And as for compares, they should be done across systems, like with cartridges
To me, there’s a significant difference between ‘comparing’ and ‘assigning a preference’.
Assigning preferences is something we do constantly, relative to our perception, and as such, requires nothing other than our perception expressed via a subjectivized opinion. I did that when I went to Munich, preferring some systems to others, and in some cases digital to vinyl and vinyl to digital in the same system, which, given the variables - none of which were under my control - resulted in observations limited to my perception and therefore of a lesser observational value to any one else.
However, saying one compared two cartridges, on different arms, with unique VTA, SRA, tracking force, cartridge loading, volume setting to compensate for output differences, internal wiring, and on two different turntables without mitigating/eliminating those variables or at the very least attempting to contextualise them is not, to me, a comparison - simply the assigning of preference, relative to the specific inter-dependencies of that particular system. Comparing two cartridges, on the same arm with the same wiring, into the same phono stage with the same interconnects, on the same turntable, and set up in such a way that each is performing at its best relative to its physical and electrical potential is, to me, a much more relevant method for evaluation of each cartridge's strengths and weaknesses, and as such, has the potential to confer a greater level of observational value relative to the former.
That I would never consider either the audition nor purchase of a cartridge without first taking into account the arm and turntable it was mounted to, relative to its compliance, output voltage, internal impedance, and ideal load impedance perhaps makes me an anomaly (1), but I appreciate that we all choose evaluation methods that best suit our ideology at any given moment.
853guy
(1) I admit I personally do not consider the cart/arm/table/phono stage to be independent entities - to me, they are hugely electrically and mechanically inter-dependent, and are best considered as a single entity. YMMV.