Unfortunately most reviews are mainly centered on a single piece of equipment, expecting magic from it. 99% of the time a negative review implies that the reviewer was not able to create a system that could play with such component, or just that the equipment was not compatible with his too narrow preferences. In such cases IMHO it is better not publishing it. A piece of equipment is not an independent entity, such as a book or an artistic work.
I completely forgot to mention it on my first post; it was on my mind but it slipped away through the mind's corridor.
You are very right, and some most pro audio reviewers are aware of it; they mention all the gear of their reference system connected to the new audio product under review.
But they don't compare and mix/match with all the other products; it is impossible. And therefore the highest challenge for us, the readers/future potential customers with the most definitive love passion that this earth has ever felt before; not even having the slightest slice of clue. You cannot repair a broken heart in the year 2017, unless you have the tools and the expertise. And the body has to accept it, have a strong immune system, a solid synergy in adapting to the new host, in balanced harmony.
Francisco, in concrete audio words, a professional audio review has to take accounts of all variables observed by the reviewer; I have no objection about the publication of full honest unbiased audio product reviews. Today it's like reading a poetry book, or a sci-fi fantasy. ...From some.
If a speaker for example is under review, the most important piece of audio equipment, parallels need to be sculpted in the floor and across all room's walls and surfaces and furniture. Some do to a certain extent, others are on a different set of tracks.
A loudspeaker is simple; it has to harmonize the natural acoustics of the room (preferably ours more than the reviewer's own), and with our natural own set of ears, more than the pro reviewer's own. If the pro reviewer can put himself in our shoes, in our rooms, and with our ears; I'm all ears. :b It's fine; we all do our jobs without imposing, dictating, sugarcoating. After all we all eat some cake.
"No direction home" ...Bob Dylan. There are so many directions that to find one where we feel completely numb and comfy @ home (planet Earth) with ourselves and everyone else...is the ultimate zone of apotheosis, and on all levels; our five senses, plus the core, the grid, the brain.
If reviewing a pair of monoblock amplifiers, showing the internals, taking measurements, listening to them amps with the speakers mated to them and the cables used and the source (turntable, music server, etc.), and naming the music playing, the pressing (almost depressing because of exclusivity), etc.; it becomes almost a personal love affair between the reviewer and that product he's reviewing with all that gear chained together with it.
"Unchained my heart" ...Joe Cocker. Pro audio reviewers are artists, poets, skilled writers (some). They are talented in conveying the messages they hear from their high end. It's like they can talk to our hearts more than our brain, and unchain the power behind, where our credit cards rest peacefully awaiting the next eclipse, apocalypse. ...Way of speech.
The time we take to read the reviews that took the time of the audio reviewers to study the audio products under review can only be measured by all the readings we did from all the other audio reviewers reviewing the same audio product with their own gear in their own room. Brief it's the totality of all the reviewers, us included like Rodney said @ the thread's beginning yesterday, that forms the best overall analysis.
And with this we can make better more comfortable/judicious/smart choices for the best performance we can afford...I think.
Just an image like that: How do we know with absolute certitude? By averaging.