Personally, I'm interested in the experience of listening to music, more than in the signal (though I have technical background in electronics).
It is ironic but in the context of speakers/room acoustics were preference enters the equation without dispute, it is the test signals that are more revealing than music. Pink noise for example may reveal differences that are audible at far lower levels. Here is a sampling of many examples in Dr. Toole's book:
Bech separately examined the influence of several individual reflections on timbral and spatial aspects of perception. In all of the results, it was evident that signal was a major factor: Broadband pink noise was more revealing than male speech. In terms of timbre changes, only the noise signal was able to show any audible effects and then only for the floor reflection; speech revealed no audible effects on timbre.
Spectrally rich test tones expose all anomalies whereas music may not statistically have the frequency content to excite them. Or have such a content as to mask distortions. The latter comes into play with compressed music. Simple ticking sounds reveal compression artifacts better than tens of thousands of songs. What may be transparent with music, will decidedly not be so with such test tones.
This works both ways of course. Because a lot of music may not be revealing, it is easy to use them to "prove" no audible difference in subjective listening tests.
There is yet another distinction into different 'camps' – those who are interested mainly in the electronic signals and those who are interested mainly in the experience of listening to music.
I don't know that I fit any of these camps. The camp I am in is that any difference we perceive, we need to hypothesize as to their reason and work to demonstrate their effect. I am actually OK if these differences are small: let's quantify them and then judge them. What I don't subscribe to is putting aside all science and engineering, and going by highly unreliable hearing system when it comes to small differences. The odds of being right in my opinion when differences shrink is very low. We would not bet in Las Vegas with our own money with such odds. But we do it when purchasing equipment. The only way to improve the odds is to see if science can be on your side. Then at least the wind is behind you
.
To my view, there is no 'right' and 'wrong' here, only different people have different interests, or different focus.
At personal level, that is true. As a matter of science and engineer, that is not so. It says that a lot, but not maybe all that we worry about in these esoteric differences may be invalid. I am not a fan of pushing this point to extreme where ever small difference is considered inconsequential. That may be throwing the baby out with the bath water. But once we eliminate that domain -- the ones that we can measure and show lack of transparency at fundamental level -- then we enter the world of improbable from science and engineering point of view.
However, to my experience, it's impossible to maintain a dialogue between people belonging to the 2 last 'camps'. Let's leave it at that, since no member of one 'camp' is going to convert any member of the other 'camp'.
I have changed my views about this topic over the 40 years I have been in it both as a listener and audiophile and an engineer helping design some of it. I don't know how anyone would not want to learn more and with it, change their opinion. Should I have stuck to my views when test after test I thought identical differences were the same? Should I not have changed my view where in double blind tests found differences down to milliseconds that nobody else heard but objectively where there and later fixed? Should I not have changed my views where I learned the psychoacoustics of how we hear? Should I not have changed my views where I sat in a double blind speaker test and the technology that I thought was great, sounded literally "broken" when I could not see its magnificent look? Should I not have changed my views about room acoustics when I read listening test after listening tests that showed what we intuit as bad, like room reflections, can actually be beneficial?
I am going to be blunt: the only reason to not change your views is if you are not continuously learning
. I learned that my pure engineering 101 studies were wrong. I also learned that trusting my ears was wrong. I learned these things by experimentation and by really learning how the equipment worked. Once there, I tend to find myself disagreeing with extreme views in both camps.