Objectivist or Subjectivist? Give Me a Break

Gentlemen, in the best interests of the forum this thread will now be closed for two days. In the meantime, please reflect on what it is you are trying to say and from here on out make nothing personal. There are many mis-quotes so please take the time to go back and re-read.

When the thread resumes, please take what you have to say and act as if you are talking to your college professor. This includes everybody. We are all better than this.

Tom
 
OK, have we all had a chance to cool down and enjoy life a little bit?

We'll try this again. Please stay on topic, make nothing personal and communicate as if your mother were standing right next to you. Once again, please take what you have to say and act as if you are talking to your college professor. This includes everybody. I would also like to take the time to remind those folks either reading this thread or responding to this thread to report any Terms of Service violations to the management team. Please do not attempt to moderate the thread on your own. A repeat of the last few pages will not be tolerated, period. Remember, cordial discussions.... :)

With that said, the thread is now open again.

Tom
 
Has it been 2 days already? Time flies when you're having fun.

Tim
 
John


I will publicly declare that I don't think I have nor intended to demean your products. I do however wanted to point that there was in my view a disconnect between the point of view you expressed in this discussion and the reality of designing a product. Somewhere instruments will be used and their measurements interpreted, balanced by auditions. That's to me the reality of designing an electronics component
As for the Quality of your products, I do not have any personal experience with them. I wanted to take your offer to audition one whose review I read. Ihave been unfortunately travelling too often these days and would not be able to properly audition it.

And now back to our scheduled discussion
 
John


I will publicly declare that I don't think I have nor intended to demean your products. I do however wanted to point that there was in my view a disconnect between the point of view you expressed in this discussion and the reality of designing a product.
Frantz, you made an incorrect logical jump, in my opinion, from a discussion we were having about listening to audio/reality into a completely different topic, that of designing audio devices. You then made another logical fallacy with an incorrect assumption about my approach to design. So firstly the jump was a fallacy & secondly your assumption was a fallacy. I hope you can see this?

To me there is/was no connection & I can't understand your logic. I took it as a low blow & attempt at point scoring to win a debate.

I also listen in two different ways - one being analytically & another for emotional engagement.
Somewhere instruments will be used and their measurements interpreted, balanced by auditions. That's to me the reality of designing an electronics component
Again, I see no connect to the type of listening that done when using audio as entertainment & when listening (more correctly auditioning) audio during design phase. Frantz, can I ask you do you or have you ever designed audio equipment?
As for the Quality of your products, I do not have any personal experience with them. I wanted to take your offer to audition one whose review I read. Ihave been unfortunately travelling too often these days and would not be able to properly audition it.

And now back to our scheduled discussion
You are welcome any time to audition my devices. Unfortunately the DAC32 is with Peter at the moment! A review of my two DACs has just been posted and comparison against an Audio Note 2.1 Signature DAC. If you wish I can post a link?
 
Thank goodness this thread is reopened, i was beginning to see sujective-objective debate starting to creep into "what's your favorite restaurant" and "what's your pet's name" threads.
Not to open a can of worms, but could somebody do an executive summary of each side's position at this point? I've visited along the way, but I'm not sure I'm ready to devote hours to catching up on each post.
 
-snip-
Not to open a can of worms, but could somebody do an executive summary of each side's position at this point? I've visited along the way, but I'm not sure I'm ready to devote hours to catching up on each post.
If I can give a exec summary of my position & others do the same it might help to bring this thread to some conclusion.

I am saying that holding up "partial measurements" as a complete characterisation of a device is a logical fallacy. Others seem to jump on this as being a rejection of all measurements. Not so. I'm just suggesting that there may well be important/crucial information in the measurements which haven't been taken. I'm simply saying that this possibility needs to be borne in mind before making bullish statements about measurements. I'm also not saying that we have to wait for discovery of new measurements, I'm saying that all necessary existing measurements are not being used & therefore a device remains uncharacterised by measurements. I posted a list of what appears to be a fairly comprehensive list for amplifiers when "amplifier differences" was the hot topic
To have some chance of characterising an amplifier I have seen the following list of measurements being cited as necessary:
"S/n ratio, frequency response, IMD/multi-tone distortion (for all levels, all loads, full bandwidth), channel separation, distortion of crosstalk signal, load tolerance, output impedance, stability margin, supply rejection, EMI susceptibility, ..."

Has anybody seen such a list of measurements for any amplifier? If not then how can people argue that Tube/SET amplifiers are preferred because people like distortion?
Yet some people seem to argue using measurements as support without admitting to the incompleteness of the set of measurements.

So I would become an objectivist tomorrow if the effort was put in to do this & provide some rigour to a set of measurements. I just wanted to point out this blind spot that a lot of objectivists seem to miss.

Now the usual come-back to the subjectivists is to "prove" they hear differences between A & B by doing blind-tests, but I find this is just distracting from the lack of rigour in the measurements i.e a partial list from which conclusions are being extrapolated which may or may not have validity.

That's my summary - hope it helps :)

Edit: I see I have to highlight phrases in what I say so that people don't misread or deliberately mis-represent what I say
 
Last edited:
Hit a nerve terry? It was not directed at you or anybody in particular.

Not in the slightest Jack, and I also did not for one second think it was directed at me, I knew it was a 'genera; observation' type thing. As it was a general thought not only could I see what you meant I also saw the 'fallacies' inherent in 'general observations'. They have the ring of truth when it stays within the bounds of general observations (folklore, grandmas wisdom type of stuff) but quickly fall apart when taken outside the restrictions they need to stay valid. It was your post with the concept which is why I quoted it, twas not directed towards you if you follow.

Indeed, it seems that you also agree with my points on the general observation..

No we do not go investigating every single claim and yes that is the job of the claimant. The burden of proof is his. Do note however that I said OBSERVATIONS. Those are very different from a claims.

You seem to be making an assumption on the next point however, that an observation (which could be true or not) is automatically true. A simple example, a group of philes are at a demo and the assistant holds up the python sized speaker cables and go behind the speakers. All report massive improvements, yet those cables were never put in the chain.

I am sure we all know that one (dunlavy)

So in this case, what would we call those reports? Observations? Well, no we cannot call them that because they were not true per your definition above. Then they must be a claim. How do we determine the difference between a claim and an observation? Measurements? A successful dbt? Dunno.

Since you and Keny seem to be having a go, lets use DACs as an example. Supposing we start seeing a significant number of observations out on the field about a certain DAC. In this case let's make it a negative one. Let's say the observation is that it sounds sharp. As the maker of the DAC you could say, the hell with you my baby is perfect. My test unit measures perfectly ergo yours should too. We know this would be foolish because it suffers from availability bias. He could say show me a measurement to prove it. The guy gives him a snapshot of an RTA that shows a peak at 2k. The DAC maker says it could be anything else in the chain. That is indeed a possibility after all. The customer says his old DAC didn't have the peak and shows him an RTA of that. The DAC maker demands more proof and asks that the measurements be taken at the outputs. At this point the customer says FU and demands a refund. Problem is, like the vast majority of consumers his customer doesn't have a measuring suite and all he's got is an app or a radioshack SPL meter.

Questions:

Would the inability to provide proof remove the possibility that the unit observed really might have caused the 2k peak? Like for example that quite a number of the units shipped out actually suffered from defects while the in house unit did not?

A claim is one thing. An observation is another. An observation will most likely be a qualitative and not quantitative one. The burden of proof shifts in this instance.

There is a lot in there! I fully get the point you are trying to make, just as I got your earlier one. But, seein as how you asked me basic courtesy demands I respond. My first point is that yes, I do fully get what you are trying to illustrate. Something akin to adverse reports with drugs? (no, things are never the same between analogies so don't take me to task on that) In any case, in order to make your point, which I fully get, it has to be a rather contrived example.

Firstly, esp when dealing with personal preferences, name an audiophile bit of gear, anyone I don't care which. Now, for every report that it is sharp I can find an opposing one where it is blunt...for every report that says it is warm I can find one that says it is cold and clinical. You get my meaning. In other words, ALL subjective reports are qualatative and we know they vary wildly. This is only to show the rather unreal world nature of the example as it is given.

The customer saying FU, I don't have to prove my observations is entirely appropriate, yet once again it is an entirely different situation than this discussion, where the claim IS that measurements do not tell all. In THIS case saying 'no, no need for meaurements' is not appropriate as it was with the customer. Two entirely different situations.

But yes, I guess it is possible that the test unit at the factory measures/sounds/is different that the one in the field. That would be broken tho wouldn't it? For me, maybe not others, it is far less likley that it is NOT broken but can sound (and measure, as in your example) so different;y because it simply has a different dac chip from the same batch.

Hope that clarifies and shows that indeed I did not have any nerve touched.
 
thanks john


You mean blind test? I have no problem in blind testing two devices which I know I can differentiate & have done so many times. Please don't ask for write-ups of set-up, statistical analysis, etc. I didn't do the tests for a paper submission to AES, I did them to check my "unreliable perceptions" :)

Firstly, well I am glad that you did a blind test, but in the future could you help us the next time a subjectivist says 'blind tests are just a trap, designed to fail and so are useless and we reject them entirely' by explaining to them that that is not true please? That is a particularly muddy area, so that you know and have found it to be not true would help things.

But, we cannot ask any questions? Seriously? Not even what were the two units (or many if you have done many tests)..was it between amps? dacs? what. We can't even find out things like that??

We can't ask about statistical analysis? You did do some right? You can't even give us your basic recall? You must at least have done some analysis else how did you know you were successful. Surely you have some sort of basic recall what the results were. You have zero recollection of how it was done?

The thing you rail against is us demanding proof with blind tests, they are 'rarely done and rarely successful', it turns out you have done them and been successful-thereby not only proving us wrong and holding the 'winning hand'...take that-and you don't have it handy in your recall? The one positive proof of every thing you argue about and you can't or won't trot it out at will?

I mean it could be true, it just kinda beggars belief that the first (any others that we know of in this area??) successful blind test between units (god knows what) that shows us measurements are not all and this is all the data we get? We don;t even know what it was you tested.

I am all for finding out for yourself, good on you for doing that, but 'I did not do it for AES publication' leaves open many possibilities, 'don't ask me about it' opens many more.

Not sure if this is a claim or an observation john.:D



No I don't want TOM to explain my perceptions but if he disagrees with my perceptions & uses measurements as his support evidence then I can examine his support & point out where they might be flawed, incomplete, incompetent, etc. Mind you, I would expect that I didn't have to do this because if you are so sure of your measurements to use them as support then I expect you might have examined these factors already, no!

Ok,as a result of the test you passed you now feel confident that 'measurements don't tell all'...would that be fair? I can conclude from that that you measured both of these units and upon examining them could see nothing in the measurements that could explain the result. I mean you did measure them right? How else to be able to conclude that the measurements were insufficient.

That means you are able to provide to Tom those measurements, a set of real world examples that in essence illustrate your point. I wonder why then for all these pages you could not have simply provided these as a starting point. Would have been a lot quicker than vague 'choose from a lillion different products and show us there is no difference'. Let's narrow it down to two, and we may as well use the two you blind tested.


If you don't agree that the list of measurements I gave is a stab at the measurements needed to characterise an amplifier then you are welcome to state what should be used. My follow-up question after that measurement list was - how many times have you seen a complete list of measurements done on an amplifier which would characterise it's performance

If you are asking ME about the use of these measurements, well I personally would not have the foggiest. About the only measurement I'd be vaguely interested in would be speakers, and even then just a fleeting glance. On the second part, well I'd hazard a guess that most if not all magazine measurements are hopelessly incomplete.
 
My position is that one can draw conclusions from partial measurements. John's example is a good one: Many SET amps are very high in harmonic distortion, to the point that the distortion is a fundamental characteristic of their harmonic content. I think it is pretty reasonable assumption that the people who love the sound of those amps like that distortion. I suppose they could just be good at ignoring it, but that's a bit of a stretch. Another example is the Harman speaker studies that have been discussed so much here. They only measured FR, in-room, of speakers (though at many points on and off axis), but they successfully predicted preference in later listening tests. Partial measurements, good conclusions -- most people prefer more linear response. Complete characterization of those speakers and that room from a single measurement? Of course not. I don't think anyone would take that position seriously.

2) I also feel that holding out for "complete measurements" whatever that means, is futile, because a) they will never be "complete" as long as civilization marches forward and b) we will never agree on what is "complete" from what is available.

3) Here's where it gets dicey. In debate on an audiophile forum, we have two things -- Our personal tastes/observations and whatever measurement are available. We do not have measurements that haven't been taken, or haven't yet been discovered. So if, on my side of the debate, I have my personal tastes/observations and all the available measurement, while I may not insist that the other guy loses, and do a little victory dance in the digital end zone, I'm not likely to concede, either. I think if I go as far as to say "it's all preference, enjoy your choice," which I do often, I'm actually being gracious. YMMV on that gracious part.

Tim
 
Not in the slightest Jack, and I also did not for one second think it was directed at me, I knew it was a 'genera; observation' type thing. As it was a general thought not only could I see what you meant I also saw the 'fallacies' inherent in 'general observations'. They have the ring of truth when it stays within the bounds of general observations (folklore, grandmas wisdom type of stuff) but quickly fall apart when taken outside the restrictions they need to stay valid. It was your post with the concept which is why I quoted it, twas not directed towards you if you follow.

Indeed, it seems that you also agree with my points on the general observation..



You seem to be making an assumption on the next point however, that an observation (which could be true or not) is automatically true. A simple example, a group of philes are at a demo and the assistant holds up the python sized speaker cables and go behind the speakers. All report massive improvements, yet those cables were never put in the chain.

I am sure we all know that one (dunlavy)

So in this case, what would we call those reports? Observations? Well, no we cannot call them that because they were not true per your definition above. Then they must be a claim. How do we determine the difference between a claim and an observation? Measurements? A successful dbt? Dunno.



There is a lot in there! I fully get the point you are trying to make, just as I got your earlier one. But, seein as how you asked me basic courtesy demands I respond. My first point is that yes, I do fully get what you are trying to illustrate. Something akin to adverse reports with drugs? (no, things are never the same between analogies so don't take me to task on that) In any case, in order to make your point, which I fully get, it has to be a rather contrived example.

Firstly, esp when dealing with personal preferences, name an audiophile bit of gear, anyone I don't care which. Now, for every report that it is sharp I can find an opposing one where it is blunt...for every report that says it is warm I can find one that says it is cold and clinical. You get my meaning. In other words, ALL subjective reports are qualatative and we know they vary wildly. This is only to show the rather unreal world nature of the example as it is given.

The customer saying FU, I don't have to prove my observations is entirely appropriate, yet once again it is an entirely different situation than this discussion, where the claim IS that measurements do not tell all. In THIS case saying 'no, no need for meaurements' is not appropriate as it was with the customer. Two entirely different situations.

But yes, I guess it is possible that the test unit at the factory measures/sounds/is different that the one in the field. That would be broken tho wouldn't it? For me, maybe not others, it is far less likley that it is NOT broken but can sound (and measure, as in your example) so different;y because it simply has a different dac chip from the same batch.

Hope that clarifies and shows that indeed I did not have any nerve touched.

Thanks for taking the time to reply Terry. Ya know I always like exchanges with you. If I may, I don't think that any observation is automatically correct, in this case attributable to the device, but rather that the qualitative reaction is valid and may require further investigation. The immediate question may not be answered but it may answer something else. In your example the answer came quick enough!

I never disputed the existence of expectation bias. God knows I've made adjustments on a channel strip and "heard" a difference when doing this on the wrong channel! :D My favorite is the one about the speakers painted different colors and folks said the red ones sounded fast and the black ones sounded dark. LOL. What it proves is that there is a lot to learn from even poor or outright incorrect observations. My secondary point was not to "burn down the house to roast a pig" to borrow a quote from one of my former teachers.

We do agree that the situations are indeed different and I put forward that it is these differences in circumstance and thought process that creates friction when these cannot be communicated properly.


BTW just got back from Brisbane. I had a blast. It was my first time Down Under. :D
 
Thanks for taking the time to reply Terry. Ya know I always like exchanges with you.

Twas my pleasure, and we should have more exchanges eh?!:D

I never disputed the existence of expectation bias. God knows I've made adjustments on a channel strip and "heard" a difference when doing this on the wrong channel! :D

We are talking in the studio here?? Every studio guy I have spoken too swears the truth of the 'disabled channel'...set aside for the band member who is adamant that 'this needs a a bit more (something)'. so the engineer tells him 'tweak this channel, don't go above this line or below that line, but tweak till it sounds right to you'. Of course he does, it sounds better and all walk away happy. That it was never connected matters little, it is the end result that is important!


BTW just got back from Brisbane. I had a blast. It was my first time Down Under. :D

"YES" to all of the rest of your post.

Glad you enjoyed your little trip. I guess it is always implied but may as well make it explicit, if there is a next time and you make it down my way I would hope you would pop in if that was your pleasure. It would indeed be MY pleasure! If it were ever to coincide with early october, then it would be an even greater pleasure to have you come to our race weekend shindig (you are into cars too if I recall correctly? The bathurst race is THE race of the australian calendar. you'd probably love it as well). About thirty or so audio guys descend to my place and stay for three or four days, lot's of music, BBQ's and general good times, all anchored with a love of all things audio. You'd be made an honoured guest:D:D

I linked to it earlier when mark asked about my system, hope you can see it is a fun time.
 
I'd love to visit Terry! BBQ, Music, Cars....three of my favorite things! I was in QLD for the Mercedes Trophy Asian finals (golf) we had a driving day with slaloms, a short closed road course and skid pad. My playing partner was almost mauled by a huge male Kangaroo when he got too close. LOL. :)
 
It seems like an explanation of the fundamentals of logic is required here.

If a partial measurement CORRELATES with an audible characteristic then we can say that measurement can be used to determine how two devices will sound with respect to that characteristic. So if A measures better than B in that particular measurement A will sound better than B in that particular characteristic. A might measure worse than B in another audibly CORRELATED characteristic & so it will sound worse than B in that particular characteristic.

Now, it is foolish, illogical & down right wrong to now pick a measurement which DOES NOT correlate to audibility, THD for instance & say that A's THD measures lower than B's THD, but people like the sound of B better than A therefore those people like the sound of higher THD - a complete fallacy & utterly ridiculous. Let's measure the weight of A & find that it is heavier than B but people like B better therefore people like lighter devices :)

So parial measurements don't have any real value unless they correlate to audible characteristics

If you want to use measurements to draw conclusions then you either have to have measurements that correlate to an audio characteristic (& then you can say something about that characteristic) or at least try to have as full a set of measurements that have some chance of characterising the device.

Latching onto a simple measurement & drawing simple & illogical conclusions is what I object to with so-called objectivists. In fact objectivist is a misnomer because there's nothing objective about doing that!
 
Do "standard" tests measure everything, no, they don't. No true, educated, objectivist would say so.

I fully agree. It's the ones that do that raise the ire of the subjectivist crowd (and many of the sincerely objective too). You know, the ones that make it look like they've correlated everything. To me they are no different from the guys that walk into a Casino saying "I have a SYSTEM!". Good luck I say! :D

BTW I really loved the video posted of Mr.Carver discussing that challenge. What surprised me was when he said distortion had nothing to do with his success and said that in fact he didn't even use the distortion pots. He said it was tonal balance that he tweaked.
 
ILatching onto a simple measurement & drawing simple & illogical conclusions is what I object to with so-called objectivists. In fact objectivist is a misnomer because there's nothing objective about doing that!

What does correlate well with proclaiming oneself an 'objectivist' is the propensity to object to other people's listening reports if they've not arisen from 'properly conducted' listening tests, 'properly conducted' never being given a falsifiable definition.
 
It seems like an explanation of the fundamentals of logic is required here.

If a partial measurement CORRELATES with an audible characteristic then we can say that measurement can be used to determine how two devices will sound with respect to that characteristic. So if A measures better than B in that particular measurement A will sound better than B in that particular characteristic. A might measure worse than B in another audibly CORRELATED characteristic & so it will sound worse than B in that particular characteristic.

Now, it is foolish, illogical & down right wrong to now pick a measurement which DOES NOT correlate to audibility, THD for instance & say that A's THD measures lower than B's THD, but people like the sound of B better than A therefore those people like the sound of higher THD - a complete fallacy & utterly ridiculous. Let's measure the weight of A & find that it is heavier than B but people like B better therefore people like lighter devices :)

So parial measurements don't have any real value unless they correlate to audible characteristics

If you want to use measurements to draw conclusions then you either have to have measurements that correlate to an audio characteristic (& then you can say something about that characteristic) or at least try to have as full a set of measurements that have some chance of characterising the device.

Latching onto a simple measurement & drawing simple & illogical conclusions is what I object to with so-called objectivists. In fact objectivist is a misnomer because there's nothing objective about doing that!

In order to make your statement about THD, you first need to show that a higher THD is not the cause of people liking B better than A. You can't assume this any more than you can assume that the weight of an audio component has no effect on how people hear it
 
In order to make your statement about THD, you first need to show that a higher THD is not the cause of people liking B better than A. You can't assume this any more than you can assume that the weight of an audio component has no effect on how people hear it

Wrong! You are making a logical fallacy! Do I have to also show that the colour, weight, size, shape, (any other difference you care to mention) are also not the cause for people liking B over A. You make the claim, you prove the connection/correlation!

It's the basics of logic!

So what you are saying is two devices are different in so many ways therefore I will pick this one random difference & claim that it is the reason that the two sound different? Now it's up to me to prove that you are wrong?
 
Last edited:
OK, so you agree that is a flawed statement - "people that like X amp over Y amp & X amp shows a higher THD than Y amp, therefore people like distortion"

Yes, the null test seems like a good candidate! So we are trying to test whether two amplifiers show any difference because people say they can hear a difference! So let's look at the null test. If you take it on the output of the amplifier you are not testing what is heard by a listener, right? So what has to be nulled is the output from the speaker, right? The same speaker that people use when they say they are hearing the difference. Now you have to use a microphone & A/D stag to capture the speaker output. You have to do control tests that prove the microphone & A/D stage is transparent enough to capture the level of detail that you deem appropriate. So what level of detail do you claim is appropriate? Then you have to produce the evidence! I wish you luck at achieving a reasonable null!

Have you ever seen the null test done in this way?

I think John K said this:

To have some chance of characterising an amplifier I have seen the following list of measurements being cited as necessary:
"S/n ratio, frequency response, IMD/multi-tone distortion (for all levels, all loads, full bandwidth), channel separation, distortion of crosstalk signal, load tolerance, output impedance, stability margin, supply rejection, EMI susceptibility, ..."


Add in phase response and you got a pretty good measurement suite. And add in if the device or distortions all null to something less than say 75 or so db on music, then dang near nobody, nowhere can humanely hear a difference. Now, we can all decide if "what" we hear is close to the real thing, but thats not measurements, measurments are simply revealing the replication of what signal is input. Tone per our ears is per our ears, and not the same thing.

That null test is very hard to argue against, just the db threshold that humans stop hearing things at is arguable.

Do "standard" tests measure everything, no, they don't. No true, educated, objectivist would say so. Is there a point where a null test can prove that one is hearing things in their imagination, yes, at what level down does the null test have to be is debatable, but IMO null testing is absolute! Notice that CARVER used that test to match two different amps to the point they sounded the same. There you have it, if you want it.
 
Last edited:

About us

  • What’s Best Forum is THE forum for high end audio, product reviews, advice and sharing experiences on the best of everything else. This is THE place where audiophiles and audio companies discuss vintage, contemporary and new audio products, music servers, music streamers, computer audio, digital-to-analog converters, turntables, phono stages, cartridges, reel-to-reel tape machines, speakers, headphones and tube and solid-state amplification. Founded in 2010 What’s Best Forum invites intelligent and courteous people of all interests and backgrounds to describe and discuss the best of everything. From beginners to life-long hobbyists to industry professionals, we enjoy learning about new things and meeting new people, and participating in spirited debates.

Quick Navigation

User Menu

Steve Williams
Site Founder | Site Owner | Administrator
Ron Resnick
Site Owner | Administrator
Julian (The Fixer)
Website Build | Marketing Managersing