No, a much lower cost streamer would beat many more expensive CD players, and selling existing CD players would also help get back some money. The expensive server you refer to like SGM is required to compete only against the best transports all of which are very expensive. Most off the shelf servers are pretty easy to operate too, you don't need to set up a CAPS style one. Either way, AC's point is valid - those who have not gone through these compares...
I am in the Server can beat a CDP camp. Caviet, I haven't heard a top CDP with tube regulated PS and tube on the SPDIF like an Audio Note CD5/6, but have compared quite a few CDPs in the 6K range, and my 'budget' 2.5K Mac Mini / Server combo beats them.
If you think about it, a CD transport is basically a data transfer method in real time off that disc using a laser at very high speeds. There will be timing errors and jitter. If you rip a Redbook file (for example) at 1/5th speed using something like XLD, you can in effect get a better data transfer than the spinner. Also while ripping XLD tracks the data report and checks against a database of other rips for errors, and warns you if there are any detected.
IMO the data sent from a PC/Mac or a purpose built music server loads that file into RAM and feeds it bit-perfect to a DAC, sometimes with further cocking and jitter reduction on the way. It is not difficult to see (and hear) that a server can beat the CD transport. And then there is downloads (full resolution) of the same music that is originated from the studio recordings, thus missing out the CD production element phase (which may have errors or loss in production as well). Then in a physical transport method in real time, I can also imagine there may be speed errors in the motor mechanism.
IMO the comparisons are going to come down to how optimised the PC or Mac that is sending the file, what software is used to play that file (hopefully not iTunes). And how much care has been taken getting rid of noise generated inside a typical PC, i.e. use of linear power supplies, no fan, solid state drive, stripped down system etc. A standard laptop or PC stuffed full of software and using a shared USB out port feeding a DAC is not going to go well TBH. Would you take the family 6 seater to a track day?
So in my view, if you have heard better quality from a CDP then have another look at PC or server based music again, I am confident you will hear the difference, and even if you decide it is as good, then job done. 1,000 of albums accessed in a second, it is a win win IMO.