Agreed. The issues that you cite, and my experience with servers, have made me shun servers so far. I know how much of a pain it is to get them sound right (I have experienced the drama over the years in friends' systems), even though it certainly must be possible. I stick with my truly excellent transport.
I do view my digital as a system. That is also why I paid attention to the interconnect between transport and DAC. It is an important component of the system as well, and my expensive AES/EBU digital interconnect does make a substantial difference, too.
It is more expensive than my transport, and almost as expensive as my DAC. It allows for the extraordinary resolution and natural sound from these components to shine.
(And yes, the DAC itself also provides a lot of rhythm & timing, not just the digital source.)
your digital cable costs as much your dac? I’m sorry, but that’s Lol.