You could try fan swaps and sound dampening but it can easily end up costing more in money and time researching compatibility than what some of these servers are worth.
Starting small is what I recommend. I had a rack before. Now I just run mini PCs.