I don't like playing with Bluetooth controllers. It's not necessarily the amount of input latency but the inconsistency of it.

For having fun with friends Bluetooth is fine, but if possible go for a cable instead.

That said, there's the XBox Wireless Dongle which uses the same protocol as an XBox. The latency is minimal like a cable, and it does support up to 8 XBox Wireless Controller.

Sadly the Linux support isn't perfect but the xone kernel driver sees regular development.

https://github.com/medusalix/xone