Their own quants for transformers run: https://huggingface.co/Qwen/Qwen-72B-Chat-Int8 https://huggingface.co/Qwen/Qwen-72B-Chat-Int4
Their own quants for transformers run:
https://huggingface.co/Qwen/Qwen-72B-Chat-Int8
https://huggingface.co/Qwen/Qwen-72B-Chat-Int4