TGI Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8 Text Generation • 73B • Updated Oct 9, 2024 • 886 • 37 Qwen/Qwen2.5-72B-Instruct-GGUF Text Generation • 73B • Updated Sep 20, 2024 • 12.1k • 59 Qwen/Qwen2.5-72B-Instruct-AWQ Text Generation • 73B • Updated Oct 9, 2024 • 112k • 93 nvidia/Llama-3.1-70B-Instruct-FP8 Text Generation • 71B • Updated Aug 22, 2025 • 2.7k • 21
TGI Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8 Text Generation • 73B • Updated Oct 9, 2024 • 886 • 37 Qwen/Qwen2.5-72B-Instruct-GGUF Text Generation • 73B • Updated Sep 20, 2024 • 12.1k • 59 Qwen/Qwen2.5-72B-Instruct-AWQ Text Generation • 73B • Updated Oct 9, 2024 • 112k • 93 nvidia/Llama-3.1-70B-Instruct-FP8 Text Generation • 71B • Updated Aug 22, 2025 • 2.7k • 21