hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Text Generation
•
Updated
•
42.5k
•
33
Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗