RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic Text Generation • 8B • Updated 23 days ago • 29.9k • 9
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated Sep 22, 2025 • 7.12k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 8B • Updated Feb 13 • 37.7k • 30
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16 Text Generation • 11B • Updated Sep 22, 2025 • 1.9k • 3
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated Sep 22, 2025 • 4.12k • 13