RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16 Text Generation • 4B • Updated 29 days ago • 418 • 1
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8 Text Generation • 14B • Updated 29 days ago • 333 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16 Text Generation • 14B • Updated 29 days ago • 307 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16 Text Generation • 14B • Updated 29 days ago • 1.44k • 3
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16 Text Generation • 12B • Updated 29 days ago • 337
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16 Text Generation • 12B • Updated 29 days ago • 4.47k • 4
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a8 Text Generation • 7B • Updated 29 days ago • 403 • 2
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated 29 days ago • 18k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • 8B • Updated 29 days ago • 1.21k • 12
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated 29 days ago • 1.32k • 21
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 71B • Updated 29 days ago • 322 • 5
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • 71B • Updated 29 days ago • 617 • 7
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 Text Generation • 406B • Updated 29 days ago • 220 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 Text Generation • 406B • Updated 29 days ago • 214 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • 406B • Updated 29 days ago • 402 • 11
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic Text Generation • 406B • Updated 29 days ago • 2.1k • 15