Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

47,935

Base only

Active filters: 4-bit

lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit

Text Generation • 31B • Updated Jul 31, 2025 • 159k • 35

mlx-community/Qwen3-Coder-30B-A3B-Instruct-4bit

Text Generation • 31B • Updated Aug 6, 2025 • 7.35k • 31

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Sep 5, 2025 • 225k • 9

mlx-community/Seed-OSS-36B-Instruct-4bit

Text Generation • 36B • Updated Aug 21, 2025 • 60 • 3

QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Oct 8, 2025 • 1.28M • 44

PJMixers-Dev/Qwen3-30B-A3B-Instruct-2507-bnb-4bit

Text Generation • 31B • Updated Oct 12, 2025 • 48 • 1

manasmisra/GLM-4.5-Air-REAP-82B-A12B-mlx-4Bit

Text Generation • 82B • Updated Oct 21, 2025 • 43 • 3

openguardrails/OpenGuardrails-Text-2510

Text Generation • 15B • Updated 19 days ago • 1.31k • 11

garrison/GLM-4.5-Air-REAP-82B-A12B-mlx-4Bit

Text Generation • 82B • Updated Nov 18, 2025 • 33 • 2

MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF

Text Generation • 12B • Updated Nov 28, 2025 • 27.8k • 4

mlx-community/Ministral-3-14B-Instruct-2512-4bit

Updated Dec 3, 2025 • 1.28k • 2

yoshii-ai/Yoshii-7B-BR

Text Generation • 7B • Updated Dec 9, 2025 • 29 • 1

mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit

Image-Text-to-Text • 5B • Updated 22 days ago • 115k • 7

mbakgun/Qwen2.5-Coder-14B-n8n-Workflow-Generator

Text Generation • 15B • Updated Dec 28, 2025 • 1.96k • 19

baichuan-inc/Baichuan-M3-235B-GPTQ-INT4

Text Generation • 235B • Updated Feb 9 • 618 • 11

nota-ai/Solar-Open-100B-NotaMoEQuant-Int4

Text Generation • 2B • Updated Jan 26 • 250 • 48

mlx-community/Qwen3-ASR-0.6B-4bit

0.3B • Updated Jan 29 • 2.35k • 13

RepublicOfKorokke/Qwen3-Coder-Next-REAP-40B-A3B-mlx-mxfp4

Text Generation • 41B • Updated Feb 6 • 439 • 3

MaziyarPanahi/VulnLLM-R-7B-GGUF

Text Generation • 8B • Updated Feb 10 • 204 • 1

JiggityNun/gemma-2b-aps-it-4bit

Text Generation • 0.4B • Updated Feb 12 • 12 • 1

exdysa/MiniMax-M2.5-REAP-172B-A10B-GGUF-Q4_K_M

Text Generation • 173B • Updated Apr 27 • 46 • 3

mlx-community/Qwen3.5-27B-4bit

Image-Text-to-Text • 5B • Updated Feb 24 • 5.55k • 50

nightmedia/Qwen3.5-122B-A10B-Text-mxfp4-mlx

Text Generation • 122B • Updated Mar 11 • 1.64k • 11

QuantTrio/Qwen3.5-27B-AWQ

Image-Text-to-Text • 28B • Updated Mar 2 • 94.2k • 44

Intel/Qwen3.5-397B-A17B-int4-AutoRound

Updated Mar 14 • 16.2k • 18

mlx-community/Qwen3.5-0.8B-4bit

Image-Text-to-Text • 0.2B • Updated Mar 2 • 2.16k • 3

mlx-community/Qwen3.5-4B-4bit

1.0B • Updated Mar 2 • 19k • 8

kaitchup/Qwen3.5-4B-autoround-W4A16

2B • Updated Mar 3 • 319 • 1

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit

27B • Updated Mar 6 • 13k • 234

mlx-community/Qwen3.5-2B-OptiQ-4bit

Text Generation • 0.4B • Updated 12 days ago • 1.34k • 12