Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

unsloth
/
gemma-4-26b-a4b-it-UD-MLX-4bit

Image-Text-to-Text
Safetensors
gemma4
unsloth
gemma
google
conversational
4-bit precision
Model card Files Files and versions
xet
Community
4

Instructions to use unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Local Apps Settings
  • Unsloth Studio

    How to use unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit with Unsloth Studio:

    Install Unsloth Studio (macOS, Linux, WSL)
    curl -fsSL https://unsloth.ai/install.sh | sh
    # Run unsloth studio
    unsloth studio -H 0.0.0.0 -p 8888
    # Then open http://localhost:8888 in your browser
    # Search for unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit to start chatting
    Install Unsloth Studio (Windows)
    irm https://unsloth.ai/install.ps1 | iex
    # Run unsloth studio
    unsloth studio -H 0.0.0.0 -p 8888
    # Then open http://localhost:8888 in your browser
    # Search for unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit to start chatting
    Using HuggingFace Spaces for Unsloth
    # No setup required
    # Open https://huggingface.co/spaces/unsloth/studio in your browser
    # Search for unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit to start chatting
    Load model with FastModel
    pip install unsloth
    from unsloth import FastModel
    model, tokenizer = FastModel.from_pretrained(
        model_name="unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit",
        max_seq_length=2048,
    )
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Updated all with official Gemma chat template update

#4 opened 9 days ago by
danielhanchen

Are there any plans for a QAT UD MLX version?

#3 opened about 1 month ago by
WowOhNo

Declare compatibility with the MLX library

👍 2
1
#2 opened 3 months ago by
l2dy

This model upload seems to be broken or incomplete

👍 1
1
#1 opened 4 months ago by
pt-ml
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs