Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

direct-preference-optimization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31

Base only

Active filters: direct-preference-optimization

ranjanrajib/DPO-trained-Qwen2.5-Python-Coder-7B

Text Generation • 8B • Updated 1 day ago • 322 • 2

RatanRohith/NeuralPizza-7B-V0.1

Text Generation • 7B • Updated Jan 12, 2024 • 67 • 3

RatanRohith/NeuralPizza-7B-V0.2

Text Generation • 7B • Updated Jan 21, 2024 • 69 • 1

RatanRohith/NeuralPizza-7B-V0.3

Text Generation • 7B • Updated Jan 29, 2024 • 61

tensorblock/NeuralPizza-7B-V0.2-GGUF

7B • Updated Jan 27 • 44

tensorblock/NeuralPizza-7B-V0.1-GGUF

7B • Updated Jan 27 • 16

InfiX-ai/InfiAlign-Qwen-7B-DPO

Text Generation • 8B • Updated Aug 11, 2025 • 21 • • 4

declare-lab/JAM-0.5

Text-to-Audio • Updated Aug 1, 2025 • 98 • 35

mradermacher/InfiAlign-Qwen-7B-DPO-GGUF

8B • Updated Aug 13, 2025 • 440

mradermacher/InfiAlign-Qwen-7B-DPO-i1-GGUF

8B • Updated Dec 9, 2025 • 1.17k • 1

dbest-isi/searchless-chess-9M-dpo

Reinforcement Learning • Updated Oct 28, 2025 • 4 • 1

ScottBiggs2/LLaMA-3.1-8B-Instruct-DPO-Baseline

Text Generation • 8B • Updated Dec 30, 2025 • 9

ScottBiggs2/LLaMA-3.1-8B-Instruct-DPO-Triton-Sparse

Text Generation • 8B • Updated Dec 30, 2025 • 7

gaokerena/amestris-1b-dpo

Text Generation • Updated Jul 25 • 8 • 1

Yale-ROSE/Qwen3-4B-SAT-VarSelector-Sym-Aug-DPO

Text Classification • Updated Jan 31

shayfeng/qwen-dpo-adapter

Updated Apr 16 • 5

Pushkar27/GriceBench-DPO

Text Generation • Updated Apr 24 • 4

varunchundru/dpo-qwen2.5-0.5b-halueval

Text Generation • 0.5B • Updated 7 days ago • 209

Matisse6410/LlaVa-1.5-SDPO

Text Generation • Updated May 29 • 9

gaokerena/amestris-1b-dpo-sft

Text Generation • Updated Jul 22 • 7 • 1

pinkelephantlimited/pinkelephant-llm-48b-s-dpo

Text Generation • Updated 28 days ago

NextGenInstitute/socraticMuse30B

Text Generation • Updated about 1 month ago

NextGenInstitute/socraticLlama8B

Text Generation • Updated about 1 month ago

pinkelephantlimited/pinkelephant-llm-48b-s-gguf

Text Generation • 15B • Updated 21 days ago • 1.64k

Harish241412/qwen2.5-1.5b-toolcalling-dpo

Text Generation • 2B • Updated 26 days ago • 212

Fabrix-AI-Inc/Triton-VX-Qwen3.5-2B-DPO

Text Generation • 2B • Updated 24 days ago • 412

Fabrix-AI-Inc/Argos-2B

Text Generation • 2B • Updated 23 days ago • 395

mradermacher/Argos-2B-GGUF

2B • Updated 22 days ago • 1.02k

muradil211/AetherSearch_DPO

Text Generation • 3B • Updated 18 days ago • 836 • 1

mradermacher/DPO-trained-Qwen2.5-Python-Coder-7B-GGUF

8B • Updated 1 day ago • 235