Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

kylesayrs updated a model 1 minute ago

inference-optimization/gemma-4-26B-A4B-it-NVFP4-REAP-50

kylesayrs updated a model 2 minutes ago

inference-optimization/DeepSeek-V4-Flash-BF16-NVFP4-REAP-50

kylesayrs updated a model 2 minutes ago

inference-optimization/DeepSeek-V4-Flash-BF16-NVFP4-REAP-25

View all activity

inference-optimization 's models 440

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.adamw-qwen235b-instruct-bs16-v2-ckpt0

2B • Updated Jul 21 • 3

inference-optimization/Inkling-0.6B-A0.6B

Image-Text-to-Text • 0.6B • Updated Jul 20 • 62 • 1

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab-qwen235b-instruct-bs16-ckpt7

2B • Updated Jul 20 • 4

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab-qwen235b-instruct-bs16-ckpt6

2B • Updated Jul 20 • 4

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon-qwen235b-instruct-bs16-ckpt5

2B • Updated Jul 20 • 4

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon-qwen235b-instruct-bs16-ckpt4

2B • Updated Jul 20 • 4

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon-qwen235b-instruct-bs16-ckpt3

2B • Updated Jul 20 • 5

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon-qwen235b-instruct-bs16-ckpt2

2B • Updated Jul 20 • 5

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon-qwen235b-instruct-bs16-ckpt1

2B • Updated Jul 20 • 5

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon-qwen235b-instruct-bs16-ckpt0

2B • Updated Jul 20 • 4

inference-optimization/Inkling-0.6B-A0.6B-NVFP4-FP8

0.6B • Updated Jul 20 • 25

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab-qwen235b-instruct-bs16-ckpt5

2B • Updated Jul 19 • 3

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab-qwen235b-instruct-bs16-ckpt4

2B • Updated Jul 19 • 3

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab-qwen235b-instruct-bs16-ckpt3

2B • Updated Jul 19 • 4

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab-qwen235b-instruct-bs16-ckpt2

2B • Updated Jul 18 • 4

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab-qwen235b-instruct-bs16-ckpt1

2B • Updated Jul 18 • 4

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab-qwen235b-instruct-bs16-ckpt0

2B • Updated Jul 18 • 4 • 1

inference-optimization/Inkling-0.6B-A0.6B-NVFP4-FP8-unconverted

0.6B • Updated Jul 18 • 12

inference-optimization/Qwen3-VL-1.0B-A0.4B-Instruct

Image-Text-to-Text • 1B • Updated Jul 17 • 77 • 1

inference-optimization/Qwen3-8B-speculator.dflash.swa.causal-qwen235b-instruct-bs16.adamw-g7-ckpt9

2B • Updated Jul 17 • 3

inference-optimization/Qwen3-8B-DFlash-b16-fullattn-fulldataset-rerun-clean-muon1e3-ckpt1

2B • Updated Jul 17 • 3

inference-optimization/Qwen3-8B-DFlash-b16-fullattn-fulldataset-rerun-clean-muon1e3-ckpt0

2B • Updated Jul 16 • 3

inference-optimization/Qwen3-8B-speculator.dflash.swa.causal-qwen235b-instruct-bs16.adamw-g7-ckpt8

2B • Updated Jul 16 • 4

inference-optimization/Qwen3-8B-DFlash-b16-fullattn-fulldataset-rerun-clean-muon1e3-ckpt0-halfepoch1

2B • Updated Jul 16 • 4

inference-optimization/Qwen3-8B-speculator.dflash.swa.causal-qwen235b-instruct-bs16.adamw-g7-ckpt7

2B • Updated Jul 16 • 3

inference-optimization/thinkingmachines-Inkling-speculator.dflash

6B • Updated Jul 16 • 79

inference-optimization/Qwen3-8B-DFlash-b16-fullinstruct-muon1e3-ckpt1

2B • Updated Jul 15 • 6

inference-optimization/Qwen3-8B-DFlash-b16-fullinstruct-muon1e3-ckpt0

2B • Updated Jul 15 • 5

inference-optimization/Qwen3-8B-speculator.dflash.swa.causal-qwen235b-instruct-bs16.adamw-g7-ckpt6

2B • Updated Jul 15 • 5

inference-optimization/Qwen3-8B-DFlash-b16-fullinstruct-muon1e3-ckpt2

2B • Updated Jul 14 • 5