LLM Training
Collection
3 items • Updated
🏝️ On Vacation
Aditya Tiwari
SyncreticAI
AI & ML interests
None yet
Recent Activity
updated a collection 3 days ago
LLM Training updated a collection 3 days ago
LLM Training updated a collection 3 days ago
LLM Training Organizations
None yet
updated 2
collections 3 days ago
liked a
model 11 days ago
reacted to Banaxi-Tech's post with 🔥 11 days ago
Post
2809
We're excited to release BananaMind 2 Micro, our smallest model yet.
It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models.
It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini.
BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1)
For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights.
Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235*
Check it out at BananaMind/BananaMind-2-Micro and follow us at:
@vovaRL
@DedeProGames
@Banaxi-Tech
BananaMind
Our new releases aren't stopping 🚀 August 13-14 BananaMind 2 Pro
It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models.
It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini.
BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1)
For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights.
Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235*
Check it out at BananaMind/BananaMind-2-Micro and follow us at:
@vovaRL
@DedeProGames
@Banaxi-Tech
Our new releases aren't stopping 🚀 August 13-14 BananaMind 2 Pro
- 9 replies
liked 2
models about 1 month ago
liked 5
models about 2 months ago
transformerlab/ideogram-4-gguf-q4_k
Text-to-Image • 19B • Updated • 64 • 9
ostris/ideogram_4_turbotime_lora
Text-to-Image • Updated • 12.1k • • 135
ideogram-ai/ideogram-4-fp8
Text-to-Image • 9B • Updated • 39.9k • • 754
Serveurperso/ACE-Step-1.5-GGUF
0.7B • Updated • 337k • 89
k2-fsa/OmniVoice
Text-to-Speech • 0.6B • Updated • 938k • 1.3k
liked a
model 2 months ago
updated a
model 2 months ago
published a
model 2 months ago
liked a
dataset 2 months ago
updated a
collection 2 months ago