AETHORIA AI

non-profit

AI & ML interests

Small language models, token routing, mixture-of-experts, multimodal generation, efficient training, open datasets, multilingual NLP and optimized inference.

Recent Activity

Pacific-i64 updated a dataset about 1 hour ago

AETHORIA-AI/luciole-16way-sft-209k

Pacific-i64 published a dataset about 1 hour ago

AETHORIA-AI/luciole-16way-sft-209k

Pacific-i64 updated a model about 3 hours ago

AETHORIA-AI/TR-HASH-MoE-200M-160B-LoRA

View all activity

Organization Card

Community About org cards

AETHORIA AI

Open, efficient AI research

Community-led research into compact language models, token-identity hash routing, multimodal generation and accessible training systems.

Partner of bench-labs ↗

Featured project

TR-HASH 200M — 70B SFT

Full-parameter refinement on 70B unique tokens, on top of the TR-HASH 200M base pretrain. Reserved repository -- not started yet, no weights uploaded.

201.2M parameters 70B unique tokens Full-parameter Not started yet

Vision research

TR-HASH Vision v8

MoE-based hierarchical vision transformer, initialized randomly and trained end-to-end on COCO 2017 at 640 px, without external detector, classification backbone or pretrained weights. 50 epochs of pretraining, then 12 epochs of supervised refinement.

2.59M parameters COCO from scratch mAP50 32.5% mAP50-95 20.05%

Datasets →

Atlas Posttrain Text instruction and chat SFT corpus Atlas Images 336K provenance-aware image-text pairs Atlas Image Edits 336K instruction-guided editing triplets