Post
110
I trained a 210M text-to-image diffusion transformer from scratch on one GPU in 3.5 days, on 4.2M curated images at 256Ā². Same six prompts and seeds at every checkpoint of the run š
šØ Try it: ivanmikhnenkov/tinydit
What mattered most: captions that fit the images, a timestep shift for the 32-channel FLUX.2 latent, aspect-ratio buckets from step one, register tokens with learned null attention slots, and torch.compile for training.
š¤ Weights: ivanmikhnenkov/tinydit-256
š» Code, every decision with its sources: https://github.com/ivanmikhnenkov/tinydit
šØ Try it: ivanmikhnenkov/tinydit
What mattered most: captions that fit the images, a timestep shift for the 32-channel FLUX.2 latent, aspect-ratio buckets from step one, register tokens with learned null attention slots, and torch.compile for training.
š¤ Weights: ivanmikhnenkov/tinydit-256
š» Code, every decision with its sources: https://github.com/ivanmikhnenkov/tinydit