Data Attribution

EleutherAI 's Collections

Data Attribution

Evals

Deep Ignorance

Pythia Scaling Suite

PolyPythias

Quirky Models and Datasets

Pile-T5

Quirky Math (archive)

Pile-T5 T5x Checkpoints

Sparse Autoencoders

updated 1 day ago

Leave-1%-out retrain banks and datasets for training-data attribution: measured per-query loss changes, the ground truth for LDS.

Upvote

EleutherAI/LDS-retrain-bank-adamw-N4k-bs256

Viewer • Updated 21 days ago • 2k • 643
EleutherAI/LDS-retrain-bank-adamw-N8k-bs256

Viewer • Updated 21 days ago • 4.64k • 174
EleutherAI/LDS-retrain-bank-muon-N8k-bs256

Viewer • Updated 21 days ago • 2k • 231
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256

Viewer • Updated 21 days ago • 3.2k • 510
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.25

Viewer • Updated 21 days ago • 2.9k • 473
EleutherAI/LDS-retrain-bank-muon-N4k-bs256

Viewer • Updated 21 days ago • 2k • 211
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-ep4

Viewer • Updated 20 days ago • 4k • 361
EleutherAI/LDS-retrain-bank-adamw-N32k-bs256

Viewer • Updated 20 days ago • 4k • 327
EleutherAI/LDS-retrain-bank-muon-N16k-bs16

Viewer • Updated 20 days ago • 4k • 419
EleutherAI/LDS-retrain-bank-muon-N32k-bs256

Viewer • Updated 20 days ago • 4k • 315
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-gpt2-medium

Viewer • Updated 20 days ago • 4k • 340
EleutherAI/bergson-smollm2-lds-chunks

Viewer • Updated Jul 17 • 60.1k • 70
EleutherAI/bergson-smollm2-scaling

Viewer • Updated 25 days ago • 512k • 121
EleutherAI/LDS-retrain-bank-adamw-N16k-bs128

Viewer • Updated 22 days ago • 2k • 19
EleutherAI/LDS-retrain-bank-adamw-N16k-bs16

Viewer • Updated 22 days ago • 2k • 57
EleutherAI/LDS-retrain-bank-adamw-N16k-bs32

Viewer • Updated 22 days ago • 2k • 19
EleutherAI/LDS-retrain-bank-adamw-N16k-bs512

Viewer • Updated 22 days ago • 2k • 13
EleutherAI/LDS-retrain-bank-adamw-N16k-bs64

Viewer • Updated 23 days ago • 2k • 213
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-clip1.0

Viewer • Updated 22 days ago • 2.9k • 15
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.5

Viewer • Updated 22 days ago • 2.9k • 7
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.0

Viewer • Updated 22 days ago • 2.9k • 37
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.1

Viewer • Updated 22 days ago • 2.9k • 48
EleutherAI/LDS-retrain-bank-muon-N16k-bs128

Viewer • Updated 23 days ago • 2k • 561
EleutherAI/LDS-retrain-bank-muon-N16k-bs32

Viewer • Updated 22 days ago • 4k • 31
EleutherAI/LDS-retrain-bank-muon-N16k-bs64

Viewer • Updated 22 days ago • 2k • 12
EleutherAI/LDS-retrain-bank-muon-N16k-bs256

Viewer • Updated 22 days ago • 5.64k • 385
EleutherAI/LDS-retrain-bank-adamw-N64k-bs256

Viewer • Updated 17 days ago • 4.18k • 171
EleutherAI/bergson-wikitext-2-gpt2

Updated 16 days ago • 15
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1004

Viewer • Updated 16 days ago • 89.9k • 666
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1005

Viewer • Updated 16 days ago • 96.2k • 235
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1006

Viewer • Updated 16 days ago • 96.2k • 632
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1008

Viewer • Updated 16 days ago • 96.2k • 653
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1007

Viewer • Updated 16 days ago • 96.2k • 519
EleutherAI/LDS-retrain-bank-london16k-bs256-muon

Viewer • Updated 12 days ago • 2k • 99
EleutherAI/PARTIAL_LDS-retrain-bank-muon-N64k-bs256

Updated 12 days ago • 323
EleutherAI/PARTIAL_LDS-retrain-bank-gpt2medium-16k-bs32

Viewer • Updated 12 days ago • 1.3k • 312
EleutherAI/pile-heldout-queries-2048

Updated 1 day ago • 42
EleutherAI/fineweb-heldout-queries-2048

Updated 1 day ago • 27

Upvote