Stella Biderman
Open Models, Open Data
EleutherAI, GPT-NeoX and Pythia
Rating
87Impact score
Domains
Open language modelsTraining dataReproducibility
Scouting report
Executive director of EleutherAI, the volunteer collective that trained and released GPT-Neo, GPT-J and GPT-NeoX when nothing comparable was public, and built the Pile. Led Pythia, a suite of models released with every training checkpoint and the data order — which made a whole class of interpretability and memorisation research possible for the first time.
Curator’s note
Released the checkpoints, not just the model. That is the contribution.
Portrait
Painted from a photograph of Stella Biderman by Stella Biderman, supplied by the subject.
Sources
- 01Pythia: A Suite for Analyzing Large Language Models (2023) arxiv.org
- 02EleutherAI eleuther.ai