YANK!

SEARCH

Every line ever yanked

Every line, yank, song, channel and source, and inside every podcast and video Yank has read, down to the moment. Results follow as you type. Quote a phrase with “quotes”, exclude a word with a minus, or just type a name.

Yanks 1

Techno Optimist on Instagram: "Zuck and Wang on how to pre-train an AI model: Wang: “In the pre-training stage, everyone who’s training frontier models basically is trying to get as much data as possTechno Optimist · InstagramA rare candid exchange between two AI insiders on what it actually feels like — and costs — to pre-train a frontier model at scale.

5 lines match “Techno Optimist”

Pre-training is full of researchers who chew glass and stare out into the abyss.

Techno Optimist · Instagramyank.info/gr4uv5

All the seven stages of grief happen while you're pre-training a model.

Techno Optimist · Instagramyank.info/gr4uv5

Scaling bigger models isn't just about flops and compute — you need to scale data with it, and if the internet isn't growing that quickly, the question becomes: where does the data come from?

Techno Optimist · Instagramyank.info/gr4uv5

Your ability to infer exactly what will happen scientifically really depends on your ability to big-brain reason about everything that's happening.

Techno Optimist · Instagramyank.info/gr4uv5

You still want as much intentionality about where ultimately you want your model to be — but it just benefits from a lot more data.

Techno Optimist · Instagramyank.info/gr4uv5