Aleksa Gordić - The AI Epiphany

Shipping. x-Google DeepMind, x-Microsoft engineer explaining AI. ❤️

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

📄 Website - gordicaleksa.com/
💼 LinkedIn - www.linkedin.com/in/aleksagordic/
🐦 Twitter - twitter.com/gordic_aleksa
👨‍👩‍👧‍👦 Discord - discord.gg/peBrCpheKE

📺 YouTube - youtube.com/c/TheAIEpiphany/
📚 Medium - gordicaleksa.medium.com/
💻 GitHub - github.com/gordicaleksa
📢 AI Newsletter - aiepiphany.substack.com/

My apps:
www.crackedengineers.com/
www.hubermantranscripts.com/

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

💰 BECOME A PATREON OF THE AI EPIPHANY ❤️

If my YouTube videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!

The AI Epiphany - www.patreon.com/theaiepiphany
One-time donation - www.paypal.com/paypalme/theaiepiphany

View channel on YouTube

Switch Invidious Instance

Videos

Shorts

Livestreams

Courses

Playlists

Posts

newest

oldest

popular

2:36:17

Day 30: Open NLLB - iterating on fasttext HBS LID, filtering (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

732 views

1:41:40

Day 29: Open NLLB - testing & improving fasttext HBS LID (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

383 views

2:32:05

Day 29: Open NLLB - handling German data, training fasttext HBS LID (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

261 views

3:35:39

Day 29: Open NLLB - training fasttext LID (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

620 views

1:56:55

Day 28: Open NLLB - debugging fuzzy dedup, training fasttext LID (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

240 views

2:51:26

Day 28: Open NLLB - debugging fuzzy dedup, training fasttext LID (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

300 views

4:25:03

Day 28: Open NLLB - debugging fuzzy dedup, training fasttext LID (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

274 views

48:44

Day 27: Open NLLB - filtering stage hyperparams, HBS LID detector (Pt 3 cont.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

174 views

53:24

Day 27: Open NLLB - filtering stage hyperparams, HBS LID detector (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

198 views

2:31:29

Day 27: Open NLLB - profiling parallel fuzzy dedup, filtering stage hyperparams (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

305 views

3:02:17

Day 27: Open NLLB - speeding up fuzzy dedup, tqdm multi process (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

293 views

2:38:44

Day 26: Open NLLB - filtering HBS, union find, paper reading (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

423 views

3:16:25

Day 26: Open NLLB - filtering HBS, refactoring, wrapping up MinHash LSH (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

374 views

2:09:17

Day 25: Open NLLB - filtering HBS (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

257 views

2:11:52

Day 25: Open NLLB - filtering HBS (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

498 views

4:22:31

Day 25: Open NLLB - filtering HBS (fuzzy dedup, toxicity, LID) (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

236 views

1:46:24

Day 24: Open NLLB - back from China, filtering HBS data (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

223 views

1:40:00

Day 24: Open NLLB - back from China, analyzing spikes, preparing HBS run (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

367 views

2:08:44

Day 24: Open NLLB - back from China, fuzzy dedup, preparing HBS run (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

357 views

2:51:27

Day 23: Open NLLB - day before China trip! fuzzy dedup, paper reading (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

507 views

2:00:41

Day 23: Open NLLB - day before China trip! LID, fuzzy dedup, paper reading (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

320 views

1:19:46

Day 23: Open NLLB - day before China trip! Refactoring & pushing changes (Pt 1 cont.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

334 views

3:51:18

Day 23: Open NLLB - day before China trip! LID, parallelization, HBS tokenizer (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

570 views

2:47:21

Day 22: Open NLLB - HBS data analysis, split into Cyrillic & Latin (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

340 views

2:54:29

Day 22: Open NLLB - HBS data analysis, split into Cyrillic & Latin (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

854 views

4:15:04

Day 22: Open NLLB - HBS data analysis, split into Cyrillic & Latin (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

219 views

3:08:24

Day 21: Open NLLB - data work (Serbian, Croatian, Bosnian) (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

360 views

52:26

Day 21: Open NLLB - data work (Serbian, Croatian, Bosnian) (Pt 1 cont.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

217 views

3:53:00

Day 21: Open NLLB - data work (Serbian, Croatian, Bosnian) (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

225 views

2:49:26

Day 20: Open NLLB - data work (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

409 views

2:03:56

Day 20: Open NLLB - analyzing HBS data (Bosnian, Croatian) (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

264 views

2:52:57

Day 20: Open NLLB - downloading HBS parallel corpora (Croatian - wrap up) (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

194 views

2:43:04

Day 19: Open NLLB - downloading HBS parallel corpora (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

319 views

2:17:42

Day 19: Open NLLB - OPUS, downloading HBS parallel corpora (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

233 views

4:00:06

Day 19: Open NLLB - compute grant, downloading HBS parallel corpora (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

227 views

2:27:53

Day 18: Open NLLB - Serbian parallel corpora, paper reading (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

267 views

2:13:56

Day 18: Open NLLB - Serbian parallel corpora, paper reading, batch analysis (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

296 views

1:42:31

Day 18: Open NLLB - data loading document, GitHub tasks (Pt 1 cont.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

464 views

1:38:30

Day 18: Open NLLB - data loading document, GitHub tasks (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

232 views

2:43:55

Day 17: Open NLLB - community tasks, dataset sharding, eos token (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

367 views

2:30:04

Day 17: Open NLLB - analyzing batch iterators (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

270 views

4:44:03

Day 17: Open NLLB - eval on 2 GPUs all-gather, fairseq data loading debugging session (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

420 views

2:54:38

Day 16: Open NLLB - Weights & Biases debugging session :) (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

507 views

2:33:26

Day 16: Open NLLB - text sampling and sacrebleu eval during training (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

245 views

4:11:50

Day 16: Open NLLB - text sampling and sacrebleu eval during training (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

301 views

2:34:06

Day 15: Open NLLB - wrapping up detecting hallucinations paper (Pt 3)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

929 views

1:12:54

Day 15: Open NLLB - ALTI+, detecting hallucinations (Pt 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

493 views

3:55:06

Day 15: Open NLLB - sharding, paper reading (hallucinations) (Pt 1)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

652 views

3:06:10

Day 14: Open NLLB - exploring BLEU, chrF++, logging (Pt 3. cont. 2)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

660 views

6:44

Day 14: Open NLLB - exploring BLEU, chrF++, logging (Pt 3. cont.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

167 views

8:35

Day 14: Open NLLB - exploring BLEU, chrF++, logging (Pt 3.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

425 views

2:30:10

Day 14: Open NLLB - Eval of our first run (English, Turkish, Hindi) (Pt 2.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

294 views

4:32:45

Day 14: Open NLLB - Analyzing our first run (English, Turkish, Hindi) (Pt 1.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

319 views

3:46:21

Day 13: Open NLLB - Aya, dedup sharding analysis, analyzing training (Pt 2.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

404 views

3:55:05

Day 13: Open NLLB - FSDP paper, kicking off the 1st run (Pt 1.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

1.2K views

2:13:51

Day 12: Open NLLB - on-boarding doc for new-joiners, eval (Pt 2.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

288 views

2:37:58

Day 12: Open NLLB - on-boarding doc for new-joiners, eval (Pt 2.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

273 views

4:05:38

Day 12: Open NLLB - on-boarding doc for new-joiners, mem usage (Pt 1.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

307 views

2:40:17

Day 11: Open NLLB - FSDP, on-boarding as a new-joiner (Pt 3.)

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

394 views

2:54:22

Day 11: Open NLLB - Apex, mined data, etc.

Aleksa Gordić - The AI Epiphany

Shared 2 years ago

278 views