Learning about LLMs

Resources for learning about Large Language Models:

LLM Agents MOOC

The Large Language Model Agents MOOC, Fall 2024 led by Dawn Song Professor, UC Berkeley and Xinyun Chen Research Scientist, Google DeepMind.

• 12 lectures each with a quiz
• Written article assignment
• 3 lab assignments
• LLM Agents Hackathon

Mastering LLMs

Led by Hamel Husain, Mastering LLMs was a paid course that ran earlier this year. They’s released the videos on prompting, evals, RAG, find-tuning, tooling, and other topics.

Sebastian Raschka

Sebastian Raschka’s latest book is Build a Large Language Model From Scratch. He also released Building LLMs from the Ground Up: A 3-hour Coding Workshop.

Papers

• What We’ve Learned From A Year of Building with LLMs A practical guide to building successful LLM products.
• Large Language Models: A Survey Shervin Minaee, Tomas Mikolov, Narjes Nikzad, Meysam Chenaghlu, Richard Socher, Xavier Amatriain, Jianfeng Gao
• A Primer On The Inner Workings Of Transformer-Based Language Models
• The Elements of Differentiable Programming Mathieu Blondel, Vincent Roulet
• Towards Conversational Diagnostic AI AIME paper from Google