Lesson 21 of 29 · Language Models

How might LLMs store facts

Optional. The multilayer perceptron blocks, which are two thirds of the parameters and get a fraction of the attention. Speculative in places, and honest about which places.

Video not playing? Some channels disable embedding, and there is no way around it.Open on YouTubeinstead — then come back and mark it complete.