Neural Canvas/What Is a Context Window? Why Long Chats Start Forgetting
What Is a Context Window? Why Long Chats Start Forgetting
A long conversation with an AI starts strong and then quietly stops holding on to what you agreed. People read that as the model losing the thread. It is simpler than that. The model is not remembering the conversation at all, it is looking at a window, and once the conversation grows past the edge of that window the oldest part falls out. This explainer covers what the window actually holds, why it is re-read from scratch every single turn, and what to do when a chat gets stuck.
The Curriculum
Track: Start Here · entry 31 of 41
See the whole track
Keep going
More from the canvas
What Are Tokens? How AI Actually Reads Your Words
Before an AI model can do anything with your message, it has to chop it up. Not into letters, and not quite into words either. It uses pieces called tokens, and once…
What Is an LLM? The Prediction Machine Behind the Chat
An LLM can feel like a person on the other side of the screen, but its core job is more mechanical and more interesting: it predicts what piece of language should come…