DEV Community

Cover image for Prompt Pad: What Is a Context Window?
Jem Community Curator for Major League Hacking (MLH)

Posted on AI-assisted

Prompt Pad: What Is a Context Window?

Ever had an AI forget something you told it earlier in the same conversation? There's a reason for that.

In this episode of Prompt Pad, @rosendo_pili explains context windows, the short-term working memory behind every AI conversation.

The video in a nutshell

A context window is the maximum amount of text a model can read, process, and remember at one time. It's measured in tokens, which are chunks of words. A model with a 128k context window can take in a full book at once. But once your conversation goes past that limit, the earliest details get pushed out of the window. The larger the context window, the more a model can work with in a single session.

Try it yourself

Check the context window size of the model you use most. Then tell us in the comments: have you ever hit the limit in a long conversation? 👇


📣 Help us spread the word

Know someone who's confused about why their AI "forgets"? Send them this video. And subscribe so you don't miss the next Prompt Pad tip:

Top comments (0)