Your chatbot loses the thread after ten turns and breaks when the user changes topic. How do you manage conversation state?
Appending every turn is the default in tutorial code and it fails twice: on the context window and on cost. The signal is the layered assembly, the constraints you refuse to let the summarizer touch, and what you do the moment the user changes subject.
Updated Sep 2026 · Grounded in real GenAI, LLM, and AI/ML engineering interview loops and written to a senior-engineer editorial bar.
Appending every turn is the default in tutorial code and it fails twice: on the context window and on cost. The signal is the layered assembly, the constraints you refuse to let the summarizer touch, and what you do the moment the user changes subject.
Lead with where the obvious approach breaks, because that is the judgment they are screening for — most candidates jump straight to the happy path and lose the room.
Then walk the failure back through the pipeline in order, naming the one metric the customer's exec sponsor actually cares about before you propose the fix.
