I appreciate all of the awesome work that’s been done on AI FDE over the past month. Context management is much better.
Got a strange message today that the window is being wasted by hidden items
The agent is typically working within window of 80k - 200k window and rarely goes over 200k, which makes me think the context management tool is wired to think the window is 200k independent of model being used. Works fine but might benefit from being less aggressive for large context window models
also, how can I get access to hivemind? I try to run it but looks like I’m missing a marketplace installation.
Hey, thanks for the signal. We let the model know its context window in the system prompt (you can see this by expanding the system prompt at the top!)
The model however doesn’t know its current context usage exactly but can estimate it based on the existing items in its context stream. So the message you saw might have been more about the model having many different types of things in the context and that being detrimental to performance. The model cleaning up its context as it goes along is intentional. The larger context windows don’t really translate to better context management because there might be a lot of things polluting the context. We are constantly iterating on this and the feedback helps a lot.
Thank you!
