That's how you get an agent who talks to you in real time. I figured I'd go ahead and spill the beans on it. Seems someone has created a chat bot that's doing this, so she's got the idea. So IMO everyone should get it. The rabbit hole goes pretty deep though if ya think about it. Anyway, on my first Mnemara post I kinda left it open without spelling it out. Here's a better picture. My agents never make a tool call for memories. They think it, something else injects it. I send mid turn inputs, I get mid turn replies.
source & further reading
dev.to — original article
Testing In-App Chat and Customer Support Flows in Delivery Apps
Prompt Engineering, Context Engineering, Loop Engineering: What Actually Changed
Building Aigris: An On-Device AI Cybersecurity Agent for Android