The Reply Comes From the Model

Developer Savindu Thathsara reported that his ThinkPad-based voice agent now generates replies with the SmolLM2-360M model instead of returning stored lines, producing a response in 667 milliseconds and a full turn of 3840 milliseconds, with speech-to-text taking 408 milliseconds. An earlier greeting, "Hi, how about you?", came back as "hi, heh, I think I'm ready now." in 857 milliseconds, while plain commands such as "open the browser" still route to a desk agent that controls the keyboard and mouse. Thathsara publishes the work as a public log of an offline AI operating system he is building in London.

The Reply Comes From the Model The Reply Comes From the Model "What should we do today?" The ThinkPad answered, in the model's own words, "i should probably go to the market today." That sentence took 667 milliseconds to generate. Savindu Thathsara, savithathsara.me. This is a Hearthlen note from the laptop. The greeting used t o be a stored line. "How are you?" always came back as the same menu. The voice agent now keeps SmolLM2-360M loaded and sends the latest sentence to it, with the last few turns in front. Speech-to-text on this question was 408 ms, and the whole turn was 3840 ms. The log marks it agent=voice. An earlier "Hi, how about you?" came back as "hi, heh, I think I'm ready now." in 857 ms. A plain request such as "open the browser" still goes to the desk agent, which uses the keyboard and mouse. A sentence that is also a question stays in the conversation. The words show up in the chat while you talk, from the live line. Savindu Thathsara builds practical AI and automation in London. This series is the public log of an offline AI operating system he is writing and learning at the same time. Site: https://savithathsara.me Email: savindu@savithathsara.me DEV: https://dev.to/savinduthathsara Key Takeaways - •"How are you?" always came back as the same menu. - •This story was reported by Dev.to , covering developments in the dev space. - •AI advancements continue to reshape industries — read the full article on Dev.to for complete coverage. 📖 Continue reading the full article: Read Full Article on Dev.to → https://dev.to/savinduthathsara/the-reply-comes-from-the-model-2633