Grok vs. Dot vs. Muse vs. Claude Duet: which one crushes the competition?

Claire Vo ran the first "How I AI" personal-agent benchmark, testing Grok Bot, Dot, Meta Muse, and Claude Duet across nine real tasks — including a Slack reply, a Sentry bug fix, a Figma thumbnail, inbox triage, a family newspaper, fourth-grade physics homework, shoe shopping, and a ChatPRD launch video — with Claude operating Dot and Codex running the other three agents and scoring results live. The episode's scoreboard and takeaways, published on the How I AI podcast, conclude with which agent Vo would trust for work versus life.

I have personal-agent fatigue, so I ran the first How I AI personal-agent benchmark: Grok Bot, Dot, Muse, and Claude Duet across nine real tasks, from a Slack reply and a Sentry bug to a Figma thumbnail, inbox triage, a family newspaper, physics homework for a fourth grader, shoe shopping, and a ChatPRD launch video. I used computer use to operate them: Claude ran Dot, Codex ran the rest and scored the results live. Here’s the scoreboard—and which agent I’d actually trust for work vs. life. Listen or watch on YouTube https://youtu.be/hnCoQ5wB-GU , Spotify https://open.spotify.com/show/4aRP2XSavdtrLG5FZoonOK , or Apple Podcasts https://podcasts.apple.com/us/podcast/how-i-ai/id1809663079 Brought to you by: WorkOS https://workos.com/?utm source=lennys howiai&utm medium=podcast&utm campaign=q22025 —Make your app enterprise-ready, with SSO, SCIM, RBAC, and more Firecrawl https://firecrawl.dev/howiai —Give your AI agents web data and beyond In this episode, we cover: 00:00 https://www.youtube.com/watch?v=hnCoQ5wB-GU Introduction 02:13 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=133s The personal-agent benchmark setup 05:00 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=300s The nine tasks and the prompts I used 07:20 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=440s Scoreboard overview 10:06 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=606s&pp=0gcJCWMAwfN6Pr3D Task 1: Draft a Slack reply as me 11:39 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=699s Task 2: Cut a short-form video from raw Dropbox footage 14:56 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=896s Task 3: Fix a bug from Sentry 17:30 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=1050s Task 4: Build a How I AI thumbnail in Figma 19:25 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=1165s Task 5: Triage my inbox for to-dos 21:06 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=1266s Task 6: Build a family newspaper 23:30 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=1410s Task 7: Explain a physics homework question to a fourth grader 24:54 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=1494s Task 8: Shop for shoes 26:46 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=1606s Task 9: Make a ChatPRD Product Intelligence launch video 30:01 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=1801s Final scores 32:38 https://www.youtube.com/watch?v=hnCoQ5wB-GU&t=1958s My takeaways Tools referenced: • Grok Bot: https://x.ai/bot https://x.ai/bot • Dot: https://chatgpt.com/features/dots/ https://chatgpt.com/features/dots/ • Meta Muse: https://ai.meta.com/muse/ https://ai.meta.com/muse/ • Claude Duet: https://claude.com/product/claude-duet https://claude.com/product/claude-duet • Codex: https://openai.com/codex https://openai.com/codex • ElevenLabs: https://elevenlabs.io/ https://elevenlabs.io/ • Figma: https://www.figma.com/ https://www.figma.com/ • Sentry: https://sentry.io/ https://sentry.io/ • Linear: https://linear.app/ https://linear.app/ • Dropbox: https://www.dropbox.com/ https://www.dropbox.com/ Where to find Claire Vo: ChatPRD: https://www.chatprd.ai/ https://www.chatprd.ai/ Website: https://clairevo.com/ https://clairevo.com/ LinkedIn: https://www.linkedin.com/in/clairevo/ https://www.linkedin.com/in/clairevo/ Production and marketing by https://penname.co/ https://penname.co/ . For inquiries about sponsoring the podcast, email \ email protected\ https://www.lennysnewsletter.com/cdn-cgi/l/email-protection .