{"slug": "how-should-we-evaluate-image-memory-in-ai-agents", "title": "How should we evaluate image memory in AI agents?", "summary": "The second cycle of the AML (Agent Memory Leaderboard) competition drew 402 task submissions across three tracks — text, code and multimodal memory — and generated more than 1 million cross-platform impressions and over 10 million cumulative website clicks, according to the organizers' published results. Participating teams included Alibaba Cloud DMS, Shopee, OPPO, KT and OceanBase, alongside university researchers, memory startups and independent developers. The cycle's headline question, how to evaluate image memory in AI agents, reflects the benchmark's expansion into multimodal agent memory.", "body_md": "🏆 AML Cycle 2 results are live! 💥\n• 1M+ cross-platform impressions \n• 10M+ cumulative website clicks \n• 402 task submissions \n• Three tracks: text, code and multimodal memory \nThis cycle brought together teams from across the global AI community, including teams from Alibaba Cloud DMS, Shopee, OPPO, KT and OceanBase—alongside university researchers, memory startups and independent developers.\nExplore the full results:", "url": "https://wpnews.pro/news/how-should-we-evaluate-image-memory-in-ai-agents", "canonical_source": "https://twitter.com/AgentMemoryL/status/2123418533950591252", "published_at": "2026-11-20 06:24:56+00:00", "updated_at": "2026-11-20 06:45:24.457559+00:00", "lang": "en", "topics": ["ai-agents", "ai-research", "artificial-intelligence"], "entities": ["Alibaba Cloud DMS", "Shopee", "OPPO", "KT", "OceanBase", "AML"], "also_reported_by": [], "takeaway": "The AML Cycle 2 benchmark evaluates agent memory across text, code and multimodal tracks, with 402 task submissions from teams including Alibaba Cloud DMS, Shopee, OPPO, KT and OceanBase.", "recommendation": {"advice": "Benchmark agent memory on separate text, code and multimodal tracks rather than one aggregate score, as AML Cycle 2 did across 402 task submissions.", "playbook": "evals-testing", "playbook_url": "https://wpnews.pro/playbooks/evals-testing"}, "alternates": {"html": "https://wpnews.pro/news/how-should-we-evaluate-image-memory-in-ai-agents", "markdown": "https://wpnews.pro/news/how-should-we-evaluate-image-memory-in-ai-agents.md", "text": "https://wpnews.pro/news/how-should-we-evaluate-image-memory-in-ai-agents.txt", "jsonld": "https://wpnews.pro/news/how-should-we-evaluate-image-memory-in-ai-agents.jsonld"}}