{"slug": "tideway-phase-aware-tiered-memory-management-for-moe-inference-on-consumer", "title": "Tideway: Phase-Aware Tiered Memory Management for MoE Inference on Consumer Devices", "summary": "Tideway introduces phase-aware tiered memory management for running large Mixture-of-Experts (MoE) models locally on consumer PCs, addressing the memory constraints that separate consumer hardware from datacenter servers. The work targets local MoE inference to balance data privacy, API costs, and inference efficiency as LLM agents become a dominant application paradigm.", "body_md": "Large language model (LLM) agents are rapidly becoming a dominant paradigm for AI applications. Recently, there is a growing demand to deploy large-scale Mixture-of-Experts (MoE) models locally on consumer PCs to balance data privacy, API costs, and inference efficiency. However, unlike datacenter s", "url": "https://wpnews.pro/news/tideway-phase-aware-tiered-memory-management-for-moe-inference-on-consumer", "canonical_source": "https://aiflash.com/news/154128/", "published_at": "2026-11-19 04:30:11+00:00", "updated_at": "2026-11-19 04:43:53.303568+00:00", "lang": "en", "topics": ["ai-infrastructure", "large-language-models", "ai-research", "mlops"], "entities": ["Tideway"], "also_reported_by": [], "takeaway": "Tideway manages MoE weights across memory tiers by inference phase, letting consumer PCs run large MoE models that would otherwise exceed local memory.", "recommendation": {"advice": "Tier MoE expert weights across memory levels and schedule placement by inference phase to fit large MoE models within consumer-PC memory budgets.", "playbook": "inference-serving", "playbook_url": "https://wpnews.pro/playbooks/inference-serving"}, "alternates": {"html": "https://wpnews.pro/news/tideway-phase-aware-tiered-memory-management-for-moe-inference-on-consumer", "markdown": "https://wpnews.pro/news/tideway-phase-aware-tiered-memory-management-for-moe-inference-on-consumer.md", "text": "https://wpnews.pro/news/tideway-phase-aware-tiered-memory-management-for-moe-inference-on-consumer.txt", "jsonld": "https://wpnews.pro/news/tideway-phase-aware-tiered-memory-management-for-moe-inference-on-consumer.jsonld"}}