cd /news/artificial-intelligence/local-llms-vlms-for-physical-ai-engi… · home topics artificial-intelligence article
[ARTICLE · art-89377] src=discuss.huggingface.co ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

Local LLMs/VLMs for Physical AI engineering workflows — model suggestions wanted

Afrid Ali is developing EdgeAI Forge, an early-stage local-first architecture for using specialized AI agents in industrial vision, ROS 2, robotics, and edge-deployment workflows, and is seeking model recommendations and evaluation ideas for local coding agents, VLMs for industrial inspection, smaller reasoning models, embedding models, and runtimes across workstation GPUs and Jetson-class devices. The proof of concept routes Planner, Vision, and ROS prompts to Ollama, with optional cloud escalation and explicit human review before physical deployment.

read1 min views1 publishedAug 9, 2026

I am experimenting with EdgeAI Forge, an early-stage local-first architecture for using specialized AI agents in industrial vision, ROS 2, robotics, and edge-deployment workflows.

The intended split is:

- local models for frequent coding, planning, documentation, private-data processing, and visual reasoning;

- optional cloud escalation for difficult or large-context tasks; and

- explicit human review before any physical deployment or machine-control action.

The current proof of concept routes Planner, Vision, and ROS prompts to Ollama. I am looking for practical model recommendations and evaluation ideas for:

- local coding agents that produce structured Python/C++/ROS 2 artifacts;

- VLMs for industrial image inspection and pipeline selection;

- smaller reasoning models for planning and validation;

- embedding models for project memory and retrieval; and

- runtimes that work well across workstation GPUs and Jetson-class devices.

I am especially interested in measured tradeoffs—VRAM, latency, structured-output reliability, quantization, tool use, and license constraints—rather than leaderboard scores alone.

Project: GitHub - afridali123/EdgeAI_Forge · GitHub

Longer background: EdgeAI Forge: My Journey Toward a Local Agentic AI Platform for Industrial Automation

This is an early architecture discussion, not a finished product announcement. Suggestions for models, datasets, evaluation harnesses, or related projects are welcome.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @afrid ali 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/local-llms-vlms-for-…] indexed:0 read:1min 2026-08-09 ·