{"slug": "governance-for-ai-agents-running-open-models-how-do-you-track-runs-and-costs", "title": "Governance for AI agents running open models: how do you track runs and costs?", "summary": "A practitioner guidance piece recommends that teams running AI agents on open models log more than a model name such as llama3:8b per run, because local tags can be repointed and a single name can cover several quantizations. The guidance points to the OpenTelemetry GenAI semantic conventions, which define agent and tool-execution spans and attributes including gen_ai.request.model, gen_ai.response.model, gen_ai.tool.call.id and token usage, and notes the conventions are still marked Development, so the emitted version should be pinned. For audit purposes, the log should be written to append-only storage that the agent's own credentials cannot modify or delete.", "body_md": "Yes. For open models, “model and version” has to mean more than a name like llama3:8b, because local tags can be repointed and one name can cover several quantizations. What I’d record per run:\n\nOn standards: the OpenTelemetry GenAI semantic conventions define agent and tool-execution spans and attributes such as gen_ai.request.model, gen_ai.response.model, gen_ai.tool.call.id and token usage. They’re still marked Development, so pin the version you emit. For audit purposes, write the log to append-only storage that the agent’s own credentials can’t modify or delete.", "url": "https://wpnews.pro/news/governance-for-ai-agents-running-open-models-how-do-you-track-runs-and-costs", "canonical_source": "https://discuss.huggingface.co/t/governance-for-ai-agents-running-open-models-how-do-you-track-runs-and-costs/190833#post_2", "published_at": "2026-10-26 02:35:56+00:00", "updated_at": "2026-10-26 02:43:16.462607+00:00", "lang": "en", "topics": ["ai-agents", "mlops", "ai-tools"], "entities": ["OpenTelemetry", "llama3:8b"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/governance-for-ai-agents-running-open-models-how-do-you-track-runs-and-costs", "markdown": "https://wpnews.pro/news/governance-for-ai-agents-running-open-models-how-do-you-track-runs-and-costs.md", "text": "https://wpnews.pro/news/governance-for-ai-agents-running-open-models-how-do-you-track-runs-and-costs.txt", "jsonld": "https://wpnews.pro/news/governance-for-ai-agents-running-open-models-how-do-you-track-runs-and-costs.jsonld"}}