{"slug": "openlit-observability-monitor-llms-genai-apps", "title": "OpenLIT Observability - Monitor LLMs & GenAI Apps", "summary": "SigNoz has published a guide for integrating its observability platform with OpenLIT to monitor LLM and generative AI applications. The integration uses OpenTelemetry to export traces and metrics from AI workloads to SigNoz Cloud, with setup requiring Python 3.10+, the openlit and openai packages, and environment variables for the OTLP endpoint and ingestion key. Users can then view detailed traces and metrics in SigNoz, with troubleshooting steps and an optional OpenTelemetry Collector setup provided.", "body_md": "Overview\n\nThis guide walks you through integrating SigNoz with OpenLIT to gain visibility into your LLM and AI applications. By combining OpenLIT's specialized LLM instrumentation with SigNoz's observability platform, you can monitor and analyze traces and metrics from your AI workloads.\n\nPrerequisites\n\n- A\n[SigNoz Cloud account](https://signoz.io/teams/)with an active ingestion key or[Self Hosted SigNoz instance](https://signoz.io/docs/install/self-host/) - Internet access to send telemetry data to SigNoz Cloud\n- Python 3.10+ with\n`openlit`\n\ninstalled - For Python:\n`pip`\n\ninstalled for managing Python packages - For this example: An OpenAI API key. You can get it from\n[OpenAI platform](https://platform.openai.com/settings/organization/api-keys)\n\nIntegrate SigNoz with OpenLIT\n\nFor more information on getting started with OpenLIT in your Python environment, refer to the [OpenLIT Overview](https://docs.openlit.io/latest/overview).\nFor more information on integrating SigNoz with OpenLIT, refer to the [OpenLIT SigNoz Guide](https://docs.openlit.io/latest/operator/destinations/signoz).\n\nStep 1: Install the necessary packages in your Python environment.\n\n```\npip install \\\n  openlit \\\n  openai\n```\n\nStep 2: Create an example LLM application (using OpenAI in this example)\n\n``` python\nimport openlit\nimport os\nfrom openai import OpenAI\n \n \nopenlit.init(application_name=\"<service_name>\")\n \n \nclient = OpenAI()\n \nchat_completion = client.chat.completions.create(\n    messages=[\n        {\n            \"role\": \"user\",\n            \"content\": \"What is SigNoz?\",\n        }\n    ],\n    model=\"gpt-3.5-turbo\",\n)\nprint(chat_completion.choices[0].message.content)\n```\n\n`<service_name>`\n\nis the name of your service\n\nStep 3: Run your application with env variables\n\nRun your application with the following environment variables set. This configures OpenTelemetry to export traces to SigNoz.\n\n```\nOTEL_EXPORTER_OTLP_ENDPOINT=\"https://ingest.<region>.signoz.cloud:443\" \\\nOTEL_EXPORTER_OTLP_HEADERS=\"signoz-ingestion-key=<your-ingestion-key>\" \\\n<your_run_command>\n```\n\n`<region>`\n\n: Your[SigNoz Cloud region](https://signoz.io/docs/ingestion/signoz-cloud/overview/#endpoint)`<your-ingestion-key>`\n\n: Your SigNoz[ingestion key](https://signoz.io/docs/ingestion/signoz-cloud/keys/)- Replace\n`<your_run_command>`\n\nwith the actual command you would use to run your application. In this case we would use:`python main.py`\n\nView Traces and Metrics in SigNoz\n\nYour AI usage should now automatically emit traces.\n\nYou should be able to view traces in Signoz Cloud under the traces tab:\n\nWhen you click on a trace in SigNoz, you'll see a detailed view of the trace, including all associated spans, along with their events and attributes.\n\nYou should be able to see OpenLIT related metrics in Signoz Cloud under the metrics tab:\n\nWhen you click on any of these metrics in SigNoz, you'll see a detailed view of the metric, including attributes:\n\nTroubleshooting\n\n[Troubleshooting](#troubleshooting)\n\nIf you don't see your telemetry data:\n\n**Verify network connectivity**- Ensure your application can reach SigNoz Cloud endpoints** Check ingestion key**- Verify your SigNoz ingestion key is correct** Wait for data**- OpenTelemetry batches data before sending, so wait 10-30 seconds after making API calls** Try a console exporter**— Enable a console exporter locally to confirm that your application is generating telemetry data before it’s sent to SigNoz\n\nSetup OpenTelemetry Collector (Optional)\n\n[Setup OpenTelemetry Collector (Optional)](#setup-opentelemetry-collector-optional)\n\nWhat is the OpenTelemetry Collector?\n\nThink of the OTel Collector as a middleman between your app and SigNoz. Instead of your application sending data directly to SigNoz, it sends everything to the Collector first, which then forwards it along.\n\nWhy use it?\n\n**Cleaning up data**— Filter out noisy traces you don't care about, or remove sensitive info before it leaves your servers.** Keeping your app lightweight**— Let the Collector handle batching, retries, and compression instead of your application code.** Adding context automatically**— The Collector can tag your data with useful info like which Kubernetes pod or cloud region it came from.** Future flexibility**— Want to send data to multiple backends later? The Collector makes that easy without changing your app.\n\nSee [Switch from direct export to Collector](https://signoz.io/docs/opentelemetry-collection-agents/opentelemetry-collector/switch-to-collector/) for step-by-step instructions to convert your setup.\n\nFor more details, see [Why use the OpenTelemetry Collector?](https://signoz.io/docs/opentelemetry-collection-agents/opentelemetry-collector/why-to-use-collector/) and the [Collector configuration guide](https://signoz.io/docs/opentelemetry-collection-agents/opentelemetry-collector/configuration/).\n\nRelated integrations\n\nUse the same OpenTelemetry pipeline for the frameworks and providers you instrument:\n\n[Instrument LLM apps with Langtrace](https://signoz.io/docs/langtrace/)- an OpenTelemetry-native SDK that exports LLM spans straight to SigNoz[Instrument LLM apps with Traceloop OpenLLMetry](https://signoz.io/docs/traceloop/)- an OpenTelemetry SDK that auto-instruments 20+ LLM providers[Monitor Mistral AI with OpenTelemetry](https://signoz.io/docs/mistral-observability/)- track Mistral model latency, token usage, and error rates[Monitor Hermes with OpenTelemetry](https://signoz.io/docs/hermes-monitoring/)- trace long-running agent sessions, skill execution, and subagent runs[Semantic Kernel observability with OpenTelemetry](https://signoz.io/docs/semantic-kernel-observability/)- trace plugins, planners, and kernel function calls\n\nBrowse [all LLM observability integrations](https://signoz.io/docs/llm-observability/) to instrument the rest of your stack.", "url": "https://wpnews.pro/news/openlit-observability-monitor-llms-genai-apps", "canonical_source": "https://signoz.io/docs/openlit", "published_at": "2026-08-03 00:00:00+00:00", "updated_at": "2026-08-05 02:24:31.332553+00:00", "lang": "en", "topics": ["ai-tools", "developer-tools", "mlops"], "entities": ["SigNoz", "OpenLIT", "OpenTelemetry", "OpenAI"], "alternates": {"html": "https://wpnews.pro/news/openlit-observability-monitor-llms-genai-apps", "markdown": "https://wpnews.pro/news/openlit-observability-monitor-llms-genai-apps.md", "text": "https://wpnews.pro/news/openlit-observability-monitor-llms-genai-apps.txt", "jsonld": "https://wpnews.pro/news/openlit-observability-monitor-llms-genai-apps.jsonld"}}