Article

What is LLM Observability and Monitoring?

Langfuse · langfuse.com

A jargon-free primer on what you should be recording and why.

Open on langfuse.com ↗

The question it answers

  1. My AI feature is live. How do I monitor it and make it better with real usage?

Read with it

  1. The leading open-source LLM observability platform: traces, costs, evals, and prompt management. langfuse.com Tool Langfuse Langfuse
  2. The managed alternative, strongest if you already build on LangChain. langchain.com Tool LangSmith Observability LangChain
  3. A follow-along tutorial that gets tracing live in your app quickly. towardsdatascience.com Guide LLM Monitoring and Observability: Hands-on with Langfuse Towards Data Science
  4. A current comparison so you choose once instead of migrating later. confident-ai.com Article Top 7 LLM Observability Tools Confident AI
  5. Explains traces, spans, and generations with the main tools side by side. langflow.org Article LLM Observability Explained (Langfuse, LangSmith, LangWatch) Langflow
  6. The operations chapter: daily habits of teams that keep LLM features healthy in production. oreilly.com Article What We Learned from a Year of Building with LLMs (Part II): Operations Eugene Yan, Hamel Husain, et al.
eChai Partner Brands The partnership →