Noveum documentation
Instrument, observe, evaluate, and improve production AI applications from one connected workflow.
Noveum brings tracing, dataset preparation, evaluation, synthetic testing, and recommendations into one platform. Start with the workflow closest to what you need today.
Instrument an application
Install Noveum Trace and send your first trace in a few minutes.
Open quick setupUnderstand traces
Learn how traces, spans, attributes, and events describe an AI request.
Explore observabilityBuild an evaluation pipeline
Transform production traces into datasets and score every important behavior.
Set up evaluationTurn findings into improvements
Use NovaPilot to group failures, identify causes, and prioritize fixes.
Review NovaPilotThe Noveum workflow
Instrument
Add the Python SDK or use a framework guide for LangChain, LangGraph, LiveKit, or Pipecat.
Observe
Inspect request paths, latency, token usage, model inputs, outputs, and failures in the dashboard.
Prepare data
Convert selected traces into a reusable dataset. Use ETL jobs when production data needs mapping or normalization.
Improve and test
Generate focused recommendations with NovaPilot, then validate new behavior at scale with NovaSynth.
Pick an integration
| Application | Start here | What it covers |
|---|---|---|
| Python or a custom LLM app | SDK integration | Initialization, traces, spans, and configuration |
| LangChain | LangChain overview | Chains, tools, agents, and callbacks |
| LangGraph | LangGraph overview | Nodes, transitions, and agent workflows |
| LiveKit | LiveKit overview | Voice sessions, STT, TTS, and latency |
| Pipecat | Pipecat overview | Voice pipelines and synthetic testing |
| CrewAI | CrewAI overview | Multi-agent tasks and handoffs |
| Claude Code, Codex, Cursor, and VS Code | MCP server reference | Resources, prompts, OAuth, and API key setup |
Product guides
NovaEval
Score quality, safety, latency, retrieval, and task-specific behavior.
NovaPilot
Translate evaluation results into prioritized engineering actions.
NovaSynth
Run repeatable synthetic conversations across personas and scenarios.
Reference
If you are new to Noveum, continue with the five-minute quick setup.