EngineeringFull-time
AI Engineer
Remote (India)
Full-time
₹12-36 LPA
Remote
Job Description
Noveum.ai is the tracing, evaluation, and observability platform for AI agents — used by thousands of developers to monitor, debug, and optimize their LLM, RAG, and multi-agent systems. We're hiring AI Engineers (all levels) who have built AI agents and want to build the tools that make agents reliable. You'll design and ship agentic features, build evaluation pipelines, and turn real production traces into systematic model comparisons. We're a remote-first team in India with both day-shift and night-shift roles.
Key Responsibilities
- Design, build, and ship AI agent features end to end
- Build evaluation pipelines and LLM-as-judge workflows
- Debug and optimize agent behavior using production traces
- Deploy, monitor, and tune models for reliability and cost
- Collaborate with the team on observability tooling and SDKs
Requirements
- Built AI agents (LLM tool-use, RAG, or multi-agent)
- Strong Python (TypeScript a plus)
- Generative AI APIs (OpenAI, Anthropic, etc.)
- Prompt engineering & evaluation
- Comfortable shipping in a fast-paced remote team
Preferred Qualifications
- Production experience with LLM-based applications
- Familiarity with agent frameworks and orchestration
- Experience with evals, observability, or tracing tools
- Background in NLP, conversational AI, or ML deployment