ToneConsistencyScorer
Evaluates tone consistency and appropriateness of responses. Assesses whether tone matches domain, remains consistent throughout, and aligns with conversation history.
Overview
Evaluates tone consistency and appropriateness of responses. Assesses whether tone matches domain, remains consistent throughout, and aligns with conversation history.
Use Cases
- Conversational AI quality assessment
How It Works
This scorer uses LLM-as-Judge technology to evaluate responses. It prompts a large language model with specific evaluation criteria and the content to assess, then analyzes the LLM's judgment to produce a score and detailed reasoning.
Input Schema
| Parameter | Type | Required | Description |
|---|---|---|---|
| output_text | str | Yes | Response to evaluate for tone |
| input_text | str | Yes | Original prompt |
| context | dict | str | No | May include expected tone/style |
Output Schema
| Field | Type | Description |
|---|---|---|
| score | float | Tone consistency score (0-10) |
| passed | bool | True if tone is appropriate |
| reasoning | str | Tone analysis |
| metadata | dict | Tone characteristics |
Score Interpretation
Default threshold: 7/10
Related Scorers
ClarityAndCoherenceScorer
Evaluates clarity and coherence of AI-generated responses. Assesses language clarity, structure, log...
Answer QualityAnswerCompletenessScorer
Evaluates completeness and coverage of AI-generated answers. Assesses whether the answer addresses a...
Answer QualityCitationQualityScorer
Evaluates quality of source attribution and citations in answers. Assesses accuracy, completeness, s...
Answer QualityInformationDensityScorer
Evaluates information density and richness of AI-generated responses. Assesses how information-rich ...
Frequently Asked Questions
When should I use this scorer?
Use ToneConsistencyScorer when you need to evaluate quality and conversational aspects of your AI outputs. It's particularly useful for conversational ai quality assessment.
Why doesn't this scorer need expected output?
This scorer evaluates without a reference answer by using the specific input fields listed in its schema. Those fields are evidence for the check; they are not automatically factual ground truth.
Can I customize the threshold?
This scorer's displayed default threshold is 7. Where the eval-job configuration exposes a threshold, review it against the scorer's native scale before saving. The stored pass decision uses that scorer-specific configuration.
Quick Info
Ready to try ToneConsistencyScorer?
Start evaluating your AI agents with Noveum.ai's comprehensive scorer library.
Explore More Scorers
Discover 112 published scorers across 15 categories: 82 Premium, 30 Free, 76 model-backed, and 36 dedicated voice and audio scorers