Voice Latency ScorerRule-Based

SttLatencyScorer

Scorer for STT latency.

Overview

Scorer for STT latency.

latency

Use Cases

  • General AI evaluation and quality assessment

How It Works

This scorer uses deterministic rule-based evaluation to validate outputs against specific criteria. It applies predefined rules and patterns to assess the response, providing consistent and reproducible results without requiring LLM inference.

Input Schema

ParameterTypeRequiredDescription

Output Schema

FieldTypeDescription
scoreany-
passedany-
reasoningany-
metadataany-

Score Interpretation

10Perfect MatchOutput exactly matches expected format/value
0No MatchOutput does not match expected format/value

Frequently Asked Questions

When should I use this scorer?

Use SttLatencyScorer when you need to evaluate latency aspects of your AI outputs. It's particularly useful for general ai evaluation and quality assessment.

Why doesn't this scorer need expected output?

This scorer evaluates quality aspects that don't require comparison against a reference answer. It uses the system prompt and context as the implicit ground truth.

Can I customize the threshold?

Yes, the default threshold of 7 can be customized when configuring the scorer.

Quick Info

CategoryVoice Latency
Evaluation TypeRule-Based
Requires Expected OutputNo
Default Threshold7/10

Ready to try SttLatencyScorer?

Start evaluating your AI agents with Noveum.ai's comprehensive scorer library.

Explore More Scorers

Discover 112 calibrated LLM-as-Judge scorers for comprehensive AI evaluation