from ai_infra.eval import LengthInRangeCheck if output length is within a specified range. Useful for ensuring responses are not too short or too long.
min_length: Minimum allowed length. Default: 0. max_length: Maximum allowed length. Default: None (no limit). count_words: If True, count words instead of characters. Default: False.
>>> from ai_infra.eval.evaluators import LengthInRange >>> from pydantic_evals import Case, Dataset >>> >>> dataset = Dataset( ... cases=[Case(inputs="Summarize this", expected_output=None)], ... evaluators=[LengthInRange(min_length=10, max_length=500)], ... )
EvaluationReason with pass/fail and length info