from ai_infra.eval import ContainsExpectedCheck if output contains the expected output text. A simple evaluator that checks if the expected_output is contained within the output string (case-insensitive by default).
case_sensitive: If True, comparison is case-sensitive. Default: False.
>>> from ai_infra.eval.evaluators import ContainsExpected >>> from pydantic_evals import Case, Dataset >>> >>> dataset = Dataset( ... cases=[ ... Case(inputs="capital of France", expected_output="Paris"), ... ], ... evaluators=[ContainsExpected()], ... )
bool: True if expected_output is found in output