feat(eval): add retry-errors, fail_on_error tolerance, and error retry tracking#442

Merged

christso merged 10 commits into

mainfrom

feat/follow-up-431-error-tracking-tolerance-retry

Mar 6, 2026

Commits on Mar 6, 2026

feat(eval): add retry-errors, fail_on_error tolerance, and error retry tracking (#433, #434, #435)

christso
and
claude
committed
test: add unit tests for extractFailOnError config parser

christso
and
claude
committed
docs: add retry-errors, fail_on_error, and errorRetries documentation

christso
and
claude
committed
fix: add fail_on_error to Zod schema and regenerate eval-schema.json

christso
and
claude
committed
style: format eval-schema.json with Biome

christso
and
claude
committed
fix: address code review feedback for fail_on_error implementation

christso
and
claude
committed
refactor: simplify fail_on_error to boolean-only (remove ratio threshold)

christso
and
claude
committed
style: fix Biome formatting in config-loader

christso
and
claude
committed
refactor: remove errorRetries tracking (YAGNI) and add YAGNI principle to CLAUDE.md

christso
and
claude
committed
style: fix trailing blank lines

christso
and
claude
committed