web-codegen-scorer

Allows setting up evaluations with different LLM models, web frameworks, and tools, as detailed in the command-line flags and environment config reference.

Assesses generated code for build success, runtime errors, accessibility, security, and coding best practices, providing comprehensive, empirical metrics beyond generic benchmarks.

Can automatically fix issues detected during code generation, with configurable repair attempts via the --max-build-repair-attempts flag, reducing manual intervention.

Focuses specifically on web code with established quality metrics, as emphasized in the philosophy, making it more relevant than broad coding benchmarks.