Skip to content

promptfoo-evaluation

Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts. Triggers on keywords like "promptfoo", "eval", "LLM evaluation", "prompt testing", or "model comparison".

Repository Source folder

Details

Path
promptfoo-evaluation
Bundled scripts
1
Dependencies
1

Bundled scripts

  • promptfoo-evaluation/scripts/metrics.py

FAQ