promptfoo-evaluation
Skillby daymade
Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts. Triggers on keywords like "promptfoo", "eval", "LLM evaluation", "prompt testing", or "model comparison".
Details
- Path
- promptfoo-evaluation
- Bundled scripts
- 1
- Dependencies
- 1
Bundled scripts
- promptfoo-evaluation/scripts/metrics.py