larswiegers/laravel-ai-evaluation

Run AI/LLM evals for your AI features

0.1.5 2026-05-31 17:44 UTC

Requires

• php: ^8.3
• illuminate/console: ^12.0|^13.0
• illuminate/support: ^12.0|^13.0
• laravel/ai: >=0.5.0 <1.0

Requires (Dev)

• orchestra/testbench: ^11.0
• pestphp/pest: ^4.5
• phpunit/phpunit: ^12.0

MIT

• Lars Wiegers

• testing
• laravel
• ai
• llm
• evals

README

Test real Laravel AI agent behavior with repeatable evals that run in Pest, Artisan, and CI.

Quick start

composer require --dev larswiegers/laravel-ai-evaluation
php artisan make:ai-evals refund-policy --type=pest
vendor/bin/pest tests/AgentEvals

use LaravelAIEvaluation\AIEval;

it('answers refund policy questions', function () {
    AIEval::agent(App\Ai\Agents\SupportAgent::class)
        ->input('Can I get a refund?')
        ->expectContains(['refund', '30 days'])
        ->run()
        ->assertPasses();
});

For installation, expectations, standalone reports, and CI output formats, see the docs:

• Documentation