General skillTesting and debugging

claude-code-genai-prompt-optimizer

Tests cheaper-model replacements against an expensive oracle and tunes prompts for measured parity.

Stars
0
Forks
0
License
Apache-2.0
Updated
Updated Jun 26, 2026

Checking live repository facts…

Project overview

genai-prompt-optimizer finds every LLM call in a GenAI app, pins one model per run, and derives adversarial cases from the app’s prompts and JSON schemas. It first records the expensive model as an oracle, then iterates on the cheaper student’s prompt and re-verifies each cohort with deterministic checks, semantic comparison, and limited judge review. The result reports measured token cost and projected savings; it asks for consent before the token-heavy run.

Repository facts

Primary language
Python
License
Apache-2.0
Repository updated
Jun 26, 2026
Default branch
main

Resource types

General skill

Use cases

Testing and debuggingSoftware development

Platforms

Claude Code, Codex, and more

Capabilities

Verification and evals

Related projects

Browse more similar projects