Agentic Eval
Agentic Eval is an agent skill (a SKILL.md file) from github/awesome-copilot. Patterns and techniques for evaluating and improving AI agent outputs. It works with Claude Code and GitHub Copilot and has 40,416 GitHub stars across a repository of 7 listed skills.
github.com/github/awesome-copilot/skills/agentic-eval (opens in a new tab)
Data as of from the GitHub API; description from the skill's SKILL.md. Report an error
- Official
- Multi-skill repo
- Testing & QA
- Maintained
Add this skill
Claude
Claude Code loads skills from ~/.claude/skills/ (all projects) or .claude/skills/ (one project):
git clone --depth 1 https://github.com/github/awesome-copilot.git
cp -r awesome-copilot/skills/agentic-eval ~/.claude/skills/agentic-eval # personal, or .claude/skills in a projectIn the Claude apps, zip the agentic-eval folder and upload it under Customize > Skills > + > Upload a skill (code execution must be on).
ChatGPT / Codex
Codex reads skills from .agents/skills/ in a repo or ~/.agents/skills/ for every project:
git clone --depth 1 https://github.com/github/awesome-copilot.git
cp -r awesome-copilot/skills/agentic-eval .agents/skills/agentic-eval # repo; ~/.agents/skills for all projectsStandalone skills also load in the ChatGPT desktop app.
Cursor
Cursor loads skills from .cursor/skills/ (or ~/.cursor/skills/) and also reads .claude/skills/:
git clone --depth 1 https://github.com/github/awesome-copilot.git
cp -r awesome-copilot/skills/agentic-eval .cursor/skills/agentic-eval # project; ~/.cursor/skills for all projectsSource (checked Oct 7, 2026): code.claude.com/docs/en/skills (opens in a new tab), support.claude.com/en/articles/12512180-using-skills-in-claude (opens in a new tab), learn.chatgpt.com/docs/build-skills (opens in a new tab), cursor.com/docs/context/skills (opens in a new tab)
What this skill does
Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when: - Implementing self-critique and reflection loops - Building evaluator-optimizer pipelines for quality-critical generation - Creating test-driven code refinement workflows - Designing rubric-based or LLM-as-judge evaluation systems - Adding iterative improvement to agent outputs (code, reports, analysis) - Measuring and improving agent response quality Patterns for self-improvement through iterative…
More skills in github/awesome-copilot
7 skills are listed from this repository.
Similar skills
More testing & qa skills
JavaScript Testing Patterns
wshobson/agents
Implement comprehensive testing strategies using Jest, Vitest, and Testing Library for unit tests, integration tests, and end-to-end testing with mocking, fixtures, and test-driven development.
Maintained · last commit Oct 17, 2026
Testing & QAPythonStrategy Red Team
phuryn/pm-skills
Red-team a PRD, roadmap, or strategy by attacking its load-bearing assumptions before reality does.
Active · last commit Oct 16, 2026
Testing & QAAgent Browser
vercel-labs/agent-browser
Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web…
Active · last commit Oct 26, 2026
OfficialTesting & QARustAgent Platform Troubleshooting
google/skills
Troubleshoots Google Cloud Gemini Enterprise Agent Platform issues (Agent Gateway, Registry, Identity, Policies, Model Armor, Identity-Aware Proxy (IAP)).
Maintained · last commit Oct 25, 2026
OfficialTesting & QAPythonMobile Native
emilkowalski/skills
Make a web app feel native on a phone — the small CSS and meta-tag fixes that separate "a website in a browser" from something that feels installed.
Maintained · last commit Oct 11, 2026
Testing & QAMarkdownFind Your Level
rohitg00/ai-engineering-from-scratch
Interactive quiz that maps your AI/ML knowledge to a starting point in the 523-lesson, 20-phase AI Engineering from Scratch curriculum.
Active · last commit Oct 23, 2026
Testing & QAPython
How do I install the Agentic Eval skill?
Copy the agentic-eval folder (the one containing SKILL.md) into ~/.claude/skills/ for Claude Code, .agents/skills/ for Codex or .cursor/skills/ for Cursor. The agent picks it up automatically when a task matches its description.
Is the Agentic Eval skill free?
Yes. The repository is open source under the MIT license.
Is Agentic Eval maintained?
The repository's most recent commit was on Oct 26, 2026. appsgit only lists skills from repositories with a commit in the last six months.