AI for Developers
Agent skill (SKILL.md) Open source Apache-2.0 3.3k

SkillEvaluator

Multi-tier framework for evaluating AI agent skills and plugins with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how...

Install

For this project
$ npx skills add NVIDIA/SkillEvaluator -a claude-code
For every project
$ npx skills add NVIDIA/SkillEvaluator -a claude-code -g

Or copy the skill folder into .claude/skills/ (project) or ~/.claude/skills/ (all projects).

For this project
$ npx skills add NVIDIA/SkillEvaluator -a codex
For every project
$ npx skills add NVIDIA/SkillEvaluator -a codex -g

Or copy the skill folder into .agents/skills/ (project) or ~/.agents/skills/ (all projects).

See the repository README for installation instructions.

When to use

Use it before you publish or adopt a skill, to find out whether it actually improves results and doesn't overlap with skills you already have.

SkillEvaluator is NVIDIA's framework for evaluating agent skills and plugins. It checks quality, security, overlap and compatibility, and measures a skill's effect on task results. The process starts with quality checks, then compares runs with and without the skill. Features include quality gates, semantic overlap detection, synthetic evaluation dataset generation and live agent evaluation.

It's a Python CLI on PyPI for Python 3.12 to 3.14, part of NVIDIA's Verified Skills pipeline, and has a paper, docs and a blog post. NVIDIA's research it draws on found that how a skill reads and how it performs can be unrelated.

Related skills

All skills