qe-learning-optimization — Claude Code skill: setup and features
qe-learning-optimization optimizes QE agents through transfer learning across test frameworks, Bayesian hyperparameter tuning, and A/B experiments.
MIT 121 installs ★ 533 updated 2026-10-25
npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a claude-codeWhat qe-learning-optimization does
The skill coordinates performance tuning for testing agents via specialized roles: qe-transfer-specialist, qe-metrics-optimizer, and qe-pattern-learner. It adapts existing testing patterns between frameworks, such as converting Jest mocks and assertions to Vitest while checking transfer accuracy against sample suites.
It runs Bayesian searches across parameters like learning rates and batch sizes to improve prediction models. It also manages seven-day A/B tests between rule-based and ML-enhanced approaches, tracking quality scores alongside generation speed.
Pattern persistence expects a configured vector database such as agentdb alongside the aqe command-line utility.
What it helps with
- Transfer test patterns and mock syntax from Jest to Vitest
- Tune defect prediction hyperparameters using Bayesian optimization
- Run split A/B tests to evaluate test generation algorithms
- Set up automated weekly retraining loops with rollback triggers
Example prompts for the agent
- Transfer learned testing patterns from Jest generator to Vitest and check the accuracy score
- Run a Bayesian hyperparameter search for the defect-predictor agent targeting higher accuracy
- Configure a continuous improvement loop for test-generator with automatic rollback on degradation
How to install qe-learning-optimization
1Skills CLI (Vercel)
npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a claude-code2Manually: put the files in place
~/.claude/skills/qe-learning-optimization/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/qe-learning-optimization/
1Skills CLI (Vercel)
npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a codex2Manually: put the files in place
.agents/skills/qe-learning-optimization/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a cursor2Manually: put the files in place
.cursor/skills/qe-learning-optimization/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install proffesor-for-testing/agentic-qe assets/skills/qe-learning-optimization2Manually: put the files in place
.github/skills/qe-learning-optimization/SKILL.md1Skills CLI (Vercel)
npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a gemini-cli2Platform CLI
gemini skills install https://github.com/proffesor-for-testing/agentic-qe --path assets/skills/qe-learning-optimizationManually: put the files in place
.devin/skills/qe-learning-optimization/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about qe-learning-optimization
How to install qe-learning-optimization in Claude Code?
Run npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a claude-code in your terminal.
What does qe-learning-optimization do?
It coordinates transfer learning across test runners, automates hyperparameter searches, and runs structured A/B tests for testing agents.
How does cross-framework transfer work?
It applies syntax mappings such as jest.fn to vi.fn, adapts assertion styles, and evaluates the transferred output against benchmark test sets.
Source text
SKILL.md · MIT
---
name: "qe-learning-optimization"
description: "Optimizes QE agent performance through transfer learning, hyperparameter tuning, and pattern distillation across test domains. Use when improving agent accuracy, applying learned patterns to new projects, tuning quality thresholds, or implementing continuous improvement loops for AI-powered testing."
trust_tier: 3
validation:
schema_path: schemas/output.json
validator_path: scripts/validate-config.json
eval_path: evals/qe-learning-optimization.yaml
---
# QE Learning Optimization
## Purpose
Guide the use of v3's learning optimization capabilities including transfer learning between agents, hyperparameter tuning, A/B testing, and continuous performance improvement.
## Activation
- When optimizing agent performance
- When transferring knowledge between agents
- When tuning learning parameters
- When running A/B tests
- When analyzing learning metrics
## Quick Start
```bash
# Transfer knowledge between agents
aqe learn transfer --from jest-generator --to vitest-generator
# Tune hyperparameters
aqe learn tune --agent defect-predictor --metric accuracy
# Run A/B test
aqe learn ab-test --hypothesis "new-algorithm" --duration 7d
# View learning metrics
aqe learn metrics --agent test-generator --period 30d
```
## Agent Workflow
```typescript
// Transfer learning
Task("Transfer test patterns", `
Transfer learned patterns from Jest test generator to Vitest:
- Map framework-specific syntax
- Adapt assertion styles
- Preserve test structure patterns
- Validate transfer accuracy
`, "qe-transfer-specialist")
// Metrics optimization
Task("Optimize prediction accuracy", `
Tune defect-predictor agent:
- Analyze current performance metrics
- Run Bayesian hyperparameter search
- Validate improvements on holdout set
- Deploy if accuracy improves >5%
`, "qe-metrics-optimizer")
```
## Learning Operations
### 1. Transfer Learning
```typescript
await transferSpecialist.transfer({
source: {
agent: 'qe-jest-generator',
knowledge: ['patterns', 'heuristics', 'optimizations']
},
target: {
agent: 'qe-vitest-generator',
adaptations: ['framework-syntax', 'api-differences']
},
strategy: 'fine-tuning',
validation: {
testSet: 'validation-samples',
minAccuracy: 0.9
}
});
```
### 2. Hyperparameter Tuning
```typescript
await metricsOptimizer.tune({
agent: 'defect-predictor',
parameters: {
learningRate: { min: 0.001, max: 0.1, type: 'log' },
batchSize: { values: [16, 32, 64, 128] },
patternThreshold: { min: 0.5, max: 0.95 }
},
optimization: {
method: 'bayesian',
objective: 'accuracy',
trials: 50,
parallelism: 4
}
});
```
### 3. A/B Testing
```typescript
await metricsOptimizer.abTest({
hypothesis: 'ML pattern matching improves test quality',
variants: {
control: { algorithm: 'rule-based' },
treatment: { algorithm: 'ml-enhanced' }
},
metrics: ['test-quality-score', 'generation-time'],
traffic: {
split: 50,
minSampleSize: 1000
},
duration: '7d',
significance: 0.05
});
```
### 4. Feedback Loop
```typescript
await metricsOptimizer.feedbackLoop({
agent: 'test-generator',
feedback: {
sources: ['user-corrections', 'test-results', 'code-reviews'],
aggregation: 'weighted',
frequency: 'real-time'
},
learning: {
strategy: 'incremental',
validationSplit: 0.2,
earlyStoppingPatience: 5
}
});
```
## Learning Metrics Dashboard
```typescript
interface LearningDashboard {
agent: string;
period: DateRange;
performance: {
current: MetricValues;
trend: 'improving' | 'stable' | 'declining';
percentile: number;
};
learning: {
samplesProcessed: number;
patternsLearned: number;
improvementRate: number;
};
experiments: {
active: Experiment[];
completed: ExperimentResult[];
};
recommendations: {
action: string;
expectedImpact: number;
confidence: number;
}[];
}
```
## Cross-Framework Transfer
```yaml
transfer_mappings:
jest_to_vitest:
syntax:
"describe": "describe"
"it": "it"
"expect": "expect"
"jest.mock": "vi.mock"
"jest.fn": "vi.fn"
patterns:
- mock-module
- async-testing
- snapshot-testing
mocha_to_jest:
syntax:
"describe": "describe"
"it": "it"
"chai.expect": "expect"
"sinon.stub": "jest.fn"
adaptations:
- assertion-style
- hook-naming
```
## Continuous Improvement
```typescript
await learningOptimizer.continuousImprovement({
agents: ['test-generator', 'coverage-analyzer', 'defect-predictor'],
schedule: {
metricCollection: 'hourly',
tuning: 'weekly',
majorUpdates: 'monthly'
},
thresholds: {
degradationAlert: 5, // percent
improvementTarget: 2, // percent per week
},
automation: {
autoTune: true,
autoRollback: true,
requireApproval: ['major-changes']
}
});
```
## Pattern Learning
```typescript
await patternLearner.learn({
sources: {
codeExamples: 'examples/**/*.ts',
testExamples: 'tests/**/*.test.ts',
userFeedback: 'feedback/*.json'
},
extraction: {
syntacticPatterns: true,
semanticPatterns: true,
contextualPatterns: true
},
storage: {
vectorDB: 'agentdb',
versioning: true
}
});
```
## Coordination
**Primary Agents**: qe-transfer-specialist, qe-metrics-optimizer, qe-pattern-learner
**Coordinator**: qe-learning-coordinator
**Related Skills**: qe-test-generation, qe-defect-intelligence
© proffesor-for-testing · MIT · proffesor-for-testing/agentic-qe