Skip to main content
skill CX Codex

qe-learning-optimization — Claude Code skill: setup and features

qe-learning-optimization optimizes QE agents through transfer learning across test frameworks, Bayesian hyperparameter tuning, and A/B experiments.

MIT 121 installs ★ 533 updated 2026-10-25

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a claude-code
Open on GitHub

What qe-learning-optimization does

The skill coordinates performance tuning for testing agents via specialized roles: qe-transfer-specialist, qe-metrics-optimizer, and qe-pattern-learner. It adapts existing testing patterns between frameworks, such as converting Jest mocks and assertions to Vitest while checking transfer accuracy against sample suites.

It runs Bayesian searches across parameters like learning rates and batch sizes to improve prediction models. It also manages seven-day A/B tests between rule-based and ML-enhanced approaches, tracking quality scores alongside generation speed.

Pattern persistence expects a configured vector database such as agentdb alongside the aqe command-line utility.

What it helps with

  • Transfer test patterns and mock syntax from Jest to Vitest
  • Tune defect prediction hyperparameters using Bayesian optimization
  • Run split A/B tests to evaluate test generation algorithms
  • Set up automated weekly retraining loops with rollback triggers

Example prompts for the agent

  • Transfer learned testing patterns from Jest generator to Vitest and check the accuracy score
  • Run a Bayesian hyperparameter search for the defect-predictor agent targeting higher accuracy
  • Configure a continuous improvement loop for test-generator with automatic rollback on degradation

How to install qe-learning-optimization

1Skills CLI (Vercel)

npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a claude-code

2Manually: put the files in place

~/.claude/skills/qe-learning-optimization/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/qe-learning-optimization/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about qe-learning-optimization

How to install qe-learning-optimization in Claude Code?

Run npx skills add proffesor-for-testing/agentic-qe --skill qe-learning-optimization -a claude-code in your terminal.

What does qe-learning-optimization do?

It coordinates transfer learning across test runners, automates hyperparameter searches, and runs structured A/B tests for testing agents.

How does cross-framework transfer work?

It applies syntax mappings such as jest.fn to vi.fn, adapts assertion styles, and evaluates the transferred output against benchmark test sets.

Source text

SKILL.md · MIT
---
name: "qe-learning-optimization"
description: "Optimizes QE agent performance through transfer learning, hyperparameter tuning, and pattern distillation across test domains. Use when improving agent accuracy, applying learned patterns to new projects, tuning quality thresholds, or implementing continuous improvement loops for AI-powered testing."
trust_tier: 3
validation:
  schema_path: schemas/output.json
  validator_path: scripts/validate-config.json
  eval_path: evals/qe-learning-optimization.yaml
---

# QE Learning Optimization

## Purpose

Guide the use of v3's learning optimization capabilities including transfer learning between agents, hyperparameter tuning, A/B testing, and continuous performance improvement.

## Activation

- When optimizing agent performance
- When transferring knowledge between agents
- When tuning learning parameters
- When running A/B tests
- When analyzing learning metrics

## Quick Start

```bash
# Transfer knowledge between agents
aqe learn transfer --from jest-generator --to vitest-generator

# Tune hyperparameters
aqe learn tune --agent defect-predictor --metric accuracy

# Run A/B test
aqe learn ab-test --hypothesis "new-algorithm" --duration 7d

# View learning metrics
aqe learn metrics --agent test-generator --period 30d
```

## Agent Workflow

```typescript
// Transfer learning
Task("Transfer test patterns", `
  Transfer learned patterns from Jest test generator to Vitest:
  - Map framework-specific syntax
  - Adapt assertion styles
  - Preserve test structure patterns
  - Validate transfer accuracy
`, "qe-transfer-specialist")

// Metrics optimization
Task("Optimize prediction accuracy", `
  Tune defect-predictor agent:
  - Analyze current performance metrics
  - Run Bayesian hyperparameter search
  - Validate improvements on holdout set
  - Deploy if accuracy improves >5%
`, "qe-metrics-optimizer")
```

## Learning Operations

### 1. Transfer Learning

```typescript
await transferSpecialist.transfer({
  source: {
    agent: 'qe-jest-generator',
    knowledge: ['patterns', 'heuristics', 'optimizations']
  },
  target: {
    agent: 'qe-vitest-generator',
    adaptations: ['framework-syntax', 'api-differences']
  },
  strategy: 'fine-tuning',
  validation: {
    testSet: 'validation-samples',
    minAccuracy: 0.9
  }
});
```

### 2. Hyperparameter Tuning

```typescript
await metricsOptimizer.tune({
  agent: 'defect-predictor',
  parameters: {
    learningRate: { min: 0.001, max: 0.1, type: 'log' },
    batchSize: { values: [16, 32, 64, 128] },
    patternThreshold: { min: 0.5, max: 0.95 }
  },
  optimization: {
    method: 'bayesian',
    objective: 'accuracy',
    trials: 50,
    parallelism: 4
  }
});
```

### 3. A/B Testing

```typescript
await metricsOptimizer.abTest({
  hypothesis: 'ML pattern matching improves test quality',
  variants: {
    control: { algorithm: 'rule-based' },
    treatment: { algorithm: 'ml-enhanced' }
  },
  metrics: ['test-quality-score', 'generation-time'],
  traffic: {
    split: 50,
    minSampleSize: 1000
  },
  duration: '7d',
  significance: 0.05
});
```

### 4. Feedback Loop

```typescript
await metricsOptimizer.feedbackLoop({
  agent: 'test-generator',
  feedback: {
    sources: ['user-corrections', 'test-results', 'code-reviews'],
    aggregation: 'weighted',
    frequency: 'real-time'
  },
  learning: {
    strategy: 'incremental',
    validationSplit: 0.2,
    earlyStoppingPatience: 5
  }
});
```

## Learning Metrics Dashboard

```typescript
interface LearningDashboard {
  agent: string;
  period: DateRange;
  performance: {
    current: MetricValues;
    trend: 'improving' | 'stable' | 'declining';
    percentile: number;
  };
  learning: {
    samplesProcessed: number;
    patternsLearned: number;
    improvementRate: number;
  };
  experiments: {
    active: Experiment[];
    completed: ExperimentResult[];
  };
  recommendations: {
    action: string;
    expectedImpact: number;
    confidence: number;
  }[];
}
```

## Cross-Framework Transfer

```yaml
transfer_mappings:
  jest_to_vitest:
    syntax:
      "describe": "describe"
      "it": "it"
      "expect": "expect"
      "jest.mock": "vi.mock"
      "jest.fn": "vi.fn"
    patterns:
      - mock-module
      - async-testing
      - snapshot-testing

  mocha_to_jest:
    syntax:
      "describe": "describe"
      "it": "it"
      "chai.expect": "expect"
      "sinon.stub": "jest.fn"
    adaptations:
      - assertion-style
      - hook-naming
```

## Continuous Improvement

```typescript
await learningOptimizer.continuousImprovement({
  agents: ['test-generator', 'coverage-analyzer', 'defect-predictor'],
  schedule: {
    metricCollection: 'hourly',
    tuning: 'weekly',
    majorUpdates: 'monthly'
  },
  thresholds: {
    degradationAlert: 5,  // percent
    improvementTarget: 2,  // percent per week
  },
  automation: {
    autoTune: true,
    autoRollback: true,
    requireApproval: ['major-changes']
  }
});
```

## Pattern Learning

```typescript
await patternLearner.learn({
  sources: {
    codeExamples: 'examples/**/*.ts',
    testExamples: 'tests/**/*.test.ts',
    userFeedback: 'feedback/*.json'
  },
  extraction: {
    syntacticPatterns: true,
    semanticPatterns: true,
    contextualPatterns: true
  },
  storage: {
    vectorDB: 'agentdb',
    versioning: true
  }
});
```

## Coordination

**Primary Agents**: qe-transfer-specialist, qe-metrics-optimizer, qe-pattern-learner
**Coordinator**: qe-learning-coordinator
**Related Skills**: qe-test-generation, qe-defect-intelligence

© proffesor-for-testing · MIT · proffesor-for-testing/agentic-qe

Similar skills

All skills for Testing and QA →

From the same set73

The whole set →
consultancy-practices consultancy-practices is a Claude Code skill that applies software quality consulting practices: it identifies client pain, prioritizes work by impact and effort, and transfers knowledge. CX Codex +1 122installs mutation-testing Skill runs mutation testing: mutates code (operators, boundaries, logic), runs tests, and counts surviving mutants — weak spots in your test suite. CX Codex +1 122installs qe-code-intelligence qe-code-intelligence builds a semantic code index, dependency graphs and knowledge graphs. Helps understand unfamiliar codebases, trace call chains, and find code by meaning rather than keywords. CX Codex +1 122installs qe-test-execution qe-test-execution orchestrates Jest, Vitest, and Playwright suites using the aqe CLI with parallel workers, affected-test selection, and flaky test retries. CX Codex +1 122installs qe-security-compliance qe-security-compliance runs code security audits, dependency vulnerability scans, secret detection, and compliance checks for OWASP and SOC2. CX Codex +1 120installs testability-scoring testability-scoring scores web application testability against 10 principles and produces a report. Use it to check test readiness and find areas that make testing harder. CX Codex +1 119installs test-data-management The test-data-management skill creates test datasets, anonymizes PII, and keeps test records isolated. Use it for unit, integration, performance, and boundary testing. CX Codex +1 118installs iterative-loop iterative-loop runs continuous build-test-fix loops until pass criteria are met. Useful for test-driven feature development, bug fixing, and metric optimization. CX Codex +1 118installs

Project sponsors

Companies that keep this analytics open