Docs/AI Providers

AI Providers

Use AI models to enhance Cadence detection with detailed code analysis

Cadence can integrate with OpenAI or Anthropic to provide deeper analysis of suspicious commits detected by its pattern-based detection engine.

Overview

When enabled, Cadence uses AI to:

  • Analyze suspicious code additions for AI-generation indicators
  • Provide confidence scores and detailed reasoning
  • Identify specific patterns and red flags in detected commits
  • Generate expert assessment with explanations
  • Summarize analysis reports in natural language
  • Explain why specific strategies flagged content

AI analysis runs after suspicious commits are flagged by Cadence's detection strategies, making it an optional enhancement.

How It Works

  1. Pattern Detection: Cadence first identifies suspicious commits using 18 git or 20 web detection strategies
  2. AI Analysis (optional): If enabled, suspicious code snippets are sent to the configured AI provider for analysis
  3. Assessment: The AI returns:
    • Assessment: "likely AI-generated", "possibly AI-generated", or "unlikely AI-generated"
    • Confidence score: 0.0–1.0
    • Reasoning: Explanation of key indicators found
    • Indicators: Specific patterns detected

Supported Providers

Cadence uses a pluggable provider system with database/sql-style registration:

ProviderDefault ModelNotes
OpenAIgpt-4o-miniUses go-openai SDK. Fast and cost-effective.
Anthropicclaude-sonnet-4-20250514Plain HTTP client. High accuracy.

Both providers support custom model selection via the model config field or CADENCE_AI_MODEL environment variable.

Built-in AI Skills

Cadence includes 4 AI skills that leverage the provider system:

SkillDescription
code_analysisDetect AI patterns in code snippets
commit_reviewHolistic review of git commits
pattern_explainExplain why a strategy flagged content
report_summaryNatural-language summary of analysis reports

Skills use structured prompt management with JSON extraction and text-heuristic fallback for reliable parsing.

Getting Started

Prerequisites

Quick Setup

Bash
# Set your API key
export CADENCE_AI_ENABLED=true
export CADENCE_AI_PROVIDER=openai   # or "anthropic"
export CADENCE_AI_KEY=sk-proj-your-key-here

# Run analysis
cadence analyze ./my-repo -o report.txt --config .cadence.yaml

Configuration

See AI Configuration for detailed setup instructions, including:

  • Environment variables
  • Config file options
  • Security best practices
  • Model selection

Usage Examples

See AI Examples for:

  • Running analysis with AI enabled
  • Analyzing suspicious commits
  • Using with webhooks
  • Batch processing
  • CI/CD integration

Limitations

  • Token limits: Large code changes are truncated at line boundaries (2000 characters) with context indication
  • API usage: Each analysis incurs costs at provider rates
  • Rate limiting: Subject to provider rate limits
  • Optional only: AI analysis enhances existing detection, doesn't replace it

Costs

AI analysis adds API calls to each suspicious commit found. Typical costs:

OpenAI:

  • gpt-4o-mini: ~$0.0001–0.001 per commit analysis
  • gpt-4-turbo: ~$0.001–0.01 per commit analysis
  • gpt-4: ~$0.01–0.03 per commit analysis

Anthropic:

  • claude-sonnet-4-20250514: ~$0.003–0.015 per commit analysis
  • claude-haiku: ~$0.0003–0.001 per commit analysis

Check OpenAI pricing or Anthropic pricing for current rates.

Next Steps