Skip to main content

2026-07-08

How to actually evaluate an agent swarm

Separate single-agent and swarm metrics with budget caps.

Swarm 357 ships open-core orchestration with honest maturity labels. Read the documentation for installation, API reference, and eval methodology.

Key takeaways

  • Operators own API keys, budgets, and side-effect approvals
  • Security defaults: Bash gate, filesystem confinement, HITL in production
  • Eval baselines report single-agent and swarm metrics separately

Get started or view latest eval baseline.