AI tool detection & filters

Swarmia automatically detects pull requests assisted by GitHub Copilot, Cursor, or Claude Code

Automatic AI tool detection

To help you understand how AI use affects developer productivity metrics, Swarmia automatically detects pull requests assisted by GitHub Copilot, Cursor, or Claude Code. You can see the AI tools involved in an individual pull request by opening it anywhere in the app.

Local changes (editor/CLI)

A pull request is considered to have local AI changes (editor/CLI) if at least one of these conditions is met:

  • Any of its commits were authored or co-authored by an AI tool (high confidence)

  • Any of its commits has the Made-with: Cursor Git trailer (high confidence)

  • It has the claude-code-assisted label (high confidence)

  • Any of its commits were made by an author who used an AI tool within the previous 24 hours (low confidence)

You can see the reason for tagging an individual pull request in a tooltip by hovering over the AI tool badge:

Cloud agent

Swarmia attributes a PR to a cloud agent if the PR or its first commit has been authored by GitHub Copilot, Cursor, or Claude Code.

The AI coding agent used to create a pull request is shown on top of the pull request author’s avatar. You can hover over the avatar to see more details:

circle-info

In Swarmia, pull requests authored by AI tools are attributed to the people who initiated them. For example, if GitHub Copilot creates a PR on your behalf, Swarmia shows you as its author.

Review agent

Swarmia attributes a PR to a review agent if it has reviews from GitHub Copilot, Claude Code, or Cursor.

AI tool filter

You can use the AI tool filter to view pull requests in Code metrics, PR exclusion rules, and investment category rules based on the AI tools involved.

The filter includes two selections:

Local changes: High confidence only

This is an optional setting that applies to local changes (editor/CLI) only.

  • Enabled: Match only work directly tagged by AI tools (labeled with "high confidence" in the list above). This can result in underreporting AI involvement.

  • Disabled: Also match work based on the authors' activity times in AI tools (labeled with "low confidence" in the list above). This can result in overreporting AI involvement.

Frequently asked questions

Why is my PR marked AI-assisted even though I didn't use AI for it?

Some AI coding tool providers don't share PR-level activity data in their analytics APIs. To address this, we use certain heuristics, such as checking if the commit authors have used an AI tool within the previous 24 hours. (See the full list of rules above.)

This can result in false positives (overreporting AI involvement). For example, if you simultaneously work on tasks A and B, but only use AI for task A, Swarmia inaccurately associates the tool usage also with task B. You can use the high-confidence filter to avoid reporting false positives.

You can hover over the AI tool label to see the exact attribution reason for any pull request:

Why is the attribution window 24 hours?

It accounts for cases where you create code with AI today but commit it tomorrow. Also, some AI coding tool providers report user activity only on the daily level, so we can't get more granular than that.

You can use the high-confidence filter to disable the time-based attribution.

Why is my PR not attributed to a cloud agent?

Swarmia attributes a PR to a cloud agent if the PR or its first commit has been authored by GitHub Copilot, Cursor, or Claude Code.

Example 1: With GitHub Copilot coding agentarrow-up-right, GitHub shows Copilot as the PR author. Swarmia shows this as a GitHub Copilot agent PR:

circle-info

Note: Regardless of what GitHub displays, Swarmia always shows the author as the person who initiated the AI coding agent PR.

Example 2: When using Cursor Cloud Agentsarrow-up-right, GitHub shows cursoragent as the author of the first commit, and the user who started the agent as the PR author. Swarmia shows this as a Cursor agent PR:

Example 3: The first commit in this PR was authored by Claude but committed by cursoragent. Swarmia shows this as a Claude Code agent PR:

If I ask an AI tool to create a PR with my local changes, is it considered a cloud agent PR?

No, we don't regard that as a cloud agent PR since you review and accept the suggestions (and perhaps manually write some of the code) before creating the PR.

The AI tool uses your local Git identity, so you are marked as the PR author and the commit author. (The tool might mark itself as the co-author, however.)

Swarmia shows these PRs as local changes.

Last updated

Was this helpful?