FAQ

General

What CI providers does FixSense support?

FixSense supports GitHub Actions and GitLab CI. Support for CircleCI and other providers is on our roadmap.

What test frameworks does FixSense support?

FixSense supports Playwright and Cypress tests. We parse each framework's specific report format (Playwright JSON/HTML, Cypress Mochawesome) for accurate analysis. Support for additional frameworks is on our roadmap.

Does FixSense see my source code?

FixSense reads relevant test files and application code only when performing analysis or auto-fix. The code is processed by AI models and is never stored on our servers beyond the analysis session.

How fast is the analysis?

Analysis typically completes in 2-5 seconds per failed test. You'll see the PR comment within 30 seconds of your CI run completing.

Plans & Limits

What counts as an "analysis"?

Each individual failed test in a CI run counts as one analysis. If your CI run has 10 failures, that uses 10 analyses from your monthly quota.

What happens when I hit my monthly limit?

FixSense stops analyzing new failures and posts a comment on the PR letting you know the limit has been reached. Your existing analyses remain accessible. Limits reset on the first of each month.

Can I use FixSense on unlimited repositories?

Yes. All plans include unlimited repositories and team members. The only limit is the number of analyses and auto-fixes per month.

Do passing tests count against my limit?

No. FixSense only processes failed tests. Passing tests are completely ignored and don't affect your usage.

Auto-Fix

Why do I need my own Anthropic API key?

Auto-fix uses Claude to generate code changes. By providing your own API key (BYOK), you maintain full control over AI usage and pay Anthropic directly at their standard rates.

Is auto-fix safe to use?

Yes. Auto-fix creates changes on a separate branch (fixsense/fix-*) and opens a Pull Request for review. It never pushes directly to your main branch. All changes go through your normal code review process.

What if the auto-fix doesn't work?

You can simply close the fix PR. The auto-fix agent learns from the failure context, so the more specific the test error, the better the fix quality. You can also manually edit the fix PR before merging.

Security & Privacy

What data does FixSense store?

FixSense stores analysis results (root cause, category, suggestions) for the duration of your plan's data retention period. Raw CI logs are processed in memory and not persisted.

Can I self-host FixSense?

Not currently. FixSense is a cloud-hosted SaaS product. If you have specific compliance requirements, please contact us.

What GitHub permissions are required?

See the Installation guide for a full breakdown of required permissions and why each is needed.