Usage & Billing
Understand credits, generated test cases, evaluation rows, and daily limits for RedRaven.
RedRaven bills evaluation work in credits. Credits are consumed when RedRaven generates test cases and when it evaluates agent responses.
Credit Events
| Event | How credits are counted |
|---|---|
| Generate test cases | (certifications × max_policies + provided policies) × max_prompts_per_policy × 5 |
| Evaluate uploaded CSV rows | One credit per uploaded data row. |
| SDK-generated test run | Generation credits plus evaluation credits for the generated cases. |
The RedRaven app shows a simple baseline as 1 test = 2 credits: one for generation and one for evaluation. Larger datasets consume more credits because generation and evaluation are counted per generated or evaluated case.
Generation Credits
When you generate a test from certifications or provided policies, RedRaven estimates the number of generated prompts before starting the job:
generation credits = (certifications * max_policies + provided policies) * max_prompts_per_policy * 5The multiplier accounts for the generated jailbreak strategies per policy prompt. Reduce max_policies, max_prompts_per_policy, or the number of selected certifications and policies to reduce generation cost.
Evaluation Credits
Evaluation charges one credit for each response row RedRaven evaluates. For SDK runs, this maps to the generated cases that your agent answers and submits back to RedRaven for scoring.
Credits And Limits
Credits and daily generated test-case limits are checked before work starts:
| Condition | HTTP status | Code |
|---|---|---|
| Not enough credits | 402 Payment Required | INSUFFICIENT_CREDITS |
| Daily generated test-case limit exceeded | 429 Too Many Requests | DAILY_TEST_CASE_LIMIT_EXCEEDED |
| Generation parameters produce no requests | 400 Bad Request | INVALID_GENERATION_PARAMETERS |
Daily generated test-case limits reset on a UTC calendar day. The default organization limit is 1,000,000 generated test cases per day unless Fireraven configures a different limit for your organization.
Manage Credits
Buy credits, manage subscription plans, and view usage from Organization Settings under Plan, Invoice, and Usage. The app also shows a warning when an organization has no credits available.