Sample budget

A worked example for “Customer support recommendation assistant” at 60,000 requests/month — computed by the same engine that powers your own estimates.

Cost / Request
$0.0012
Monthly Cost
$70.12
$841.49/yr
Cost Driver
Generate personalized recommendation summary
Avg Latency
11.0s
Budget Risk
Manageable
Score: 80/100
This workflow costs about $0.0012 per request (about $70.12/month) under current assumptions. "Generate personalized recommendation summary" is the largest cost driver.

Cost drivers

  • "Generate personalized recommendation summary" is the largest cost driver

    high

    Accounts for 80% of total estimated monthly cost ($56.38).

    A single step dominating cost means small changes to it move the whole budget.

    Suggested fix: Consider a smaller model, a lower max output length, or caching for this step first.

    Potential savings: about $16.91/month

  • "Evaluate response quality" evaluates every request

    medium

    Evaluation step runs on 100% of requests.

    Evals add a full extra model call to every request just for quality monitoring.

    Suggested fix: Sample evaluations (e.g. 10-20% of traffic) instead of running on every request.

    Potential savings: about $10.94/month

Optimization plan

Quick savings

  • Consider a smaller model, a lower max output length, or caching for this step first.

    medium quality risk

    A single step dominating cost means small changes to it move the whole budget. Accounts for 80% of total estimated monthly cost ($56.38).

    Savings: $16.91/moLatency: -400msEffort: low

Retry & eval policy

  • Sample evaluations (e.g. 10-20% of traffic) instead of running on every request.

    medium quality risk

    Evals add a full extra model call to every request just for quality monitoring. Evaluation step runs on 100% of requests.

    Savings: $10.94/moLatency: -200msEffort: low
AgentBudget Lab provides planning estimates. Actual provider pricing, token usage, latency, and bills may vary. Verify current pricing before production decisions.