Home / Research / AI Startup Gross Margin Statistics

Market research · September 21, 2026

AI Startup Gross Margin Statistics: 2026 Report

This report looks at AI startup gross margins as of 2026. Gross margin here means revenue minus cost of revenue, and the inference and compute share is the portion of revenue spent on third-party model API fees, GPU rental, and self-hosted inference, excluding model training, which most model labs book outside cost of revenue.

We collected quarterly financials from Q3 2024 through Q2 2026 for 168 venture-backed AI startups across five categories: AI-native applications, AI agents, developer tools and coding products, infrastructure and inference platforms, and model labs. Figures came from founder surveys and data room reviews, with 2026 covering Q1 and Q2, and we surveyed 57 venture investors on the lowest gross margin they would fund at each round.

AI Startup Gross Margin by Category

In the table below, we compare average gross margin and inference and compute cost for each AI startup category against a traditional SaaS benchmark, the 77% median we measured across 40 public SaaS companies.

The AI Startup Gross Margin by Category, 2026

CategoryCompanies in SampleAverage Gross MarginInference and Compute Cost (% of Revenue)Gap to SaaS Benchmark (pts)
AI-native applications5856%29%-21
AI agents3643%40%-34
Developer tools and coding2931%53%-46
Infrastructure and inference platforms3347%37%-30
Model labs1239%45%-38
All AI startups16846%38%-31
Traditional SaaS benchmark4077%6%0

Insights

Gross Margin Trend by Quarter, Q3 2024 to Q2 2026

In the table below, we track average gross margin by quarter for all AI startups in our sample, for AI-native applications, and for developer tools and coding products. Each value is a simple average across reporting companies, and the Q1 and Q2 2026 values average to the 2026 figures in the category table.

The Gross Margin Trend by Quarter, Q3 2024 to Q2 2026

QuarterAll AI StartupsAI-Native ApplicationsDeveloper Tools and Coding
Q3 202436%45%18%
Q4 202438%47%14%
Q1 202537%49%21%
Q2 202540%48%24%
Q3 202542%52%23%
Q4 202543%54%27%
Q1 202645%55%30%
Q2 202647%57%32%
Line chart of average gross margin by quarter from Q3 2024 to Q2 2026 for All AI Startups, AI-Native Applications, and Developer Tools and Coding.
The Gross Margin Trend by Quarter, Q3 2024 to Q2 2026

Average gross margin across the sample rose 11 points over the eight quarters, with a single quarterly decline in Q1 2025. Developer tools and coding products gained the most, climbing 14 points from 18% to 32%, though their path was also the most uneven: margins fell to 14% in Q4 2024 and slipped again in Q3 2025 as agentic features multiplied tokens per request. AI-native applications moved more steadily, adding 12 points with one small dip in Q2 2025. The Information reported in August 2025 that Replit's gross margins swung between 36% and negative 14% as its revenue surged.

The upward trend tracks falling model prices. Andreessen Horowitz estimated in November 2024 that for an LLM of equivalent performance, inference cost falls by 10x every year. ICONIQ's July 2026 State of AI report puts average gross margin on AI products at 45% in 2025, projected to reach 53% in 2026, somewhat above our sample, which averaged between 37% and 43% in each quarter of 2025. Model providers saw the same direction of travel: Jason Lemkin of SaaStr, citing reported figures, wrote in December 2025 that OpenAI's compute margin reached 70% in October 2025, up from 35% in January 2024.

Gross Margin by ARR Stage

In the table below, we group the 168 startups by annual recurring revenue at the end of Q2 2026 and show average gross margin, compute cost share, and the share of companies above a 60% gross margin in the first half of 2026.

The Gross Margin by ARR Stage, 2026

ARR StageCompanies in SampleAverage Gross MarginInference and Compute Cost (% of Revenue)Share Above 60% Gross Margin
Under $1M3438%43%12%
$1M to $5M4743%41%19%
$5M to $20M4148%37%29%
$20M to $100M3153%33%35%
Over $100M1552%34%33%
All stages16846%38%24%

Gross margin rose with scale through the $20M to $100M band, from 38% below $1M ARR to 53%, while compute cost fell from 43% of revenue to 33%. Only 12% of sub-$1M companies cleared a 60% margin, compared with 35% in the $20M to $100M band. Larger contracts let companies negotiate committed-use discounts with model providers and spread fixed hosting costs over more revenue, while the smallest companies carried the most free-tier usage relative to paid revenue.

Margins eased slightly above $100M ARR, to 52%, as compute cost rose to 34%. Several of the largest companies in that band grew on heavy free usage and aggressive agent features, the pattern Bessemer Venture Partners described in its State of AI 2025 report, where fast-scaling "Supernovas" averaged about 25% gross margin, often negative, against roughly 60% for "Shooting Stars." Companies above $100M ARR still averaged 14 points more margin than the sub-$1M group, and their compute share sat 9 points lower.

Margin Levers and Their Measured Effect

In the table below, we show the share of startups using each margin lever and the median gross margin change from the quarter before adoption to Q2 2026, limited to companies that adopted the lever by Q2 2025. Adoption shares sum to more than 100% because most startups used several levers at once.

The Margin Levers and Their Measured Effect, 2026

LeverShare of Startups Using ItMedian Gross Margin Change (pts)Median Months to Full Effect
Model routing61%+74
Response caching72%+42
Fine-tuned small models29%+119
Usage or credit pricing44%+96
Outcome-based pricing14%+68
Batch inference33%+33

Insights

Minimum Gross Margins Investors Accept by Round

For the table below, we surveyed 57 venture investors who led or co-led AI rounds in 2025 or 2026 on the lowest gross margin they would fund at each round in 2024 and 2026, the margin they expect 24 months after the round, and whether they require a written margin roadmap.

The Minimum Gross Margins Investors Accept by Round, 2026

Funding RoundMinimum Accepted, 2024Minimum Accepted, 2026Expected 24 Months After RoundInvestors Requiring a Margin Roadmap
Seed55%35%57%46%
Series A60%42%61%63%
Series B65%50%66%79%
Series C and later70%56%71%86%

Investors lowered their floors by 14 to 20 points at every stage between 2024 and 2026. A Series A AI startup can now raise with a 42% gross margin, down from 60%, and investors expect it to reach 61% within two years, with 63% of them requiring a written plan to get there. The distance between today's floor and the 24-month expectation ran 15 to 22 points, widest at seed, where investors accept 35% today and expect 57% two years later. That tolerance matches Pilot's March 2025 guidance that a 50% to 60% margin is defensible for an AI startup, against 80% for an efficient SaaS company. Our 2026 floors for Series B and later sit at or above the lower end of that range, which suggests later-stage investors have kept most of their discipline while early-stage investors price in future cost declines.

Public companies show where the market may settle. SoundHound AI reported a 45.1% GAAP gross margin and a 58.4% non-GAAP gross margin for Q2 2026, while C3.ai reported a 17% GAAP and 37% non-GAAP gross margin for its fiscal third quarter of 2026. Our 2026 sample average of 46% sits near SoundHound's GAAP figure, and investor expectations of 57% to 71% two years out assume inference prices keep falling. C3.ai's 20-point spread between GAAP and non-GAAP margin also shows how far stock compensation and amortization can move a headline figure, a caution for anyone comparing private company self-reports.

Requesting a Copy of This Report

If you would like a PDF copy of this report, including the full quarterly dataset by category and ARR stage, you can reach out here. The underlying data also includes quarterly margins for all five categories, every ARR band, and each of the six margin levers covered above.

Sources