• Latest
  • Trending
  • All
Answer card: OpenAI built its own inference chip, Jalapeño, a custom accelerator for running models built with Broadcom in about nine months, still an engineering sample.

OpenAI’s first chip, Jalapeño, is built for inference

3 September 2026
Answer card stating that Ternary Bonsai 2 27B, released by PrismML on 17 September 2026 under Apache 2.0, packs Qwen3.8 27B into 5.95 gigabytes at 1.72 bits per weight, keeps 98.2 percent of the 14-benchmark average, about 75 percent on SWE-bench Verified and Terminal-Bench 2.1, and needs PrismML's llama.cpp fork to run.

Does Bonsai 2 27B really keep 98% of Qwen3.8 in 5.95 GB?

20 September 2026
Answer card stating that Jev 1.13 from TypeSafe AI is a decision model in early access since 15 September 2026 that returns typed probabilities instead of text, priced at 42 dollars per billion input tokens with output tokens free, answering in 70 to 500 milliseconds, with a 64K token request budget, text input only, and a documented list of things it does badly, including counting and dates.

Jev 1.13 bills $42 a billion tokens, and it can’t count

19 September 2026
Answer card stating that Qwen3.8-Omni-Flash launched on 17 September 2026 as an API only model on Alibaba Cloud Model Studio, taking text, images, audio and video in a 1M token context and returning text only, priced at 0.15 dollars per million input tokens for every modality and 0.47 dollars per million output tokens in the international regions, with no open weights published and the Qwen-Live Harness GitHub repository returning 404.

Qwen3.8-Omni-Flash bills audio at $0.15 and ships no weights

18 September 2026
Answer card stating that on 15 September 2026 AWS said it is unable to restore access to resources and data hosted exclusively in the Middle East Bahrain region me-south-1 and in the mec1-az2 zone of the UAE region, because the damage spanned multiple Availability Zones and exceeded what multi-AZ services are designed to withstand.

AWS can’t restore me-south-1, six months after the drone strikes

17 September 2026
Answer card stating that Google released Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking on 15 September 2026 at 3 dollars per million audio input tokens and 12 dollars out, that the thinking model requires asynchronous tools, and that Artificial Analysis scores it 82.6 on its Speech to Speech Quality Index.

Gemini 3.8 Live Extended Thinking rejects any tool that blocks

16 September 2026
Answer card summarising the Atria Dawn Preview release: 744B GLM-5.2 base, MIT licence, 1.5 TB BF16 and 756 GB FP8 checkpoints, 256K context, top on five of sixteen benchmark rows and trailing on SWE-bench Pro.

Atria Dawn Preview is 744B under MIT, and the BF16 weighs 1.5 TB

15 September 2026
Answer card stating that OpenAI released the Agents API in public beta on 10 September 2026 with no separate fee, billed through model tokens, tool calls and hosted sandbox time, with a choice of OpenAI hosted, self hosted or partner sandboxes, US only data residency and no Zero Data Retention support.

OpenAI’s Agents API has no fee, no ZDR and a one hour sandbox clock

14 September 2026
Answer card: Sakana Fugu Max at $2 and $6 per million tokens, Fugu Ultra v2 unchanged at $5 and $30, and Sakana saying Ultra v2 scores without Fable 5 or GPT-6 Astra in its pool.

Fugu Max costs $2 and $6 while Fugu Ultra v2 runs without Fable 5

13 September 2026
Answer card stating that DeepSeek released DeepSeek-V4.1-Flash on 10 September 2026 as a 552 billion parameter mixture of experts model with a new causal encoder decoder architecture that activates 8 billion parameters on input and 16 billion on output, with native vision, a one million token context and MIT licensed weights, that the API model name is now deepseek-flash at 0.15 dollars per million input tokens and 0.60 dollars per million output tokens off peak, and that DeepSeek announced V4 Pro would be routed to V4.1-Flash from 14 September and reversed that on 11 September.

DeepSeek V4.1-Flash arrived, and the V4 Pro retirement lasted a day

12 September 2026
Answer card stating that Cognition released SWE-2 on 10 September 2026, a coding model post-trained from Kimi K3, scoring 50.0 percent on FrontierCode 1.1 Main against 50.9 percent for Claude Fable 5.1 and 27.3 percent on Terminal-Bench 4 against 55.8 percent, available only inside Devin.

SWE-2 trails Fable 5.1 by one point, and by 28 on Terminal-Bench 4

11 September 2026
Answer card for Meta Muse, free to 100 million tokens a week then $20 a month, launched 8 September 2026 for United States adults only, running in a dedicated per user virtual machine.

Does Meta Muse do enough to earn your inbox and a card on file?

9 September 2026
Answer card stating that the public download pages for the VMware Virtual Disk Development Kit on developer.broadcom.com began returning 404 errors on 25 August 2026 with no announcement or deprecation notice, that Broadcom support tells customers the kit is no longer available for use or download, and that release lines 7.0.3.1, 8.x and 9.x are all affected.

Broadcom pulled VDDK 8.0 and 9.0, and the 404 is the only notice

8 September 2026
  • About
  • Contact
  • Privacy
  • Legal
Sunday, September 20, 2026
  • Login
Packet Nebula
  • Home
  • Articles
    • Security
    • Network
    • Dev
    • Sysadmin
    • SEO
    • Email & DNS
  • Tools
    • Network tools: free, fast, no signup
    • Security tools: free, fast, no signup
    • Developer tools: free, fast, no signup
    • Sysadmin tools: free, fast, no signup
    • SEO tools: free, fast, no signup
    • Email & DNS tools: free, fast, no signup
  • Download
  • About
No Result
View All Result
Packet Nebula
No Result
View All Result
Home Dev

OpenAI’s first chip, Jalapeño, is built for inference

by stephane
3 September 2026
in Dev
0
Answer card: OpenAI built its own inference chip, Jalapeño, a custom accelerator for running models built with Broadcom in about nine months, still an engineering sample.
493
SHARES
1.4k
VIEWS
Share on FacebookShare on Twitter

Sam Altman got handed a chip on a stage, and the AI hardware race picked up a new character. On June 24, OpenAI and Broadcom unveiled Jalapeño, OpenAI's first custom silicon, and here's the one-line version we'd give a colleague: it's an inference accelerator, the chip that runs a trained model on every request, not the GPU that trains it. OpenAI designed it around how its own models serve traffic, Broadcom handled the silicon, Celestica the systems. Design to tape-out in about nine months. It isn't for sale, it's still an engineering sample, and deployment is targeted for the end of 2026. So the real question isn't whether it's impressive. It's whether any of it reaches your desk.

The short answer

OpenAI announced Jalapeño, its first custom chip. It is an inference accelerator, built for running models rather than training them, and you cannot buy one. The near-term effect on your work is basically nothing. The slow-burn effect, if the numbers hold, is cheaper inference for OpenAI, which can leak into steadier API pricing and less exposure to Nvidia shortages.

June 24unveiled with Broadcom
~9 modesign to tape-out
End 2026deployment target
Answer card: OpenAI built its own inference chip, Jalapeño, a custom accelerator for running models built with Broadcom in about nine months, still an engineering sample so the speed claims are unproven.
The one-card version. A chip for running models, not training them, and not one you can buy yet.

What OpenAI actually shipped

Not a product. A prototype with a name. OpenAI and Broadcom put Jalapeño on stage on June 24, and the parts worth writing down are narrow. It’s OpenAI’s first custom accelerator, what the companies call an Intelligence Processor, and it’s a single massive ASIC (Tom’s Hardware pegged it as reticle-sized, meaning about as big as a chip can physically get). Broadcom did the silicon implementation and networking. Celestica handles boards and racks. OpenAI did the architecture, because it wanted a chip shaped around how its own serving stack behaves rather than a general-purpose part it then bends to fit.

The timeline is the flashy bit. OpenAI says Jalapeño went from first design to tape-out in roughly nine months, which it calls possibly the fastest ASIC cycle ever pulled off in high-end semiconductors. That’s their framing, and tape-out is not the same as a shipping product, so file it under impressive but unverified. Engineering samples are running real workloads in the lab at production target frequency and power, including a coding model OpenAI names as GPT-5.3-Codex-Spark. Live traffic? Not yet. Deployment is aimed at the end of 2026.

The Jalapeño inference chip from OpenAI and Broadcom, shown in OpenAI's official announcement.
Jalapeño, from OpenAI’s own announcement. Image: OpenAI.

Inference, not training, is the whole point

Here’s the distinction that makes sense of the news. Training a model is the one-time, brutal job: months on a giant cluster to produce the weights. That still runs on Nvidia, and OpenAI hasn’t suggested otherwise. Inference is the other job, the model answering you, and it fires on every single request. At OpenAI’s scale that’s the meter that never stops spinning. Jalapeño is a blank-slate design for that second job, and OpenAI was blunt about the goal: lower operating cost when running interactive models like the coding ones people hammer all day.

Diagram: training builds the model and still runs on Nvidia GPUs unchanged, while inference answers every prompt and is where Jalapeño, OpenAI and Broadcom's custom chip, comes in.
Two different jobs. Training stays on Nvidia. Jalapeño is for the part that runs on every request.

The one number OpenAI put out is performance per watt, which it says early testing shows is substantially better than current state-of-the-art. Read that carefully. It’s a lab reading on a sample, OpenAI is still measuring, and there is no independent benchmark. So we’d treat it as a direction of travel, not a spec you can bank on. Efficiency per watt is the honest thing to chase for inference, mind you, because at data-center scale the power bill is a big slice of what a token costs to serve.

Does it change your day? Mostly no

Let’s be honest about the reach of this. You can’t buy a Jalapeño, you can’t rent one, and it doesn’t touch the quality of the models you already call. Same GPT models, different metal underneath. If you were hoping OpenAI shipped hardware you could drop into a homelab, this isn’t that, and nothing on the roadmap says it will be.

Checklist of what OpenAI's Jalapeño chip does and does not change for you: you cannot buy it and model quality does not move, but cheaper inference can drift into steadier API prices and less Nvidia dependence, and none of it is proven yet.
The honest split between what this changes for you now and what stays hype until end of 2026.

Where it could matter, slowly, is your invoice and your uptime. If OpenAI serves its own models more cheaply, that pressure can show up as steadier or lower API prices over time, the same way custom silicon at the other big clouds has. And a company less hostage to Nvidia allocation is a company whose rate limits wobble less when GPUs get scarce. Both are real, both are indirect, and both are a 2027 story at the earliest. If you’re picking a model today, the GPT-5.6 versus GPT-5.5 tradeoff matters far more than the chip underneath, and if you want to understand why inference cost is the number that quietly runs your bill, our Fable 5 effort-level breakdown walks through exactly where the money goes.

The honest read

Jalapeño is a strategy move dressed as a chip launch. OpenAI wants to own more of its own stack and lean on Nvidia less, and building custom inference silicon is how the hyperscalers have chipped at that for years. Real story. Just not a product story, and not yours to use. So don’t re-architect anything around it, don’t read the performance-per-watt line as gospel, and don’t expect a Jalapeño instance to appear in a console. Watch the API price sheet over the next year. That’s where this either shows up or it doesn’t.

Sources: OpenAI and Broadcom’s official Jalapeño announcement and Broadcom’s press release; reporting and context via TechCrunch and Tom’s Hardware, June 2026. Performance figures here are OpenAI’s own lab claims on engineering samples and are not independently verified.

Frequently asked questions

What is OpenAI's Jalapeño chip?

Jalapeño is OpenAI's first custom chip, an inference accelerator it calls an Intelligence Processor. OpenAI designed it from scratch for running large language models, with Broadcom on the silicon and Celestica on the systems. It is built for inference, meaning it runs already-trained models to answer requests, and it is not aimed at training.

Can I buy a Jalapeño chip?

No. It is internal silicon for OpenAI's own data centers, not a card you can put in a server or a cloud instance you can rent. There is no consumer or enterprise product, and OpenAI has not announced one.

When will Jalapeño be deployed?

OpenAI is targeting initial deployment by the end of 2026, expanding after that as the first step in a multi-generation compute platform with Broadcom. Right now the chip is at the engineering-sample stage, running workloads in the lab rather than serving live traffic.

Does Jalapeño replace Nvidia GPUs?

Not for training. OpenAI still relies on Nvidia hardware for the heavy work of training models. Jalapeño targets inference, the part that runs constantly once a model ships, so the goal is to reduce dependence on Nvidia for serving rather than to swap it out everywhere.

How was Jalapeño built so fast?

OpenAI says the chip went from initial design to manufacturing tape-out in roughly nine months, which it describes as possibly the fastest ASIC development cycle achieved in advanced semiconductors. That claim is OpenAI's own, and final performance is still being measured, so treat the speed and efficiency numbers as unproven for now.

Tags: aibroadcomhardwareinferencenewsopenai
Share197Tweet123
stephane

stephane

  • Trending
  • Comments
  • Latest
Answer card: Proton Lumo 2.0 is private by policy, not by locality. Saved history is locked so even Proton cannot read it, but the prompt is decrypted on a Proton EU server to answer it, then forgotten.

Proton Lumo 2.0 review: how private is it, really?

3 September 2026
The Agentic Coding section of the official Hy4 preview benchmark appendix published by Tencent, a table comparing Hy3 and Hy4 preview against DeepSeek V4 Pro 0813, Qwen 3.8 Max, GLM 5.3, Kimi K3, GPT 5.6 Sol and Claude Opus 5 across SWE-bench Multilingual, SWE-bench Pro, DeepSWE, three SWE Atlas tasks, SWE-Marathon, Terminal-Bench 2.1, NL2Repo-Bench, CyberGym, ProgramBench, PostTrainBench and Harbor-Index.

Tencent’s 770B Hy4 tops one benchmark row in 46

3 September 2026
Answer card: Qwen 3.7 Max is API-only and cannot run locally yet; the open Qwen models (Qwen 3.6 27B, qwen3:8b to 32b) run offline via Ollama.

Qwen 3.7 local: what you can actually run offline

22 June 2026
Answer card: JWTs are not encrypted, anyone can read them; the signature proves who issued the token, not who may read it.

Are JWTs encrypted? No, and the difference will bite you

0
Answer card: a random 8 character password falls in under 2 hours offline, while 16 random characters hold for 1.4 trillion years at the same speed.

How long does it take to crack a password in 2026?

0
Answer card: three DNS records decide if your mail lands or bounces; SPF lists allowed senders, DKIM signs messages, DMARC sets the failure policy.

SPF, DKIM and DMARC explained: the records your email needs

0
Answer card stating that Ternary Bonsai 2 27B, released by PrismML on 17 September 2026 under Apache 2.0, packs Qwen3.8 27B into 5.95 gigabytes at 1.72 bits per weight, keeps 98.2 percent of the 14-benchmark average, about 75 percent on SWE-bench Verified and Terminal-Bench 2.1, and needs PrismML's llama.cpp fork to run.

Does Bonsai 2 27B really keep 98% of Qwen3.8 in 5.95 GB?

20 September 2026
Answer card stating that Jev 1.13 from TypeSafe AI is a decision model in early access since 15 September 2026 that returns typed probabilities instead of text, priced at 42 dollars per billion input tokens with output tokens free, answering in 70 to 500 milliseconds, with a 64K token request budget, text input only, and a documented list of things it does badly, including counting and dates.

Jev 1.13 bills $42 a billion tokens, and it can’t count

19 September 2026
Answer card stating that Qwen3.8-Omni-Flash launched on 17 September 2026 as an API only model on Alibaba Cloud Model Studio, taking text, images, audio and video in a 1M token context and returning text only, priced at 0.15 dollars per million input tokens for every modality and 0.47 dollars per million output tokens in the international regions, with no open weights published and the Qwen-Live Harness GitHub repository returning 404.

Qwen3.8-Omni-Flash bills audio at $0.15 and ships no weights

18 September 2026
  • About
  • Contact
  • Privacy
  • Legal

Copyright © 2026 Stephane Cardon.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • Home
  • Articles
    • Security
    • Network
    • Dev
    • Sysadmin
    • SEO
    • Email & DNS
  • Tools
    • Network tools: free, fast, no signup
    • Security tools: free, fast, no signup
    • Developer tools: free, fast, no signup
    • Sysadmin tools: free, fast, no signup
    • SEO tools: free, fast, no signup
    • Email & DNS tools: free, fast, no signup
  • Download
  • About

Copyright © 2026 Stephane Cardon.