Advancing chip design with OpenAI models (openai.com)
161 points by vighneshiyer 8 hours ago
jacquesm 4 hours ago
It's interesting how the first period of AI companies was improving their AIs and now they are diversifying into just about every other industry with models that they withhold from the market. Effectively these companies are now competing with each and every one of their customers whilst having the inside scoop on what those customers are up to.
To me this signifies two things: the low hanging fruit has been plucked and we are now on the slow but steady incremental improvement part of the trajectory and the second is that if you share your corporate secrets with these companies you can count on that being used against you sooner or later and they'll be using tools that you can't buy from them at any price.
root_axis 3 hours ago
Pretty much the same strategy as Amazon. Systematically extract business intel from all your customers at scale, then use that data to gradually take over your customer's businesses.
fhn 2 hours ago
customers and employees
dominotw 3 hours ago
Do businesses really have that much "intel" ? Like what intel do they need from google to copy gmail.
palata 3 hours ago
melagonster 3 minutes ago
CompoundEyes an hour ago
Isn’t this just the outcome of turning AI into a researcher? Discoveries across anything and everything from which to create new products. I think Anthropic and OpenAI will start looking like Mitsubishi Group.
jacquesm an hour ago
If you agree that Google selling you a browser, a mobile phone operating system, a search engine, an advertising empire and an office suite leads to some problems then I won't have to convince you that this is a bleak prospect.
The Mitsubishi group is worth 130B or so, this is estimated to be 10x that or so. There is no way you will be able to effectively regulate an entity that size.
ralph84 4 hours ago
Many companies are happily selling their corporate secrets to AI companies. The upfront payment is too lucrative to ignore, the future be damned.
jacquesm 3 hours ago
Many companies are happy to give their corporate secrets to AI companies.
b112 3 hours ago
alpha_squared 3 hours ago
This is something I've been wracking my brain with for the last couple years. These companies are not quite profitable (if they ever will be?) and their valuations demand that they're unimaginably profitable. Sure, some investors are sold on the whole creating AI-god thing, but a lot of the investors are looking for traditional return multiples.
If selling access to the models to stay afloat while needing to pour ever-more resources into the next model to remain competitive are not sufficient, it would follow that they'd eventually look at which customers are successfully making money off their products and to follow that trail.
Basically, any money a customer makes from using their models is money "on the table" for them to pick up, no?
dachris 4 hours ago
Not sure about the trajectory, but yeah, many companies are just sharing their code, business strategy etc. with their potentially worst competitor.
At least the sharing part should be manageable: you need local models, or inference providers that you can really count on to not share your data.
bethekidyouwant 2 hours ago
Oh no! They might take market share from NVIDIA, Apple, AMD, Qualcomm and Broadcom?!
jacquesm 2 hours ago
Did you end up commenting in the wrong thread?
bethekidyouwant an hour ago
empath75 3 hours ago
> To me this signifies two things: the low hanging fruit has been plucked
I don't think this is even close to true. People have still barely figured out how to apply AI effectively.
jacquesm 3 hours ago
That's about the applications, not about the core tech.
dominotw 3 hours ago
didnt they try something with disney and shutdown sora. recently shutdown their robotics division too.
sascac 6 hours ago
Naming the chip Jalapeño is great. Not only does it play into hot potato chips, but also Jalapeño peppers come from Xalapa, a city in Mexico. Xalapa comes from the Nahuatl word Xallapan, which roughly translates to "place of sandy water." These chips are made from quartz sand, and a data center then uses water to cool them. A data center is a place of sandy water!
hingler36 4 hours ago
I sincerely doubt they thought this hard about the name, which is a shame because this is a really cool justification!
Aarostotle 5 hours ago
This is the kind of comment that I come to Hacker News for.
I hope it’s true
htrp 5 hours ago
seems like the AI named the chip,
prompt: come up with a name for an inference chip that works across multiple leveling, think hard
lofties 2 hours ago
Claude told me "Octave" would be a good name, but it assumed "multiple levels" meant the chip would work from DCs to the edge. Started a new prompt explaining I wanted multiple levels of depth to the name instead and it came up with Sequitur.
But none of the reasons given for the name are as deep as OPs explanation.
smusamashah 5 hours ago
You can use the same argument for almost everything these days.
NetOpWibby 4 hours ago
Thanks for the prompt
skyberrys 5 hours ago
I am seeing good results with chip design by treating it as a software design problem, using the agent to write software to generate my circuits and then write software to automate my EDA flow. Then the agent can babysit my several runs of multi hour simulation so I don't have to anymore.
I don't drive straight at the RTL though. Infact only a small fraction of the design in RTL, the bulk is analog.
zardo 7 hours ago
Am I missing something or are they not sharing those RISC-V designs?
PowerElectronix 7 hours ago
They're probably embarrasing. Circuit design does not in the least work like code design.
fooblaster 6 hours ago
This is a very verifiable task with well defined metrics and verifiable results. Chip designers are going to have just a rough time of it as software engineers.
It's just so obvious that with access to a timing and power simulator they will be able to do this just as well, as let's say opus 5.5 is at blackwell optimization. Which is to say, effectively superhuman.
anvuong 5 hours ago
tencentshill 5 hours ago
pedro_caetano 4 hours ago
oddIdentities 5 hours ago
denverllc 5 hours ago
epistasis 7 hours ago
I've heard this too, all the IC designers I know think there's some fundamental training missing that prevents the models from creating highly optimized circuits, which is what's needed for most tasks of interest.
scrlk 5 hours ago
ducktective 6 hours ago
maherbeg 4 hours ago
wuschel 7 hours ago
But there are encoded heuristics in the design software for chips/IC, or formalizable constraints, are there not?
throwawaycsdc3 3 hours ago
CalChris 5 hours ago
This is pre synthesis logic. It’s a lot like code and indeed Berkeley Boom is designed in Chisel which is based on Scala.
giancarlostoro 6 hours ago
Personally, I dont care how it looks as long as it works, and works well, and lasts long.
george_max an hour ago
I wonder when we'll get to the point of AI designing their own TSMC-like machines specialized for AI ASICs, alongside designing their own server infrastructure, buildings, etc.
tschellenbach 5 hours ago
The same improvement loops will happen to every area of science.
amelius 3 hours ago
I said it before ... this is how nvidia is fueling their own demise.
fhn 2 hours ago
or Nvidia will use this to design and make chips for cheap and sell it to you for $$. Who loses here?
zackmorris 6 hours ago
It will be interesting to see if AI really starts innovating in circuit design or just continues doing the wrong things faster. But I'd bet that it will soon run circles around the status quo, and rightly so.
We're way out on the long tail of a dead-end approach to computation that started in the late 1990s with GPUs when we chose to optimize SIMD at the expense of general-purpose computing. On top of that, Moore's Law ended in roughly 2007 with the arrival of smartphones, when the industry chose cost and power minimization over compute maximization via a multicore approach.
Now only servers have access to highly multicore chips like AMD EPYC, at 10-100 times the cost and with poorer performance than if they maximized local/shared memories with content-addressable caching. Apple's M line of processors is ok, but its specialized cores just stand in the way of the higher abstractions available with symmetric multiprocessing, upon which specialized algorithms can be built. We're still missing the multicore foundation.
I used Synopsys and Cadence back in college in the late 1990s to automatically place and route circuits from diagrams in SPICE (I think, my memory is foggy) and they already performed 80% as well as humans. I don't remember if that was for chip area, speed or power. But the big players were obviously using tools at least as capable as whatever we were trained on.
Then in the 2000s I had hoped to do what OpenAI is doing and simulate small/open CPU designs on FPGAs. But the economics just weren't there. Even though some people like me (the poors) knew just exactly what could work, there was a tech winter between roughly the Dot Bomb around 2000 to the start of the Mobile Bubble in the early 2010s. So we didn't have a way to communicate what was possible to the people with capital, without having to network to get through the gatekeeping. Which may be fun for enthusiasts, but it's anathema to hackers wanting to get real work done.
I'd nearly given up all hope of progress until last year when AI went mainstream. Now I see 3 steps to the epiphany:
[x] Time
[ ] Money
[ ] Resources
AI solves the time component, since specs (ideas) are orders of magnitude easier to create than implementations.
But money and resources may not be available for quite some time. It's looking like the music may stop for AI funding next year, now that the election is over and the writing's on the wall as far as doing things without consent goes. Regulation is coming, and with it perhaps the last AI winter, although admittedly I'm probably exaggerating.
So as usual, we may have to pull ourselves up by our bootstraps and skip the money step to provide resources directly to ourselves and the rest of humanity. There's so much capital now that all it can do is inflate Wall Street. There's little to no carryover onto Main Street. So in a very real way, it's easier now to make money by borrowing and investing than going to a job. That's a dangerous situation for any country, as it slips into being a giant casino of haves and have-nots. We'll let the farms go under before raising taxes.
The interesting thing is that without my involvement, the universe went ahead and made AI without me, which is ..surprising. But automating problem solving was perhaps the hardest problem there was. The remaining problems are easier. We may be ready for Morris's Law of Manifestation, where the time it takes to manifest whatever you can think of keeps halving. So whatever tech or medical breakthrough you're wishing for will arrive in 12 years now, not 25. Then if you don't get it, it arrives in just 6 more years. Then 3, then 2, then 1, then we reach the Singularity. So whatever all this is will certainly end by 2050. I just hope that whatever's on the other side has less suffering rather than more.
Sorry this got so long. I've been thinking about it for a long time.
throwaway3252 6 hours ago
I agree with a lot of what you wrote as I've been thinking about this a long time too.
The conclusion I came to is none of this really solves the problem hardware designers like me have.
The problem is not circuits, or RTL, takes too long to write or design. The problem is circuits take too long to verify and validate. I haven't measured it, but I'm mostly sure even with a tool could take the spec to RTL time to zero, I would not be able to make even one more chip per year. Which is not to say that tool wouldn't be useful and a cost savings. It definitely would be. It's just to say the impact will be limited in current incarnations. Amdahl's law and all that.
And with people spitting out even larger gobs of RTL, and that getting that force multiplied by AI, is not making the verification problem any easier.
anon-3988 3 minutes ago
> The problem is not circuits, or RTL, takes too long to write or design. The problem is circuits take too long to verify and validate. I haven't measured it, but I'm mostly sure even with a tool could take the spec to RTL time to zero, I would not be able to make even one more chip per year. Which is not to say that tool wouldn't be useful and a cost savings. It definitely would be. It's just to say the impact will be limited in current incarnations. Amdahl's law and all that.
Maybe we should all reverse engineer the tools to make it our own and make it better
davemp 7 hours ago
> We have partnered with AMD […] on the flagship GPU IP
Curious how these partnerships work. AMD uploads its X Billion dollar IP and OpenAI pinky promises not to retain or train on it?
pwarner 5 hours ago
I mean society is built on pink promises backed by lawyers is it not?
wmf 4 hours ago
Every company is uploading their IP to TSMC and it seems to be fine.
throwa356262 3 hours ago
The contract says "will not train on customer data" and conveniently leaves out "will not look at customer data".
I am 100% sure they do data mining on customer data in strategic areas. They have partnered will multiple major chip design firms and offered them huge discounts and dedicated servers. Just ask yourself why a company that is bleeding money would do something like that. What ROI are they aiming for?
epsteingpt an hour ago
You have to love the top line partnership mentioning AMD the week after Jensen gets bounced.
All's fair in love and war.
hungryhobbit 3 hours ago
You know what would actually convince me Open AI is great? If, instead of a zillion Open AI articles trumpeting how Open AI helped some random industry ...
... I saw even one single article from a company in one of those industries, actually saying "Open AI helped us do X".
Otherwise, every one of these pure marketing announcements just sounds to me like a meaningless ad.
spwa4 7 hours ago
Guess many people who got fired at Google are now working for OpenAI:
"... OpenTitan uses Ibex as the embedded processor ..."
ActionHank 7 hours ago
Really feels like OAI is just trying to make noise every day leading up to the ANT IPO.
dgellow 7 hours ago
As they should, that’s what competition is for
ActionHank 7 hours ago
Competition is for competing, this is just marketing.
I block ads everywhere else, yet this is somehow being paraded around as something of value.
BeetleB 4 hours ago
jstummbillig 6 hours ago
dgellow 7 hours ago
light_hue_1 7 hours ago
Totally meaningless advertising drivel.
Here's how you can tell: every statement and unit in that doc is worthless.
Every graph is in terms of a reward or a loss. If you have an actual amazing improvement you put it on the y axis and show how much better you can drive it. Instead of a unit that is undefined.
And every statement is hedged to the 9s. Like "AMD also verified single-digit percentage gains in PPA" That's awesome! Except.. it continues with "across key blocks of its upcoming next-generation flagship CPU using designs written by our model". The improvement could have been zero. It could have by chance proposed something. Also... designs written by our model could have been inspiration for a human. It's totally impossible to know.
If they actually had something they would be bragging about it. Instead of whatever nonsense this is.
alex1138 7 hours ago
The fact your comment is grey 19 minutes in is irritating. It feels you're making at least a good faith post but presumably OpenAI employees are here ready to downvote
Tinfoil hat, whatever. Industry people definitely are here wanting to shape narratives
core_dumped 5 hours ago
i feel this too, it's kinda driving me crazy
bpartcl 7 hours ago
'Mean normalized reward' with no equation lol