OpenAI models are coming to Google Cloud (openai.com)
185 points by armcat 9 hours ago
nsagent 5 hours ago
Gotta love the disclaimer at the bottom:
Microsoft remains OpenAI’s primary cloud partner.hobofan 4 hours ago
Things that you only say because you are contractually forced to say them.
merelydev 4 hours ago
Or don't want to crash stock price.
neuroelectron 20 minutes ago
Isn't Google renting cloud compute from XAI?
v4dm 15 minutes ago
Yep, and they pay them like 900 mil per mo for it, pretty crazy from the company that first brought TPUs to market
v4dm 14 minutes ago
Google also has a stake in xAI... so they are financing themselves too
echelon 4 hours ago
OpenAI buys from Azure because of the Microsoft investment deal.
OpenAI sells and reaches enterprise customers via GCP.
Enterprises want zero data retention guarantees and they're already on AWS or GCP, so this is how OpenAI reaches those customers and makes more money.
_boffin_ 2 hours ago
Microsoft has had ZDR for inference since pretty much the beginning. Just needed to fill out a form and get approved.
_diyar 34 minutes ago
keerthiko 3 hours ago
isn't the largest portion of openAI's reach to (overwhelming cloud provider leader AWS) enterprise customers via amazon bedrock?
paxy 3 hours ago
londons_explore 3 hours ago
> Enterprises with Google Cloud spend commitments will be able to draw down their GCP commitments for these purchases.
This is a fairly big move by Google... It means revenue they have already booked and reported to shareholders they now might have to give away - potentially all of it. Bean counters hate that!
paxy 2 hours ago
“Reported to shareholders” doesn’t really mean anything. There are thousands of such line items on financial reports. The ones that matter, such as recognized revenue, don’t count future bookings. It is understood that customers renege on these commitments all the time.
Google is simply telling customers - there’s a new Google Cloud service, and you can use it under your existing account.
redwood an hour ago
Let's not quite right... you don't recognize revenue in a consumption business until the usage actually happened
londons_explore 41 minutes ago
pretty sure that's what the "spend commitment" changes. It's a "use it or lose it" agreement. It's as good as a debt the moment it is signed, used or not.
MisterMunchkin 17 minutes ago
anthonypasq 2 hours ago
Sergey better really go into "founder mode" or else Thomas Kurian (head of GCP) will continue to eat Deepmind's lunch.
Between selling TPUs to external companies and now hosting competitor models, Gemini just doesnt have the full faith of the Alphabet capital allocators, and I can't really blame them. A mature company like google would rather just expand their extremely profitable cloud business rather than dump billions into a black hole on the off chance they achieve RSI or superintelligence or whatever.
bitpush 26 minutes ago
> Our cloud business is at any given moment in time forgoing short-term revenues because we are making compute trade-offs to support frontier AI development
Sundar Pichai just this week.
https://finance.yahoo.com/technology/ai/articles/google-ceo-...
paxy an hour ago
What does “capital allocators” mean here? If your implication is that the Gemini org is resource starved and a few extra dollars will put their model in the lead that is 100% incorrect. If anything it’s the bloat and bureaucracy keeping it behind.
Signing partnerships and hosting third party models costs Google nothing, and in fact brings in a ton of revenue that will eventually go back into Gemini.
skohan an hour ago
Infra might very well be the right play. Over the past year, it seems like the evidence is on the side that there's no "secret sauce" in AI, and models will all converge towards similar capabilities. Not much margin to be had for having the best model for a month or less until another lab leapfrogs you by 3%.
hax0ron3 2 hours ago
Google uses Gemini for its AI Overview on Google Search results, though. And it seems to me that this is an area where they really have a big incentive to run their own AI that they completely control. AI Overview sits at the top of the Google Search results first page, so when it comes to marketing it's sitting in the most coveted place on the entire Internet.
anthonypasq an hour ago
im talking about research compute allocation
kenhwang 2 hours ago
It's also marketing that their AI is hilariously terrible because AI Overview is the biggest posterchild for AI slop and often used as an example of how bad Google is at AI. Gemini proper isn't that bad, just the ultra cost cutting version on search is.
eecks 40 minutes ago
sebzim4500 2 hours ago
open592 4 hours ago
I don't understand all the wild speculation and question here - openai is selling a shit ton of inference through third parties. these third parties want to provide inference to their customers who use gcp (and don't want to also inference through bedrock or azure ai foundary.
these are all zdr engagements and thus "enterprise" contracts.
basically it boils down to - anthropic already provides inference direct through GCP, Azure, and AWS - so to compete openai is doing the same.
123haw 4 hours ago
Preparing for Oracle bankruptcy.
kps 3 hours ago
There's always a silver lining!
esseph 2 hours ago
I could only hope...
bananzamba 4 hours ago
How are they trusting Google not to destill them
dumberquestions 4 hours ago
This is speculation, but funnily enough Gemini models show the least evidence of being distilled from OAI or Anthropic compared to everything else in the market.
BudaDude 3 hours ago
I feel this is correct. Google has probably the most data of any company in the world. For better or worse, they don't need to train on the outputs of other models.
iamdelirium 4 hours ago
GCP already hosts Anthropic models so probably trusts and lawyers.
lrvick 4 hours ago
Probably a very strict contract, and letting OpenAI read all the session logs like they do for their own customers.
aviinuo 4 hours ago
Nvidia GPUs let you load encrypted weights onto them and to decrypt on chip so Google would need to have some sort of Nvidia management firmware attack to read from HBM while the GPU is live
zeroxfe 3 hours ago
Distillation does not require access to weights.
jayd16 3 hours ago
Isn't distillation more of a black box type affair?
binlog 4 hours ago
Doesn’t really matter what happens at the GPU level when Google can see all API traffic.
worldsavior 4 hours ago
Except google cloud doesn't use Nvidia GPUs but TPUs.
Mond_ 3 hours ago
amelius 3 hours ago
First answer this: How are they trusting OpenRouter not to distill them?
skohan an hour ago
Open router doesn't host the models, so they wouldn't have access to the weights or reasoning traces right?
amelius 43 minutes ago
tgma 3 hours ago
America is a high-trust society.
toephu2 2 hours ago
Japan is a high-trust society. America is the opposite.
skohan 43 minutes ago
tgma 2 hours ago
paxy 3 hours ago
More like - America is a high-litigation society.
tgma 2 hours ago
binlog 4 hours ago
Contracts and lawyers are more powerful than any technical tool.
amelius 3 hours ago
Yeah like the copyright lawyers of content owners that got their works trained on?
paxy 3 hours ago
WarmWash 4 hours ago
Google Cloud couldn't give a shit about Google Deepmind, and backdooring Clouds customers only stands to hurt Cloud.
mlmonkey an hour ago
Google should just spin out DeepMind as an independent company and get out of the model building business: just sell tents and shovels as they say, and leave the actual (gold) mining to others.
hax0ron3 an hour ago
Google Search is still a large fraction of Alphabet's revenue, and Alphabet needs to be able to deliver AI results for people's searches if it wants to stay relevant in the search game.
I imagine it's much easier to have fine grained control over AI search results if you develop and own the AI yourself.
dpkirchner 43 minutes ago
Last I checked their AI results were terrible, worse than anything I get from ChatGPT or Claude. The only benefit is their AI results are fast.
If I were google there's no way I'd leave their AI overviews in place as-is.
hax0ron3 38 minutes ago
TiredOfLife an hour ago
And Google is renting compute from SpaceX.
AznHisoka 3 hours ago
Does this mean OpenAI is going to use TPU now?
AndrewKemendo 4 hours ago
We need a new acronym
Google, NVIDIA, OpenAI, MSFT…
GNOM…oh wait no
The strategy that I’ve heard said out loud now by all the major technology companies is “we’re all doing it (AI) together”
In my view this was more or less the political result of the White House summit
So I think we’re seeing what is basically going to be a giant amorphous set of collaborations such that nobody gets taken down, and the whole market doesn’t collapse
If Alphabet, OAI, MSFT, AMZ…etc all agree to be interoperable then they will be acting more or less as a single body in tension.
Whether that’s good or not is a question of your worldview but I think that’s the strategy
simonw 3 hours ago
Add Anthropic and you get MANGO. MSFT, Anthropic, NVIDIA, Google, OpenAI.
AndrewKemendo 3 hours ago
Let’s go with Mango!
paxy 3 hours ago
Giant companies working together isn’t an AI-age phenomenon. Go back 10, 20, 30 years and you’ll see that despite the public perception of competitiveness all the largest tech companies (Apple, Microsoft, Google, Samsung, Amazon) buy/sell to each other, sign partnerships and have tight economic interdependencies.
AndrewKemendo 3 hours ago
Who said it’s new? :)
However if you look at the trust busting era what preceded it was this exact kind of private “cooperation” to prevent government involvement
selimthegrim 4 hours ago
This is like that SNL skit with Tim Meadows where Will Ferrell has the F on his shirt on the kids TV show and keeps getting in the inappropriate order
solyin 4 hours ago
Add in Meta (Muse app is a winner)
MOM-NG GNOMM NGMOM MGNOM MGMNO MGMON ONMGM NOMGM NOMMG
cubefox 4 hours ago
Is this the begging of the end of Gemini?
iamdelirium 4 hours ago
GCP has been hosting Anthropic models for a while.
cubefox 4 hours ago
Google owns Anthropic stock.
tancop 4 hours ago
Why would it? The point of Gemini is provide user facing services cheaper than if they were paying OpenAI, make some money on the side with API credits and position themselves as a leader when investors want to see AI everywhere.
Google Cloud is competing with AWS. Amazon has Bedrock so Google needs to keep up with them by serving both Claude and GPT, along with Gemini and open models.
dgellow 4 hours ago
No? Why would you think that’s the case? Gemini fills its own niche
cubefox 2 hours ago
Gemini and GPT fill the same niche. They are direct competitors.
lemonish97 3 hours ago
"OpenAI models will soon be available in the Gemini Agent"
They definitely need to have a better name if they're going to use 3p models
torben-friis 2 hours ago
New to Google?
game_the0ry 3 hours ago
Prediction: google cloud will pivot to being a hyperscaler versus a model + hyperscaler. Kind of like how xAI started hosting anthropic workloads with colossus cluster.
bc the alpha is not the model, the alpha is having the physical infra (chips, power, etc).
paxy 3 hours ago
A company is allowed to do two things
hackernudes 3 hours ago
But x.ai also hosts Grok? Why would google stop developing their own models? I think you're right that Google will try to make money from their infrastructure (that's basically what Google Cloud is too).
ReptileMan 2 hours ago
As much as I like Elon, if Grok was a hero shooter its concurrent steam player count will be in low hundreds.
cma 2 hours ago
>Kind of like how xAI started hosting anthropic workloads with colossus cluster.
Google has been hosting part of Anthropic's load long before that deal. They had a big degradation due to compiler bug for TPUs in an optimization they made to work around TPUs not being able sample from the logits efficiently.
barumrho 3 hours ago
Is that a long term prediction? Are you saying that physical infra will always lag demand from here on?