Expanding Project Glasswing (anthropic.com)

73 points by surprisetalk 4 hours ago

ianm218 2 hours ago

In case the topic of memory safety is interesting to anyone I've been experimenting with using AI agents to port common web infra projects to safe/ performant Rust. Somewhat inspired by the Bun port - was thinking that at some point memory safety might be such a big deal that people just need drop in replacements.

- Valkey/ Redis port here https://github.com/ianm199/valdr (passes ~99% of single node test suite, real prod features like replication/ clustering/ HA early or not implemented) - Further along port of Lua 5.1-5.5 https://github.com/ianm199/lua-rs-port/tree/main - I have a less developed nginx version that would be the north star - These projects are very alpha at the moment

If anyone is interested in getting involved in this or has done similar experiments I'd love to collaborate! There is so much variation in how you can run these large scale agent fleets I don't think anyone has a perfect system yet.

mekpro 2 hours ago

It’s clear that Anthropic has run out of the compute capacity needed to serve Mythos publicly.

They’re using security concerns to mask their inability to deliver the model at scale, while still trying to maintain their lead over OpenAI. As a result, they’ve chosen to release it privately under the banner of an “ethical” rollout.

jb_briant 2 hours ago

It is not "clear", as your comment suggests, it's hidden. Which is semantically the opposite of clear. Regarding your theory, might be true, might be false. But it's highly speculative.

Forgeties79 a minute ago

All of us, including you, know that he is not saying "they are being transparent." When someone says "it's clear that..." in this way they're saying "It's clear to us what is really happening here.

simonw 2 hours ago

They started Glasswing before they struck that $1.25B/month deal with xAI/SpaceX for their (notoriously dirty) Memphis data centers.

So they have a whole lot more compute now than they did last month.

mekpro an hour ago

Yes, 300 MW from SpaceX helps a lot, but I think that’s mainly to support Opus demand, which has grown faster than expected. If Mythos is roughly 5× more expensive to serve than Opus, as the pricing suggests, then 300 MW is nowhere near enough to enable large-scale deployment of Mythos.

As an ordinary developer who relies on a $20–$200/month subscription, I feel disappointed by the release of a paper describing a model that I can’t actually use.

aspenmartin an hour ago

nickthegreek 2 hours ago

But that compute might not be available to then long term. Hard to make big moves with a contract like that.

simonw an hour ago

notahacker an hour ago

The security concerns argument would have worked better if a forum full of people hadn't promptly obtained access by the extremely sophisticated tactic of guessing its URL...

cobolcomesback 2 hours ago

So why is OpenAI also releasing 5.5-Cyber in a private manner? Are they also out of compute?

lossolo 2 hours ago

Probably. This is an 8-12 trillion-parameter model, which is why it costs so much, that is also a major reason, besides RL and synthetic data, why it suddenly gained these new capabilities. They claim it was not fine-tuned or trained specifically for cybersecurity, but is instead a general purpose model.

827a 3 hours ago

GPT-5.5-Cyber has already at least hit if not surpassed Mythos capability in cyber tasks. The only reason they're holding back is because once its out everyone would realize that its capabilities were a step change in March, but are not anymore, yet it costs significantly more and is much slower.

john_strinlai 3 hours ago

how did you go about assessing this?

jansan 3 hours ago

So you believe one marketing department more than the other?

NitpickLawyer 3 hours ago

The brits have a step-based benchmark that they use for this - https://www.aisi.gov.uk/blog/our-evaluation-of-openais-gpt-5...

They seem pretty close, in both average and "best run" scores. And, in a highly verifiable domain, "best run" or pass@n is what you're looking for.

aesthesia 2 hours ago

mentalgear 3 hours ago

Here's my big fear: Even IF (and that's a BIG if) we get all critical vulnerabilities fixed in tech (before adversarial/state-actors turn up with open attack models) - we still have (in at least a year) models that will be so good in social engineering that they can still (given enough tokens) gain access to whatever system they want.

If society can't trust banks and other institutions to safely control their data, what follows ?

Do we we collectivelly switch off the internet?

colechristensen 3 hours ago

Social engineering as a problem goes away when anybody can get a model to do it for them for $5. It stops being possible, it's really the bank's problem when they can't have a minimum wage call center or a robot responsible for people's data.

p-e-w 3 hours ago

Yes. There will be a few high-profile incidents, and then institutions will be forced to stop performing administrative actions based on people’s word.

applfanboysbgon 3 hours ago

lern_too_spel an hour ago

The government should be in charge of ID Provider infrastructure and has local offices (postal) that can establish physical identity (and already do for people who need to travel abroad), but the religiously affiliated NWO conspiracy theorists have made this politically infeasible in the US, so we have unsavory private sector providers like World ID stepping in.

aspectop 3 hours ago

i think anthropic is being performative here, creating a hype for mythos and not releasing. i guess this is all a marketing thing to sell a security specialized AI to enterprise and startups at a way larger cost coz security market is deep in money.

skybrian an hour ago

This is just cover for being sore that you don’t have access yet <- see what I did there?

People and organizations can have mixed motivations. It’s often not “just” one thing.

bushido 3 hours ago

This feels more and more like a marketing/scarcity play for the largest global corps.

Will likely give them time to expand capacity as well. And make them harder to dislodge in these orgs.

aspenmartin an hour ago

To me this makes little sense — I can’t imagine the orgs they have limited this rollout to don’t already have Claude subscriptions and integrations. And sure this may play nicely into branding a build a mystique around the model but ultimately they are missing out on a ton of revenue and risking being totally front-run now that model performance parameters are out and people have firsthand experience. Feels more like a fairly genuine attempt to be responsible. They could have easily rolled out an update and done some PR to absolve themselves of responsibility

jb_briant 2 hours ago

Urgency x scarcity, unbeatable marketing move.

bushido 2 hours ago

It is really good. Will also cut through the common procurement, legal and change management processes seen at these orgs.

jb_briant 2 hours ago

tantalor 3 hours ago

yanis_t 3 hours ago

Is there any evidence Mythos is qualitatively better than the Opus 4.x?

I'm afraid that the usual mantra that "we just need more scale" that worked well for attracting investments, is not working anymore - bigger models provide marginal improvements while naturally get much more expensive to run.

Is this why both Anthropic and OpenAI are rushing for IPOs this year?

alasano 2 hours ago

From what I've read so far it's less about Mythos being much better at tasks in isolation.

Security wise, it's about being able to find and chain multiple vulnerabilities to actually create viable exploits.

So I would imagine that if you were using it for regular software development you may not feel that it's that different unless used in a particular way?

iamniels 2 hours ago

Whats currently an open source project which comes closest to Mythos capabilities?

adrian_b 2 hours ago

No single open weights model comes close to either Mythos or GPT 5.5.

Nonetheless, running many of the open weights models over a codebase, with an appropriate harness, can provide about the same vulnerability coverage (i.e. each of the open weights models would find a subset of what Mythos or GPT 5.5 could find, but the subsets are not the same).

Despite needing more runs and more time, this may be significantly cheaper, especially if the models are self hosted.

Based on what Anthropic said about Mythos, they also use a quite elaborate harness for finding bugs and vulnerabilities, i.e. not a simple prompt like "find the bugs".

They run repeatedly Mythos on each file of the codebase, many times. They start with more generic prompts, used to determine whether a more thorough analysis of that file is worthwhile. Then they use more specific prompts, to detect various classes of bugs. After it becomes probable that a certain bug exists, they do a final run where the prompt requests a confirmation of the already known bug, perhaps together with a proposed patch or a PoC exploit.

Therefore the efficiency of finding vulnerabilities depends a lot on the harness, not only on the LLM. Also, searching vulnerabilities in a big codebase when paying per token is very expensive, because it requires many runs of the LLM.

aplthrowaway67 3 hours ago

How "altruistic" of them. If only Anthropic extended this level of care to the environment or the economy.

3sk_ask8 36 minutes ago

Anthropic has the marketing of a weight loss product.

- They still claim 10000 issues, but they found only one in curl.

- They did not find rsync issues but Claude rather introduced rsync issues.

- Facebook is a member of this cult program but Mythos did not find the account takeover flaw.

- Mythos did not find the issues in Anthropic's own Bun rewrite.

They will not release Mythos because it would be exposed as a fraud before the IPO.

andrewjneumann 2 hours ago

They keep writing like they stand to profit from this or something. Too many “coulds” in there for me too, this could be an amazing advancement and it could be nothing… normally we look at data and last headline I saw was 25 “high” vulnerabilities at the cost of $1 million in tokens.

No comparison to human teams, and I’m sure that $1 million in tokens was used by humans, in a team. So like most AI, they’ve developed a tool that capable people can use to be better, but unlike most tools, they’re claiming this to be outright magic. The magic is the hype train.

jb_briant 2 hours ago

Step 1: claim you created a tool so dangerous you can't release it

Step2: offer to test it, but only for the biggest companies in the world

Step 3: onboard those big players on your tooling and product

Step 4: profit

This is genius.

estearum 2 hours ago

And all you have to do is demonstrate unique value during the pilot phase!

Err... wait... that was already the hard part... hmm

jb_briant 2 hours ago

Genius marketing move doesn't mean there is no value.

It means than even if the value you offer is similar as your competitors, you are the one conquering the market.

That's the only way to not becoming a commodity.

skybrian an hour ago

It’s true that providing security services to so many organizations will likely put them in a position to earn lots of money. It makes them an essential service, sort of like what happened with Cloudflare and denial-of-service attacks. (There are competitors, but they’re the first company people think of.)

But I think that downplays the importance of having a good product. If the product didn’t work, this would be a good way to lose trust with a lot of organizations in a hurry.

sandeepkd 22 minutes ago

This is a circular economy that makes everyone look good. Almost all of these enterprise companies are sitting on top of so much of tech debt that in any realistic scenario they cant really patch vulnerabilities if they are even in double digits. A lot of these companies would not even let their valuable enough code to be ingested by LLM's.

At this phase no company would risk their brand by calling the product as ineffective. The big players are in it together and small ones have no option but to play along.

Nevertheless collecting the historical wisdom and running it at machine scale does have a lot of benefits for sure. The only question is the signal to noise ratio, machine is doing what humans did, just at a multiplier speed and with a lot more context than what a normal human can hold.

geodel 2 hours ago

With trillion dollars at stake they can hire best of best in sales and marketing. And unlike some hardcore hackers who may have ethics that does not always move in direction of more money. Sales and marketing people are highly motivated for opportunities to make more money.

jb_briant 2 hours ago

Our game is to craft shit, their game is to sell shit. You gotta respect the different tastes in the nature!

geodel 2 hours ago

cyanydeez an hour ago

<stop hiring people>

Don't you understand, if they really did do the <ai magic> they don't need to hire anyone, IT SELLS ITSELF

aspenmartin 2 hours ago

These companies are surely already onboarded…? They claim like 10k verified and high severity CVEs. Would you have preferred they just rolled it out like another opus update? You wouldn’t be insinuating in that situation that they were careless and reckless? They risk missing a boatload of revenue if openAI front runs them for a public launch. In what world is this some sort of scam??

jb_briant 2 hours ago

Where did I use the word scam?

Marketing move doesn't mean scam. It describe the ability to sell people over a narrative and surpassing your competitor in market share. And that's exactly what is happening.

My post is a "tribute" to the efficiency of Anthropic's communication. I never complained about anything, nor calling it a scam, nor saying they should have released mythos to the public instead of rolling it out to a selected cohort.

You tried to expand my words to make me say something I didn't, because my post wasn't giving you a clear conclusion of my opinion regarding their private release.

aspenmartin an hour ago

wslh 20 minutes ago

And put Chris Olah, Anthropic co-founder, sitting next to Pope Leo XIV presenting his first encyclical, Magnifica Humanitas, at the Vatican.

cyanydeez an hour ago

>can't release it

can't release it the plebs

fontain 3 hours ago

“Mythos Preview continues a long-term trend that we’ve been warning about for some time: within 6 to 12 months […]”

The only trend Mythos continues is Anthropic’s trend of warning that disaster is always 6 to 12 months away.

jofzar 3 hours ago

> The organizations in this new group are based in more than 15 countries

I mean most nasdaq tech companies would be in 13+ countries, why are they writing this like it's a big number, is hilariously small?

newtonsmethod 3 hours ago

I assume they're using a more candid definition where they're not counting all the countries a company may be based, but rather the primary country they're based in.

I don't think they're trying to flex this as a large number. They don't want to give an exact number, as that may change etc / is fuzzy, but also want to give you an idea of the scale.

They say "In the future, we intend to expand our geographical reach much further". I imagine this commentary is somewhat related to the concerns that AI will create an even worse "global underclass". AI developments are first accessible to Americans, then allies, and then later the whole world.

SpicyLemonZest 2 hours ago

They're writing it in contrast to the previous scope, which doesn't seem to have been available to any organizations based outside the US. (There was news a few weeks ago about how Japanese banks were going to gain access, but based on the timing I think this announcement is that access.)

cmxch 3 hours ago

That’s fine as long as I can identify and reject any Mythos derived patch as being irreproducible.

astrange an hour ago

How can a patch be "reproducible"? The testcases are reproducible.

IanCal 3 hours ago

Why would it not be reproducible?

cyanydeez an hour ago

Expanding Project Glasswing (IPO)

philipwhiuk 3 hours ago

It would have been nice to have a list of the 150, but I guess it would make them a hacking target?

mrbonner 2 hours ago

Maybe it is just me: I feel Anthropic most recent product announcements resemble more and more like what IBM tactic was at its high. For instance, the Watson AI hype after it defeated Kasparov. The difference is IBM actually wanted and let businesses buy and use Watson as opposed to time released like what Anthropic does to even boost the hype higher.

3sk_ask8 33 minutes ago

Big Blue defeated Kasparov. The Watson hype was about winning Jeopardy, which is still kind of the only use case for current AI.