Kimi K3-256k (kimi.com)

165 points by monneyboi an hour ago

illithid0 39 minutes ago

This was posted 38 minutes ago, and as of 20 minutes ago, several Anthropic services are now designated as having a "major outage".

Doubt these are related, but it made me laugh a little.

paxys 12 minutes ago

Anthropic services have outages on all days ending in y.

periodjet 4 minutes ago

Why are Anthropic and OpenAI even allowing their coding harness apps to be plugged into different model providers…? I’m surprised they haven’t figured out a way to clamp down on that by now.

wren6991 a minute ago

I'd guess because it costs them nothing and it gives you a smoother transition back towards paying for their products.

madihaa an hour ago

That's actually nice! I usually try to stay below 200k context anyway.

giancarlostoro an hour ago

For me the sweet spot is somewhere under 500k depending on how extensive I want to get. You can build up a sizable effort project in half a million tokens with Claude, with Claude having all the context from ground 0 to wherever you're off at.

cyanydeez an hour ago

I'm always curious what you guys are working on; every git repo I've run a local model on and stick below <100k to increase speed seems effective enough to scope patches and changes.

KronisLV 35 minutes ago

giancarlostoro 18 minutes ago

sheeshkebab 17 minutes ago

jdoe1337halo 37 minutes ago

hawtads an hour ago

This is just an API level change right? The model itself should be the same I think.

dgritsko an hour ago

This isn't quantized, right? Just a smaller context?

DSingularity 42 minutes ago

Its 256k context window. Quantization is orthogonal. We cant really tell directly so it could be quantized.

wxw an hour ago

> k3-256k is now available. Within 256k context, it delivers the same results. k3 (1M) consumes about twice as much quota as k3-256k.

lukan 39 minutes ago

Since Claude is the first time for me really, really out (TIL against my wished about https://status.claude.com/), I am now interested enough to see what else works. But ... when I click pricing, I see "Join a waitlist". Wtf? Are they really that good, so were totally surprised and overwhelmed by the requests, is this a marketing stunt, or do they just don't have the hardware being in china?

KronisLV 28 minutes ago

> Are they really that good,

They did exceed the expecations of pretty much everyone! I've also blogged about using the model, it's a bit on the slow side but pretty good!

> so were totally surprised and overwhelmed by the requests ... or do they just don't have the hardware being in china?

Yes, this is mostly the case: https://x.com/Kimi_Moonshot/status/2078855608565207130

As a user, I much prefer that to service disruptions or severely degraded or secretly quantized performance. However if I didn't have an account, I'd be pretty pissed off about not being able to give them money and become a user.

lukan 4 minutes ago

"I'd be pretty pissed off about not being able to give them money and become a user."

I am now rather pretty pissed towards antrophic for stopping my flow and forcing me to search for alternatives.

MYEUHD 33 minutes ago

Since the model is open-weights, you can get from other providers, for example see https://openrouter.ai/moonshotai/kimi-k3#providers

Alifatisk 23 minutes ago

The only downside with third party providers is that you have to trust that the provider have setup and configured it correctly, and is not secretly quantizing it.

See Kimi Vendor Verifier.

Alifatisk 25 minutes ago

No, the waiting list is true.

Kimi had become that popular. I was a subscriber of Kimi back when latest version was Kimi K2. Later I unsubscribed because I jumped over to GLM subscription (they had amazing deal). Now when I wanted to try out Kimi K3 to find out what the fuzz was all about, I couldn’t subscribe to them.

I remember reading a post from Moonshot team about this, they are doing this because they are almost at peak capacity and want to reserve it to keep the quality for their current customers.

We are actually witnessing an open-weight model catching up at catching mainstream users attention. And instead of behaving like Anthropic, they actually care about their users experience.

InsideOutSanta 25 minutes ago

It's an extremely popular model hosted by a company affected by hardware export bans. I doubt they'd voluntarily prevent people from subscribing if they didn't absolutely have to to maintain service quality.

hendersoon 15 minutes ago

What is the purpose of this? Just a hard cutoff below the actual context window? You could set that in your harness anyway.

dnlzro 11 minutes ago

Uses less quota (i.e., cheaper). For people who like to keep their contexts small, this is a no-brainer.

surgical_fire 12 minutes ago

> k3 (1M) consumes about twice as much quota as k3-256k

Cheaper?

chrisweekly 3 minutes ago

k3-256 consumes half the quota, so... yes?

holoduke 10 minutes ago

A bit of topic. But how likely is it that the US will restrict Chinese open weight models and also force Euro countries to do the same? I think it will be effective within 6 months. The US is having a hard time staying competitive.

jeppebemad 7 minutes ago

I don’t know, but I do think that the days of the US “forcing” Euro countries to do anything, is over.

realusername 4 minutes ago

Trump burned a lot of bridges in the EU, that one will be a hard sell

sergiotapia 25 minutes ago

I can't seem to find pricing for this model. Since the context size is just a quarter of the full size K3, is the price also much cheaper?

I usually keep my context in chats below 256k anyways so this would be tremendous honestly.

daemonologist 21 minutes ago

It seems to only be available in Kimi Code, via subscription, no there's no API pricing. The linked page says it consumes about half as much quota as the 1M version though.

ibuildproducts an hour ago

omg! new model!!

Alifatisk 21 minutes ago

Same model, new configuration

superloika an hour ago

The bells tolled today, but nobody came to church.