Apple introduces M6 and M5 Ultra (apple.com)

1027 points by interpol_p 16 hours ago

alluro2 9 hours ago

I was blown away by M1 Pro, and used it for 4 years before it became a little sluggish, and replacing it with an Asus S16 running on Ryzen AI 9 HX 370 (an excellent laptop). One of the main reasons was missing my old Linux setup.

I've briefly tested M5 Pro in an Apple store and was surprised by how quick it felt and did anything. A tangible and significant difference, and I really feel it would be good getting it, or M6.

However - before, MacOS was a big factor driving me towards Apple - now, it would be hard for me to give up my Linux setup and all the stuff I love about it, even for such performance...Linux progressed really nicely, while MacOS deteriorated at the same rate, and it's changing the balance and the decision for me.

greenowl 8 hours ago

Still rocking an M1 Air - 2020 build. 8GB ram. No slowdown or deterioration at all. Battery health reports the battery max capacity at 84%. Best computer I've ever owned, by far.

plasticeagle 8 hours ago

M1 Pro 2021 16GB RAM

Feels as snappy and impressive as the first day I got it. I never need to close apps, or reboot. I record multitrack audio on it without any perceptible latency. I write code on it. It's the best computer I've ever owned by a significant margin.

ilamont 3 hours ago

crossroadsguy 2 hours ago

echelon an hour ago

Forgeties79 4 hours ago

anakaine 7 hours ago

Also M1 Air 8gb, though not the daily driver. Bought second hand, the machine is still an absolute champ with no slowdown and is my go to machine when I want a calm space for writing.

Ned_Williams 3 hours ago

holiveros 6 hours ago

Same here, my M1 Max 64GB beats the s*t out of my work-provided M5 16GB :P

Best computer I've had in a long time.

genghisjahn an hour ago

xp84 6 hours ago

I splurged for the 16GB version of this. Originally bought it for my spouse, and then replaced it with a refurbed M2 with 1TB of storage for reasons. So I took the "old" M1 Air. So far, can't come up with a reason to want to replace it. Not updating to Tahoe helps with that too.

harry8 4 hours ago

sriku an hour ago

Same here. For tough compute, I spin up a machine in some cloud service, do what I need, and shut it down. Of course, its a different issue if you need power on the desktop right there, like for A/V/Graphics work.

stmw an hour ago

Which MacOS version are you on, out of curiosity? Do others see the same software issues?

gyomu 8 hours ago

Same. It was borderline unusable on Tahoe to the point I had to downgrade it, but the Golden Gate beta brought it back to life.

I’m only using it as a travel machine now, trying to hold on from upgrading it until I can get an Air with OLED display - hopefully coming in <24 months…

jtbayly 6 hours ago

InexSquirrel 7 hours ago

Same here. Still using the original M1 as a daily dev pc. The portability and battery life are great. Biggest gripe is the limited number of USB-C ports...

emp_ 7 hours ago

Great to hear! The absolute best Air Form Factor, I've debated a lot buying a used one because I dislike the square form of M2+ Air compared.

sgarland 4 hours ago

dave_sid 8 hours ago

Same here. Got the same machine and feel the same as you about it.

thisisnotclear 4 hours ago

M1 air 2020 16gb ram - still working like its new

waldothedog 6 hours ago

Same, but MBP. Incredible machine, still has a lot of miles left

thiht 8 hours ago

Same here, the thing is a beast

testing22321 6 hours ago

I bought a used M1 air with 16GB and 2TB a few years ago for $1000 CAD. It’s easily the fastest computer I’ve ever used, and I have no reason to upgrade. It chews through 4K footage and ten of thousands of RAW images off my cameras.

abrookewood 2 hours ago

The M1 was genuinely a big step forward, but what has followed, not so much. I have an M5 Pro with 48GB of RAM and it is genuinely good ... but that's about it.

I love the battery life, appreciate the hardware, but find the OS to be annoying. Less annoying than Windows for sure, but I'd rather be running Linux.

socalgal2 5 hours ago

> I've briefly tested M5 Pro in an Apple store and was surprised by how quick it felt and did anything. A tangible and significant difference, and I really feel it would be good getting it, or M6.

How did you measure this? I have an M1 Pro and short of actually measuring with tools I can't imagine you can tell the diffrence between an M1 Pro and an M5 Pro in the Apple Store

mathisfun123 2 hours ago

bro people don't measure things - it's all vibes these days (in all fairness OP specifically used the word "felt"). if they measured anything they'd have realized M5 GPU is ~V100 lolol.

HaloZero 8 hours ago

I'm really curious about this deterioration? I use a M1 Macbook Pro with 16GB RAM as my primary machine and it still runs fine. I do iOS development so it's not exactly fast but I wouldn't call it slow by any word.

My Poor M1 Mini though is struggling though but that's b/c I'm running it as home server and 8 GB RAM is not enough anymore.

xp84 6 hours ago

Curious about the choice of the Mac as a home server. I feel like an off-lease x86 usff pc, at roughly half the cost, would be more useful as a server. Pre-RAM-crisis you could get one with 32GB of RAM for like $240. My main home server is one of those HP ProDesk, running Debian.

ryukoposting an hour ago

Different people are sensitive to different things. I still find my 6th gen ULV i5 and 8GB of RAM tolerable.

Twirrim 7 hours ago

I'm always a little cautious about "tried it in the store" experience. If I nuke and rebuild my machine (either Linux, or Windows), it's always significantly faster than it was before. Over time stuff just tends to accumulate that you don't notice. Like the old days of needing to defrag hard disks.

snazz 4 hours ago

I agree with you that this is a noticeable effect, but I have a hard time figuring out why it is, especially on Macs with the sealed system volume (which should make the operating system files bit-for-bit identical between a freshly set up Mac and one you've been using for years). Certainly it could come from the accumulation of cruft in /Library and ~/Library, but you can clean that up too.

alasdair_ 2 hours ago

alluro2 5 hours ago

Yeah, same - I tried the M5 Pro randomly while waiting for my daughter to finish salivating over a Neo, and just got surprised by how quickly it opened apps and reacted to anything I did - ~1-1.5 seconds for Affinity Designer was amazing.

My MBP probably got affected by OS updates like other people are saying - opening apps and responsiveness definitely got worse, and felt like slightly deteriorating over time (but it might have been MacOS updates along the way).

foxyv 8 hours ago

I have never owned an Apple product that didn't slowly get worse over time. After a couple iPads and MacBooks, I'm almost certain they are intentionally updating their operating system to slow down older products. Even worse is the removal of access to certain applications for older hardware in the name of security or compatibility.

Meanwhile my Linux laptop continues to get faster every year as the operating system improves with performance updates and bugfixes.

alluro2 5 hours ago

Absolutely agree - happened on MBP, 2 generations of iPads, and Watch...For iPads and Watch, I thought that it might just be the famous battery health vs performance tradeoff they enforce on us, but I rarely ever used the MBP on battery, it was plugged in 95% of the time.

slowin 6 hours ago

The only Apple products that I can think of that haven't degraded in quality over time are the iPods and maybe the Apple Watch.

xp84 6 hours ago

caycep 6 hours ago

This may be true (not perceptible w/ my apple silicon Macs), but the important thing is that they get slower more slowly than my wintel gets slower (I blame disgruntled Windows and/or nvidia drivers devs....)

DonHopkins 4 hours ago

My Apple ][+ improved with age as I added things like 48K of RAM, a floppy disk, a language card, etc...

senderista 7 hours ago

iOS 26 made my iPhone SE pretty much unusable.

littlecranky67 7 hours ago

dcow 9 hours ago

Can you characterize the deterioration more specifically? I only ask because every time I run this exercise for myself I end up back on macOS, despite any hiccups.

alsetmusic 8 hours ago

Not OP, but a decades-long Mac user. Removing CLI tools over the years would be one way, though I run Homebrew and have everything I want or need. That doesn't change that scripting is less useful on a fleet of devices.

Also, the UI has been in decline for a decade or so, with the regrettable decisions under Alan Dye. Thankfully, Zuck poached him and we're all grateful for that. I mean, what they've done to our icons is tragic, the glyphs in the menus was intern-level boneheaded, and reduction of contrast to "get out of the way" of our content has made everything less usable, especially for people with vision issues.

A bug that I filed about window-ordering when using the Cmd-` / Shift-Cmd-` shortcuts has been live since 2010 without getting fixed, though an industrious HN user posted a link to the background utility they made to fix it themselves[0].

0: https://github.com/tacomanator/sash

mymacbook 7 hours ago

unloader6118 2 hours ago

delish 7 hours ago

An example of deterioration:

Jeff Goldblum's 30 second "Presenting three easy steps to the internet" https://www.youtube.com/watch?v=rjY0xsoozs8

And now when you want to set up a fresh Mac it's a parade of dialogue boxes:

Do you want to turn on Siri? No. (the dialogue-choice is probably "maybe later" ugh)

Do you want to share app analytics with developers? Yes.

Do you want to add Touch ID? No, because I'm setting this up for someone else.

There are more!

I gave those examples -- each of which having a different answer or reason -- to show that the problem of onboarding is nontrivial, but Apple has spent no(?) effort toward fixing it. It's the same for new iPhones and iPads.

NB I don't know if you sign into your Apple account it pre-answers these questions. That'd be nice.

gcanyon 2 hours ago

xp84 6 hours ago

binkHN 3 hours ago

FireBeyond an hour ago

abroszka33 9 hours ago

Not OP, but I have been using an M1 pro Mac Book since release. It's not sluggish in any way whatsoever.

novafunc 7 hours ago

peddling-brink 8 hours ago

omgwtfbyobbq 8 hours ago

dajonker 8 hours ago

nifty_beaks 8 hours ago

whalesalad 8 hours ago

If you have not tried it this is an absolute game changer for Mac users moving to Linux. https://github.com/RedBearAK/toshy

I've been running it for 3 years now. I am so macpilled that I had to install it on my new Framework 13 pro.

The Mac muscle memory was always my biggest hurdle with Linux. I always felt handicapped by it. But Toshy eliminates that.

xp84 6 hours ago

nightski 7 hours ago

ColdStream 5 hours ago

There is a youtube channel 'Dank Pods', he was going on about his Framework laptop and was talking about how modern OS's have this ark to their usability.

He was arguing that Windows is well past its best years and that OSX is now starting on the downward slope and that is why he was moving to Linux. It was a interesting take on the whole thing about the life times of OS quality.

But with a new CEO for Apple, they have an opportunity to turn things around and blame it all on Tim Cook, but only time will tell if they do that.

hedora 5 hours ago

Linux has been going down hill, but since you can choose distributions, there is an escape hatch.

I’ve been moving all my machines to devuan with xfce (or freebsd with xfce).

I have zero issues despite not having to deal with wayland, systemd, snap, etc.

pkulak 5 hours ago

ColdStream 3 hours ago

brodock 2 hours ago

bigyabai 5 hours ago

rowanG077 2 hours ago

acroback 9 hours ago

My 16" M1 Pro MacBook with 32 Gigs of RAM is still going strong. Not going to upgrade till this thing dies.

I can ride this puppy for the next 10 years. Say what you will about Apple but their hardware is top notch and it is a great value if you can snag some OG hardware in M series.

w0m 9 hours ago

I ran my ~2011 i7 MBA for 12 years as primary laptop before the battery finally killed it (had to run linux on it due to apple killing support the last few years).

Great hardware. I don't miss OSX though.

fnord77 9 hours ago

my 16" m1 max w/ 64gb is getting a little sluggish on some things

kwanbix 9 hours ago

Yeah, if I could install Linux without any hacks I will get one.

Even if I prefer the body of a X1 Carbon ThinkPad, its keyboard and trackpoint.

gregors 5 hours ago

Agreed. I loved Macs, but I need it to run Linux.

bluecalm 7 hours ago

I am in the same boat. I would buy a Mac if I could run Linux on it. As it is I will pay more for X1 Carbon with a worse CPU just to run free OS on it.

stasomatic 7 hours ago

prmph 9 hours ago

Yep, vote with your wallets. It’s about time Apple learned that excellent hardware alone would not make up for what macOS lacks and where it fails for development.

thiht 8 hours ago

macOS is fine, you guys are just overreacting… Is it perfect? No. Is it usable? Clearly yes.

switchbak 7 hours ago

cortesoft 9 hours ago

What would you want Apple to do to improve the developer experience?

prmph 8 hours ago

spudlyo 3 hours ago

NamlchakKhandro 6 hours ago

danielktdoranie 9 hours ago

“macOS lacks” LMAO

jasoneckert 2 hours ago

I'm still using an M1 Ultra Mac Studio with 128GB RAM running Fedora Asahi Remix. It's far more power than I need for a very long time, which is one of the reasons I love the Apple Silicon platform so much.

binkHN 3 hours ago

> Linux progressed really nicely, while MacOS deteriorated at the same rate, and it's changing the balance and the decision for me.

Same, but it's Windows that's been deteriorating fast for me. Linux has it's warts, but it's FAR better than the current commercial offerings.

websap 8 hours ago

Mac OS has been hands down one of the best OS that I’ve used in a long long time. What problems are you running into?

alluro2 5 hours ago

To be clear, I'm definitely not saying that MacOS is now bad - it's absolutely still a pretty good OS. But, personally, I do have a couple of gripes, and my feeling is that things are changing in the opposite direction from what I would like. Compared to Linux let's say a couple of years ago - yeah, better. Compared to Windows - there's no comparison.

But, still:

- it slows down after a while

- design direction is questionable and controversial - that it got more inconsistent is factual - also, so much wasted space and everything got bigger and a little dumber

- so little control over system behavior, functionality, looks

On modern Linux, you get a more polished (wow, unbelievable thing to say - I first dabbled with Linux in 1997), robust, and infinitely more functional and customizable experience. After a while, I started feeling at home - like it's "mine" - and how distinctively MacOS feels like being a guest there, and that it was never "my environment".

I definitely realize how vague and unquantifiable most of this sounds - and how little value those things have for a lot of people - but I've come to enjoy my setup, I spend ~12h / day in it, and I discovered that how it "feels" matters to me.

acomjean 8 hours ago

stuff that annoyed me on mac was the "find" feature was useful, but to get to a enclosing folder (what I want), involved searching, clicking something, finding the file again in the display and "enclosing folder" (this might not be exact, I don't have a computer in front of me).

Sharing files with a windows hard drive. My workmate had a seagate that installed an NTFS driver on mac, which saved us a few times. Never had a problem on linux.

Python never seems to work right. Conda, and other stuff, just never worked smoothly with the bioinformatics code we were running. Cluster machines it was easy.

There is a wierd issue that you can't close a macbook and use it with an external monitor without plugging it in. It just sleeps.

Would you like to join iCloud. No really would you like to join iCloud. How about apple music? (To be fair MS is just as bad if not worse about onedrive...)

We had a pythonTK program to print labels from a CSV file. Every MacOS update broke it. We ended up just running it on a windows machine. back up was going command line on mac.

case insensitive file systems.

generally stability..

Its not bad, just seems the OS has gotten worse.

slowin 6 hours ago

I would say the artist formerly known as OS X has never been good. It literally started its life as a half-assed NeXT attempt and has only gone downhill from there. There's still a "Services" entry in the file menu. .DS_Store files are an abomination. Mac OS thinks it knows better than I do about which software I'd like to install. Plist insanity that makes the Windows registry look pristine. GUI inconsistencies across every surface area... I'm curious what you like about it, because other than font rendering (which it does well), I can't think of anything positive.

icedchai 6 hours ago

soulofmischief 8 hours ago

I wouldn't even know where to begin, because the slide in quality has permeated every aspect of the operating system, from stability to design. Numerous networking bugs, SSH agent bugs, sleep state bugs, sometimes having to restart my machine because the network screws up so badly, Bluetooth issues that they keep introducing and then not fixing; I have peripherals that just no longer work due to this. I could go on and on. I could talk about the mobilization of a desktop interface (same mistake the Unity and GNOME teams made)

And I don't feel like beating a very dead horse, so just google "macOS Tahoe design issues" and take your pick.

zer0zzz 7 hours ago

amelius 9 hours ago

Apple should just switch to making servers instead.

fooster 9 hours ago

Ok, what am I using on my workstations then? Windows? Hell no. Terrible hardware, OS sucks. Linux? Hell no! Terrible hardware, desktop is terrible.

alphabeta3r56 9 hours ago

shit_game 8 hours ago

robertwt7 4 hours ago

i'm still rocking m1 pro with 16gb ram. for all my eng stuff its still snappy for me. that includes some iOS dev from time to time, lightroom classic, much better than my pc with ryzen 9 5900x + rtx 3080 somehow! i haven't even think about upgrading my mac

meerita 7 hours ago

I'm still on my M1 Pro. I bought one M5 for one of my employees and after 5 minutes playing around I am thinking in getting a new one.

mrcwinn an hour ago

I’m on an 14” M5 Pro MacBook Pro with nano texture display. It’s the best computer I have ever owned. Not close.

aymeric 7 hours ago

What Linux distribution do you use?

alluro2 6 hours ago

CachyOS with KDE...it's been amazingly fast, dependable, stable, customizable, polished (yes, really)...

boredtofears 9 hours ago

Weird, I'm still using my M1 Pro and it feels just as fast as it always has. MacOS feels almost identical to me as it did 5 years ago, too, except the ugly icon change.

als0 9 hours ago

Tahoe slows it down, but Seqouia is still strong.

ardit33 8 hours ago

same... mine works great...

st3fan 6 hours ago

the top comment .. "i prefer linux"

ycombinatrix 9 hours ago

How did it become sluggish?

alluro2 5 hours ago

Desktop is taking a bit to render after a reboot (which I need to do very rarely, admittedly), apps definitely got slower to open, a small delay in actions here and there - it started feeling a bit sluggish compared to before and it felt like it's deteriorating over time - but slightly.

I think it's very likely due to OS updates, like other people are commenting on. It probably doesn't happen to everyone, and maybe doing a clean reinstall helps (I tried all the standard stuff - rebuild caches etc).

holoduke 8 hours ago

What cant you do what you can do with Linux? Nowadays my main apps are terminal apps mostly running Claude. Honestly don't really care whether it's macOS or Linux or maybe even windows. I do care about local speed. Occasionally try out local models.

doc_ick 5 hours ago

I can’t download ms teams on Linux (the browser version sucks).

ardit33 9 hours ago

I still use my M1 Pro Macbook... for iOS development. It still works amazing well, and the battery still is holding strong. For large apps, compiling can be a tad slow, but for medium and small apps it still works amazingly well.

Eventually I will upgrade, but for me the M1 Pro Macbook (14") has to be the best computer of the last two decades.

Before that, I had the butterfly Intel version, and that was a disaster. Apple just cooked with the M1+ line...

zer0zzz 7 hours ago

Why buy all that for Linux when there’s asahi for the m1?

porjo 5 hours ago

Not OP. I'm a huge fan of Asahi and use it on my M2 MBP. There are some significant downsides in particular battery life is nowhere near what you'll get from MacOS due to inability to go into low power sleep state, and buggy DP alt mode for external monitors. I hope that will change but it's not there yet.

Jnr 7 hours ago

Because it still doesn't fully support all of the hardware on M1. I know it because I used Asahi while I had M1. Now I have M4 for work and it doesn't support Asahi at all.

I just use Linux PC as much as possible instead. And that 4$ M4 is just a fancy presentation computer I use when I travel.

Personally I would spend thousands on an actually great Linux laptop, but there are still none around.

sharts 5 hours ago

Just run a linux vm

tiahura 8 hours ago

40+ years of guis and I'd rate MacOS usability around early 90s Openwindows. Something about being wedded to Fitts's law and 1985 design docs.

Everyday I check on Fedora M4 progress.

unloader6118 2 hours ago

Everytime I look at fedora, I think "are those GNOME guys retarded?" Linux would be much better if fedora never exist

jbverschoor 8 hours ago

Try omarchy

bayindirh 15 hours ago

I know, this is a bit of a meaningless comment, but it's funny in a way. Feels like late 90s again:

    - Xiaomi: We have matched Apple in CPU performance.
    - Apple: *Meep Meep...*

derwiki 15 hours ago

Reading Infinite Games, they tell an anecdote about a Microsoft exec on a flight telling an Apple exec that the Zune was a way better portable music player than the iPod. The Apple exec was just “yup, you’re probably right” and then soon after the iPhone dropped

VCFundedGenYer 12 hours ago

To be fair, the Zune actually was a better media player than the ipod in almost every way. That wasn't a false statement.

The issue was the abysmal marketing and "me too" attitude Microsoft had (and still has).

saturn8601 11 hours ago

blauditore 10 hours ago

tambourine_man 10 hours ago

staticman2 10 hours ago

gffrd 12 hours ago

godwinson__4-8 10 hours ago

koliber 9 hours ago

tcmart14 11 hours ago

insane_dreamer 12 hours ago

wat10000 12 hours ago

whatsThisBtn4 9 hours ago

throwaway894345 10 hours ago

spacedcowboy 9 hours ago

12_throw_away 9 hours ago

riazrizvi 11 hours ago

shuwix 12 hours ago

Actually, Microsoft came with "modern" smart phone much sooner. Actually too soon, technology wasn't there (price, computing power, size, weight, battery life).

Apple never came first ... but often just at the right moment and had marketing skills to make it a new trend.

nodamage 10 hours ago

skrebbel 12 hours ago

__alexs 12 hours ago

0x457 11 hours ago

NoMoreNicksLeft 12 hours ago

bingo-bongo 12 hours ago

Simon Sinek - Apple vs Microsoft: https://m.youtube.com/watch?v=jEOftmUJ6a4

But it had nothing to do with the iPod/iPhone release in his story.

(story starts ~1:15, but I highly recommend the entire talk)

mikestew 14 hours ago

Might want to edit, as this would make sense/be amusing if the exec in the last sentence was Apple.

That, or I can’t read.

derwiki 14 hours ago

nxobject 13 hours ago

Hell hath no fury like Apple Global Security scorned...

troupo 14 hours ago

Zune was probably a better player. It was too late, and arrived when MS didn't much care.

There are emails unearthed in various lawsuits where you can read Bill Gates screaming at his subordinates: "why the hell can't our partners like Sony and Creative create a similar device? Give them all, give them early access to everything, work with them". In the end MS felt compelled to make their own.

bayindirh 14 hours ago

cosmic_cheese 12 hours ago

unsupp0rted 12 hours ago

mark_l_watson 12 hours ago

I loved the book The Infinite Game. Really changed how I looked at work, personal research, and being an author. Recommended!

kccqzy 10 hours ago

That just sounds like a standard introvert response when one doesn’t want to walk.

adventured 10 hours ago

The anecdote is likely a false rip of the actual story:

[2017] Speaking at an event Tuesday, Scott Forstall, who lead Apple's iOS software division under Jobs, recounted the surprising history behind the company's first touchscreen prototype, which ultimately lead to the first iPhone.

It all began, Forstall said, because Jobs had an acquaintance at Microsoft who he really, really, didn't like.

"It began because Steve hated this guy at Microsoft," Forstall said during the event. "Any time Steve had any interaction with the guy, he'd come back pissed off."

The unnamed Microsoft exec, who was apparently the husband of a friend of Jobs' wife, apparently bragged so much it pushed Jobs over the edge.

"He just shoved it in Steve's face -- the way they were going to rule the world with their new tablets with their pens. He came in on Monday with a set of expletives and then was like 'let's show them how it's really done.' "

https://mashable.com/article/scott-forstall-steve-jobs-micro...

meowface 9 hours ago

yard2010 12 hours ago

I just want to take a minute and be grateful for getting the chance to live through the 90s again. I always felt a bit sorry for myself being a child through the og 90s. Now I feel like in a decade or so into the future I will look back and be happy I got to live in the naïve days of windows 95 again, as an adult this time. I really appreciate it.

forinti 15 hours ago

Cheap RAM in 500 yards. ->

RankingMember 14 hours ago

[apparent tunnel to cheap RAM painted on rock face]

bayindirh 14 hours ago

pavlov 14 hours ago

In the ‘90s it was the opposite.

- Apple: We have matched Intel in CPU performance thanks to this new PowerPC! (Shows ad that uses carefully handpicked benchmarks to suggest that the PowerPC is actually faster when it really isn’t on average)

- Intel: Oh, we just found a 30% clock rate increase in the pocket of our other fab pants.

- AMD: Hold my beer, I have the DEC Alpha guys making an x86 CPU… How about 64-bit while at it.

bayindirh 13 hours ago

I said late 90s though. The insanity which poured through early 2000s.

5.25GHz Pentium 4s, intentionally lower binned Athlons, the era your CPU got obsoleted the moment you booted it for the first time.

I don't remember early 90s much. I was too young back then. I don't remember much stuff from that era. But late 90s, early 2000s.

Oh, boy.

P.S.: AMD64 was a great sucker punch though. One of the professors in our university rejected to believe and got mad when he learnt that Intel licensed AMD64 from AMD, heh.

nxobject an hour ago

0x457 11 hours ago

I had a G4 MacBook when I switched to the first-gen Intel MacBooks, and subjectively, the G4 performed much, much better. Probably because the best pairing for any Intel CPU is thermal throttling.

pavlov 10 hours ago

crest 10 hours ago

bryanlarsen 14 hours ago

It's been really weird reading laptop reviews over the last few months. I've seen a bunch of reviews where they have their usual bar graphs comparing a bunch of laptops, and the laptop that is at the bottom is an Apple. It's the really inexpensive Neo, of course, but even the M5 laptops are consistently beat on performance and battery life by Intel Windows laptops.

I assume the M6 will take the crown back and then a few months later Intel/AMD will release a new chip and take that crown back again. That's the state of the world we used to expect, but it's a state that has been missing ever since the release of the M1 in 2020 until Intel finally caught up again this year.

dbspin 14 hours ago

> even the M5 laptops are consistently beat on performance and battery life by Intel Windows laptops.

When plugged in... This caveat is so enormous it should almost be legislated. If your computer use is at all portable, a computer that scales down to 20 - 40% of GPU power when unplugged is an enormously significant factor. So far as I'm aware (could be wrong about arm devices?) there's no non-apple laptop that operates at 100% speed on the road.

doomroot13 14 hours ago

bryanlarsen 14 hours ago

adgjlsfhk1 14 hours ago

f6v 13 hours ago

> but even the M5 laptops are consistently beat on performance and battery life by Intel Windows laptops

The real question is whether all these Intel Windows laptops spin their fans at full speed when doing absolutely nothing. That’s something I can never go back to. I do some light gaming on my M2 Pro MBP and it gets hot when trying to push 120 fps. But my Lenovo Legion (that’s now collecting the dust) is so loud I could hear it through headphones.

ripharamberip 10 hours ago

Topfi 13 hours ago

> [...] but even the M5 laptops are consistently beat on performance and battery life by Intel Windows laptops.

Hold up, in what metric/benchmark? Feel personally like we life in an age where, no matter the SOC vendor, something high performant and efficient is offered, so seeing a claim that any vendor, be it Intel, AMD, Qualcomm or Apple, is consistently outperforming another, I'd like to get more context on that.

achenet 12 hours ago

Aurornis 12 hours ago

> It's the really inexpensive Neo, of course, but even the M5 laptops are consistently beat on performance and battery life by Intel Windows laptops.

Of course you can beat the entry level MacBook Neo by comparing it to larger, more powerful, more expensive laptops.

The M5 is an entire family with a range of performance. Intel/AMD have done a lot to improve performance but they’re not beating the high end M5 chips on performance or battery life yet.

bryanlarsen 12 hours ago

bayindirh 14 hours ago

x86 is way more complex when compared to ARM processors, as a result their TDP is way higher when you request performance from them.

Intel had to reduce the frequency of their processors when running AVX2 instructions and the AVX2 frequency of the processors were non-disclosable to anyone.

Also, benchmarking Intel processors and publishing these numbers were forbidden in some cases. I don't know whether this ban is still in effect.

x86 processors can't keep up with the ARM processors TDP and thermal profile wise. So they slow down a ton when running on battery. See Jeff Geerling's last video on Apple Neo vs. some Intel laptop. It's as "efficient", but slow as a newborn tortoise learning to walk when unplugged and trying to get the most endurance out of the battery.

My M1 Mac gets almost 2 days of low-intensity use after ~6 years of use, and it got warm once or twice because something ran away in the background for tens of minutes.

Topfi 14 hours ago

qwertytyyuu 15 hours ago

Echos of the ai race as well haha

VCFundedGenYer 12 hours ago

Seems most computer companies are still boasting that they can beat the M1 and it's like...congrats on beating a 6 year old chipset?

Grombobulous 10 hours ago

I don't think this is the case.

Intel Panther lake beats the M5 in GPU and multi-core performance, and is only behind in single core (and not by much). Panther Lake is also on some Windows laptops that trounce MacBook battery life (e.g., Framework 13 Pro according to Just Josh Tech medium-brightness productivity benchmarking).

The Snapdragon X2 Elite beats the M5 multi-core performance (the HP Omnibook Ultra 14 is priced identically spec-for-spec with the MacBook Pro with M5). Still behind in single core and probably graphics, but squarely in the same realm.

Both of these chips are within small deviations of the M5. We could call Intel and Qualcomm 1 year behind at best.

bob1029 12 hours ago

I still have zero urgency in upgrading from my M1 MBP.

whatsThisBtn4 9 hours ago

rconti 11 hours ago

ant6n 12 hours ago

PUSH_AX 14 hours ago

Apple is like the Billy Mitchell of computing. Just waited for them to beat it before announcing the gains they were sitting on.

inigyou 14 hours ago

Does this imply they faked all their benchmarks?

aksss 10 hours ago

Funny, wasn't getting the reference. https://en.wikipedia.org/wiki/Billy_Mitchell vs. https://en.wikipedia.org/wiki/Billy_Mitchell_(gamer)

THE (Col.) Billy Mitchell was actually a badass. His time in Alaska alone, running telegraph lines in the wilderness, made him a legend even before his forward thinking during WWI and beyond.

reaperducer 11 hours ago

Xiaomi: We have matched Apple in CPU performance.

Apple: Meep Meep...

This seems to happen repeatedly.

Apple: Look at this cool new chip!

Others: Look how we very slightly passed Apple (six months later, with worse thermals and power consumption)

Apple: Look at this even cooler new chip!

whatsThisBtn4 9 hours ago

Yay a CPU in 2026!

My YouTube will load 0.00001s faster!

jonplackett 7 hours ago

I think it’s weird to say Apple is faster than Xiaomi when both are just using arm chips and using TSMC to build them, and this chip is only any faster because TSMC made a smaller node.

I know Apple do some special hardware software integration magic too.

alain94040 6 hours ago

Apple is not "just using arm chips". They have been designing their own 100% custom cores for more than a decade.

ajross 14 hours ago

To be fair, this kind of dominance is not unprecedented. Intel was even further ahead in the early 2000's. Every new competitor process was further behind the leading edge and not closer. TSMC started launching half nodes like 28nm just to have something in the market that would sell.

But then you started to see the cracks. New competitors would launch new products with very slightly better metrics than Intel's older stuff, just to be, heh, meep-meeped at the next press conference. But the overlap was real, if small. And it grew over time until everyone looked up around the 5nm node and realized Intel had lost.

That's where we are right now with Apple. "Funny in a way", sure. But history says this is more likely to be the beginning of the end. Everything goes in cycles.

nasretdinov 10 hours ago

TBH Apple never should've been the one who makes the best CPUs -- that's not really their area of expertise historically speaking either. It just appears that everyone else did such a terrible job for so long that they caught up

chvid 11 hours ago

The US “export controls” what Chinese companies can buy at TSMC.

handbanana_ 14 hours ago

Haha, late 90s wasn't really like that though

Gud 13 hours ago

Except in the 90s, I could wield my OS of choice on the hardware I bought.

bayindirh 13 hours ago

That's sadly true though. Also booting something was really simple.

Now we boot an embedded microcontroller (or CPU) which boots the main CPU which boots another OS semi-persistently to boot the main OS (if it's allowed).

Sometimes there are other processors needs to be up to allow processor to continue booting as well (these are mostly servers, but eh).

thsv32r2 9 hours ago

You can still have the 90s OS experience, even today, but these days we use the name bootloader, not operating system, for that amount of functionality.

reaperducer 7 hours ago

Except in the 90s, I could wield my OS of choice on the hardware I bought.

What OS could I have loaded onto my Macintosh SE/30 that wasn't from Apple?

mr_toad 15 hours ago

Apple levelled up in the middle of a fight.

Zylokloto 14 hours ago

I do not find it funny tbh.

I'm very very surprised that Xiaomi matches Apples speed even with the newest release, its not diminishing Xiaomis success.

giwook 14 hours ago

It's interesting to see how defensive some of these pro-China posters get on HN and elsewhere. I'm genuinely curious why there seems to be an inferiority complex here with respect to America/American companies.

yipinwong 14 hours ago

Zylokloto 14 hours ago

cyanydeez 14 hours ago

smith7018 14 hours ago

I think it's great but it's important to remember that we haven't seen Xiaomi's chips in actual devices under real world tests. We don't know if the speeds are sustainable, under what wattage, etc. Competition is still great and I look forward to learning more, of course.

bayindirh 14 hours ago

I find it funny not because I support Apple. I find it funny because it feels like the leapfrogging happened in early superscalar CPU evolution. The era when the Moore's Law was working.

I enjoy it because of progress, not because of Apple.

Schiendelman 11 hours ago

They didn't. It's an off the shelf chip, the threads on that post dismantled it pretty thoroughly as a false claim.

recursivedoubts 15 hours ago

Even w/the pricing spike, inflation adjusted we are back to roughly the prices of a new Mac SE/30 for something that can beat a turing test w/o sweating.

I yield the floor to no one when it comes to pessimism, but that's incredible.

dannyw 15 hours ago

The DRAM market is cyclical. I don’t think anyone truly knows when, but it will happen.

Fab capacity is being bought online; there’s just lead time.

Noticeably greater intelligence is being achieved at the same number of parameters (see: Qwen3.8).

I think the future will be bright, it might be a matter of time. And for tinkers, a used Epyc + DDR4 server can be great fun and epic value.

cogman10 14 hours ago

I'm expecting it to somewhat collapse. I don't know if it'll go back to pre bubble prices (here's to hoping), but I do expect a pretty sharp decline around 2030... probably not before then.

Basically everyone that makes memory is building new fabs, meanwhile I'm not sure how much longer AI datacenter demand for ram will last. I think the decrease in AI ram demand and the new fabs will likely coincide leading to a collapse in pricing.

That is, of course, assuming the memory manufacturers don't pull their favorite trick and collude.

FeepingCreature 14 hours ago

ColdStream 5 hours ago

brookst 15 hours ago

100%. We're probably on the cusp of over-capacity, a glut, cheap RAM, bankruptcies, and shortages.

unsupp0rted 12 hours ago

nomel 8 hours ago

giantrobot 11 hours ago

SSLy 15 hours ago

Looks like I'll be sporting my 5800X3D + DDR4 + 9070 XT gaming box for a little while. Too bad the CPU's ST is slower than my MB Air m4.

pdpi 14 hours ago

Lwerewolf 14 hours ago

ColdStream 5 hours ago

Absolutely, I am in a hold pattern for the next few years. I suspect in another 3-4 years you will be able to build an absolutely stacked machine at a reasonable price. Probably won't go back to what was before but it will be decent.

ciupicri 15 hours ago

If it will happen in 100 years it will practically never happen (for us). Even 25 years would be a lot, it's half of a career.

Could you provide more details about the Epyc + DDR4 server?

bluGill 14 hours ago

vonneumannstan 13 hours ago

If you don't understand that the AI driven memory boom has totally broken the cycle you are going to lose a lot of money. There is infinite demand for Intelligence and that translates directly to chips.

Mistletoe 11 hours ago

mathisfun123 13 hours ago

> The DRAM market is cyclical.

...

> I don’t think anyone truly knows when, but it will happen.

Do you know what cyclical means ... ?

darreninthenet 15 hours ago

An additional £1,000 for a 2TB drive is crazy though, rapidly takes the new Mac mini from a good price to a nuts price

SloopJon 12 hours ago

I happily booted and ran an Intel Mac mini using a 4TB drive in a Thunderbolt 3 enclosure, and I do the same for an M4 Max Mac Studio using an 8TB drive in a USB4v2 enclosure (OWC Express 1M2 80G).

You'll just have to be careful to match the enclosure to the ports on the system. The base-model M6 Mac mini still uses Thunderbolt 4, so a USB4v2 enclosure would be wasted.

criddell 14 hours ago

Considering hard drives were $10k / GB in the Mac SE/30 days, that feels like a bargain too.

aurmc 11 hours ago

inigyou 14 hours ago

Keyframe 14 hours ago

On the higher end upgrade we're more like back to roughly SGI prices.

intrasight 15 hours ago

Yes. I commented elsewhere that it's only twice as expensive as my first mac which has 128kb.

high_na_euv 15 hours ago

You should compare with competition, not what was decades ago.

E.g how is the perf/$ vs Wildcat lake

TheRealPomax 9 hours ago

There is nothing special about making a computer that's unaffordable, irrespective of whether it's 2026 or 1989. If anything, it just shows how little they're trying.

bubblegumcrisis 15 hours ago

Sigh..

Is there anything better now though?

All I see from AI, is an amplification of the enshittification of the internet.

And people being even more alone.

AbsurdCensor 15 hours ago

Sure, when you look a little wider, since 2000 we have seen the following major improvements:

- Extreme poverty has dropped from 30% to under 10% globally. - Child mortality rates have dropped in half - Internet access has exploded from 10% to 70% - Solar energy costs have dropped 90% - Cancer death rates have declined by 30%

All of these massive improvements in less than 30 years.

While there certainly are issues to solve, and if you simply follow journalism you may think the world is worse off, but for many, their lives have been significantly improved.

Taikonerd 14 hours ago

SamPatt 14 hours ago

minhaz23 15 hours ago

wang_li 12 hours ago

cedws 15 hours ago

Just like the computer revolution, it will make a small number of people richer and put everyone else at their mercy. In real terms the average person is far poorer than in the 20th century. Used to be able to buy a home and support a family on a single income. Now it can take two just to survive.

marknutter 15 hours ago

senordevnyc 13 hours ago

kilroy123 15 hours ago

Well, there is more renewable energy than ever before powering the world. It's all being built and added to the grid faster and faster each year.

That's one big plus.

runjake 15 hours ago

Then you’re either spending time in the wrong parts of the internet or doing things that don't fulfill you.

These times are exciting and rough seas make good sailors. Find your path forward.

ashetr 15 hours ago

snozolli 15 hours ago

formvoltron 10 hours ago

Yo... the Se/30 was worth it. dual floppies was so lame

jgalt212 15 hours ago

when was the turing test beaten?

simonh 15 hours ago

1966

https://en.wikipedia.org/wiki/ELIZA_effect

It turns out the limiting factor isn't how sophisticated algorithms are, it's how gullible humans are.

ashetr 15 hours ago

ebruchez 5 hours ago

beardedetim 15 hours ago

applicative 12 hours ago

bell-cot 15 hours ago

Someone1234 15 hours ago

The EU just had to pass a law to force companies to disclose if a customer service agent is AI or Human. It is beaten.

https://commission.europa.eu/news-and-media/news/safer-and-m...

thatjoeoverthr 9 hours ago

AnotherGoodName 13 hours ago

stavros 14 hours ago

maximilianthe1 14 hours ago

bnchrch 15 hours ago

According to Psychology today, April this year by GPT 4.5

https://www.psychologytoday.com/ca/blog/the-digital-self/202...

DougBTX 15 hours ago

mdp2021 15 hours ago

The Turing test is more complex than what gets suggested.

And the "popularized" version is faulty also since it uses an ideal, abstract human judge (like the "spheroidal economic agent").

But if you want to add declinations to the said popularized image of the Turing test, you may add Maxim Lott's IQ tests at trackingai.org . Between the end of 2024 and the beginning of 2025 LLMs reached an equivalent IQ of 100, for example.

goda90 15 hours ago

I think it was determined that the Turing test is too easy because humans are too easily fooled.

bbor 15 hours ago

3836293648 15 hours ago

~1960

ELIZA beat the Turing test and then everyone forgot about it. Humans are just really terrible at recognising robots.

mdp2021 14 hours ago

Or can we reframe it: when did humans start losing the (so-called) "Turing test".

I think there are elements showing lowering of performance and expectation.

olmo23 15 hours ago

shric 15 hours ago

It depends who takes the test. I am not yet, to my knowledge, fooled by AI.

I've tried [1] and I almost 100% detect which is the AI. I really want to convince myself I have failed, does anyone know of a better site/resource for this?

I know it might be moving goalposts but I would consider AI to have passed in a well and truly undisputed manner when [2] is resolved.

But in a more practical sense, if AI can impersonate humans so well today then why are state of the art frontier models so obviously AI when they create PRs, commit messages, documentation, etc. Are the companies deliberately making them unnatural?

[1] https://turingtest.live/

[2] https://www.metaculus.com/questions/11861/date-when-ai-passe...

sgerenser 9 hours ago

jayGlow 15 hours ago

dmd 15 hours ago

intrasight 15 hours ago

2050 I'm guessing

Rover222 13 hours ago

are you living under a rock?

afro88 11 hours ago

> something that can beat a turing test w/o sweating

Ok I'll be that guy. It's pretty easy to figure out if you're talking to an LLM now we know it's tics, failure modes, jailbreak techniques etc

gardaani 15 hours ago

Rumors say that Apple will only release M6 base variant and skips M6 Pro, M6 Max and M6 Ultra variants to concentrate all efforts to create a good AI capable M7:

"According to reports from Bloomberg, Apple will be skipping its M6 Pro, M6 Max, and M6 Ultra chips to accelerate development of the M7 chip. That means the only chip to be released from the M6 family will be the base M6.

The reason for this break with tradition: AI. Apple had been planning major neural-processing upgrades for the M7 family and ultimately decided those improvements were important enough to justify accelerating the next generation rather than completing the M6 lineup." https://9to5mac.com/2026/08/08/apple-m7-chip-heres-why-it-ma...

I'd skip M5 and M6 chips for LLM work and wait for a year for M7.

Humphrey 3 hours ago

I wonder when/if we will start to see Apple include a silicon encoded model into their chips. Similar to Taalas build Llama 3.1 silicon with 17,000 tok/s inference.

So could the M7 actually include an AFM 3B model, alongside a generic neural engine?

bhouston 14 hours ago

The M6 doubled the neural engine from 16 to 32 cores. I would expect that the M7 doubles that again to 64 from 32? That would make sense.

I believe that the CPUs are actually limited by ram bandwidth more than the neural engine right when it comes to LLM processing?

Maybe the M7 introduces something new to get around the current ram bandwidth problems on the non-Ultra chips.

bigyabai 11 hours ago

Apple's biggest bottleneck for real-world inference is prefill processing. They need a better GPGPU architecture, which is what I'm expecting M7 to reveal.

tedd4u 11 hours ago

aurareturn 3 hours ago

wmf 12 hours ago

LPDDR6 is coming.

bhouston 11 hours ago

spacedcowboy 11 hours ago

i sold my m3 ultra /512 for £14000, or about $18000. The difference is what is important to me for a new one, and assuming $6k or so for the 256->512 boost, my cost will be about $16k, so i’ll save $2k by upgrading to the top-of-the-range model, bar it being a 4TB drive

ColdStream 5 hours ago

That makes sense. I also think that we are at the point where maybe the expectation of a yearly refresh on everything should be reconsidered. They can end up on a Tick-Tock schedule when the Pro/Max/Ultra can be done every second year.

lifty 13 hours ago

Do current models run on the NPU or GPU? Wondering if Apple will have something like a TPU.

bhouston 11 hours ago

Apple has a dedicated "neural engine" which is designed as an inference NPU. Where as Google's TPU has a dual focus, both inference and training, which is a more complex design.

curious_cat_163 14 hours ago

> I'd skip M5 and M6 chips for LLM work and wait for a year for M7.

Please say more? Is it because it is a one-time cost, unlike a recurring subscription of Claude/Codex?

romanovcode 12 hours ago

I'll upgrade M3 Air only when Mx Pro/Ultra can run Opus level perf locally. Otherwise what's the point.

RetpolineDrama 14 hours ago

The true-local AI chip, codename "buddy", will be the M8

mrtksn 15 hours ago

Apple Studio with maxed out M5 Ultra, 256GB RAM and 16TB storage is 18,299$. The 512GB RAM version apparently is coming in October, considering that the difference between 96GB and 256GB is priced at 4000$, the 512GB upgrade must be eye watering.

So, on the mini the RAM upgrade runs at 25$ per GB on all tiers, the same as the Studio therefore the upgrade to 512 will probably cost 6400$.

The fully maxed out Apple Studio then will be 24699$. It's 17199$ if you don't upgrade the storage(1TB).

Nevertheless I itch to have one :)

intrasight 15 hours ago

So is downpayment on a house. I would buy the house and just pay for tokens as needed. The house will get more valuable and that wealth would buy a lot of tokens in the future - which will probably get cheaper.

EDIT: or buy AAPL. If I had bought Apple stock instead of buying a Mac LC II in 1992, then I would have about $2 million in Apple stock.

paxys 15 hours ago

Or more simply – $25K (+ tax) put in a savings account will earn about enough interest to pay for a $100/month AI subscription indefinitely. And at the end of it you still have the $25K.

AbsurdCensor 15 hours ago

kphorn 14 hours ago

twobitshifter 7 hours ago

sanderjd 14 hours ago

bilbo0s 15 hours ago

chrsw 11 hours ago

Where I’m from $25k is the down payment on a parking space in a garage, not an entire house (or condo).

saturn8601 11 hours ago

>The house will get more valuable

Depends on where you live. Also keep in mind population decline so long term, im not so sure. Prices already dropping in less desirable places (everywhere outside of most blue areas) (Assuming you are talking about the US sorry if not)

ziofill 15 hours ago

where are downpayments so cheap? I'll move there ^^'

kridsdale1 12 hours ago

alistairSH 10 hours ago

weakfish 11 hours ago

intrasight 14 hours ago

derwiki 15 hours ago

d_runs_far 15 hours ago

Had I done that as well, then maybe I wouldn't have gotten intrigued by HyperCard, then Director/Authorware, then Flash, then HTML, then...

garciasn 15 hours ago

With the way RAM prices are going up, you could expect to make 20% profit on any purchase.

intrasight 15 hours ago

moomoo11 9 hours ago

why not buy the maxed out mac and then buy a metaverse house that you can live in virtually

problem solved /s

tedd4u 11 hours ago

Regarding the $25 price per GB RAM. These chips use LPDDR5X RAM. Looking at the Framework site, they are selling LPDDR5X LPCAMM2 modules for the following prices:

    16GB   $239 - $15/GB 
    32GB   $800 - $25/GB
    64GB $1,600 - $25/GB

cortesoft an hour ago

$7000 of that is for the 16tb of storage. That is certainly not worth it if you are trying to save money.

JKCalhoun 15 hours ago

M6 Mac mini maxes out at 32GB—if you want 64GB you have to go with the M5 Pro (just priced it out on Apple's store page).

TimByte 15 hours ago

Apple hasn't been selling just ram for a long time, they sell vram. Try getting 512 gb of HBM on current Nvidia cards - it's gonna cost way more than $ 24k. And here you get the same amount of memory for weights right in a quiet unit under your desk

Put together a similar build with a couple of rtx 6000 Ada cards and Apple's price tag suddenly looks pretty damn reasonable

tedd4u 11 hours ago

The RAM in the M5 is LPDDR5X, not HBM. You're right of course that it's unified and used as VRAM in that sense.

dagmx 13 hours ago

HBM itself is very expensive but it’s not really fair to compare to LPDDR or GDDR

They’re very different things.

The more logical argument to me is that Apple uses its upgrade price points as more than just direct BOM and rather as a proxy for things that are amortized across all their sales like support/warranty/etc so higher SKUs subsidize the costs of the lower ones.

smcleod 15 hours ago

I wish you could drop $20k and get a house! Down payment here store like $100k+ (AUD). So "only" 5~ Max Studios.

sanderjd 14 hours ago

Ha yeah that was my thought. How is this a down payment? This would only be 20% of a $100k house...

alistairSH 10 hours ago

Marsymars 13 hours ago

Tempest1981 10 hours ago

op forgot to add "/hyperbole"

frogperson 15 hours ago

i remember when SGI boxes were $50k and then literally worthless just a couple bears later. i remember my university had a pile of them for free outside the deans office.

fluidcruft 14 hours ago

I figure most electronics are worthless after a couple of bears.

mf2hd 14 hours ago

mr_toad 14 hours ago

Ten years ago a bought an expensive MBP because I do a lot of stats in R, Python etc that benefited from it. But the next Mac I’ll buy will be a much lower-end model, because it’s just easier these days to do that work in notebooks in the cloud.

_the_inflator 11 hours ago

The trick are tax deductions.

I wouldn’t recommend buying any bare metal unless money is a second thought or you can fully deduct the price.

Most often in the end you pay half the price then. Depending on the write offs you could even make some bucks out of it.

Or buy and lease. Under certain circumstances the hardware costs you nothing.

But you need money to save money. And a company.

meerita 13 hours ago

I don't think 16TB storage is a right choice. Going 2TB and it's 11,299. Probably, if you buy the storage and install it yourself you can go higher and quite cheaper.

ff10 13 hours ago

I think the reason they offer these options in the first place is the discontinuation of the MacPro and their remaining need to offer high end solutions.

sixothree 6 hours ago

Does anyone know if you can link multiples of these together for a single large model?

paxys 15 hours ago

More validated by the day that my $450 M4 Mac Mini (16GB) was the best deal in computing for a long, long time.

hasteg 15 hours ago

I live right next to a micro center and remember when they started offering that deal... still so pissed at myself for not buying one. I ended up just buying a raspberry Pi for what I was doing, but seeing as where the prices are now, I messed that up a bit. Also my worst sin was not buying 64GB of DDR5 when I was doing my computer upgrades back in August last year.

brookst 14 hours ago

I returned an M4 Mac mini, 64GB, unopened... because I thought it was excessive for my needs then. I swear it'll be one of the things flashing before my eyes when this all ends.

Huppie 6 hours ago

I feel so incredibly lucky I chose to overdo it a bit on RAM when I upgraded last year... though I remember deliberating to go for 192GB (it's 96GB now) but motherboard support was somewhat more complicated and it felt like a waste of 300 euros...

aucisson_masque 7 hours ago

Mac mini aren't that good for home made server, raspberry sure ain't powerful but there are in-between.

Not being able to upgrade the SSD or the ram is a big issue, not so much on a portable laptop.

zamadatix 5 hours ago

F7F7F7 15 hours ago

Should have grabbed two.

giwook 14 hours ago

Should have grabbed 100.

georgel an hour ago

xiphias2 15 hours ago

Apple still has the best hardware so I moved to it for the last few years, but the closed software ecosystem is terrible for taking advantage of it.

I wasn't able to debug network errors (restartin my Mac worked), Metal was missing low level disassembly / debugging tools (there is some hard to use UI), but the worst thing was the inflexible windowing system.

Even getting all the window handles on all screens/desktops with their titles and programs is impossible.

I just decided that I move to Omarchy 4 (basically Hyperland + QuickShell) + NVIDIA GPU, and I already was able to customize it more than my Mac in years.

I will miss Apple's hardware for sure, but not MacOS and the missing hardware documentation

nomel 8 hours ago

> but the closed software ecosystem

There's aren't really any alternative OS [1], but I don't think it's fair to say there's a closed software ecosystem. You can install/compile/run whatever you want, including kernel extensions. The hardware isn't locked.

[1] Hardware isn't locked: https://asahilinux.org/about/

> Apple allows booting unsigned/custom kernels on Apple Silicon Macs without a jailbreak! This isn’t a hack or an omission, but an actual feature that Apple built into these devices.

foltik 2 hours ago

It’s barely a “feature” that they let you execute arbitrary code on your own hardware.

They don’t provide any source code or documentation (which they easily could) so if want to do literally anything with your “open” device you must first reverse engineer the entire MacOS driver stack like the Asahi project did. Great fun, but it’s a criminal waste of incredibly talented engineer hours.

On top of that, the reason Asahi doesn’t work on M4 and later is that Apple has intentionally modified the ARM core to prevent stock MacOS from running once the hardware is “unlocked,” which makes it way more difficult to reverse engineer.

Bastards.

xiphias2 8 hours ago

I wanted to try it but it works just on M1 and I have M4. I was also considering upgrading to M5/M6, again to take advantage of what I really love: access to the 2nm process.

The performance you get with M5/M6 in theory is crazy (especially having matmul cores with such an energy envelope and unified memory). By the time I can use it well in Linux there will be M7/M8 though.

With NVIDIA I can buy a Blackwell based core right now and use it (even if I will have much less GPU memory. Though it will be high bandwidth).

Axsuul 15 hours ago

I had a chance to try Omarchy past few days and it's just very different vs macOS. I honestly never had a problem with the windowing system ever since I built my own customization scripts (i.e. Hammerspoon). I can see the appeal for someone who wants ultimate customization though but macOS still wins overwhelmingly when it comes to polish, ecosystem, user experience, and apps (nothing comes close).

cosmic_cheese 14 hours ago

It’s not just Omarchy, there’s really not much out there in the desktop Linux sphere for those who are mostly happy with how macOS works out of the box. Everything is either in a similar vein to the Omarchy setup (hyper-minimal tiling WM), Windows-like (KDE, Cinnamon, most other DEs), or a chimera with a grab bag of design bits from every desktop and mobile platform (GNOME, Pantheon, COSMIC).

It’s a bit depressing because it means that if I ever feel forced to switch my daily driver, it won’t come without a dump truck load of friction, frustration, and lost productivity, which I’ve validated by using the various Linux desktops on secondary machines.

kombine 10 hours ago

xiphias2 14 hours ago

prmoustache 12 hours ago

xiphias2 14 hours ago

It's interesting because I just haven't felt the polish.

For example when using PyTorch I wanted to try to speed up my NN kernel by 2x by just using half precision and haven't noticed any speedup at all. Also I was missing the easy to use GNU tools that had to be mixed with Apple's tools.

I loved using Arc browser as well, and I'm missing it, but I guess I will do without it somehow (Chrome's vertical tabs are just not the same).

My main program missing from going back to Linux was ChatGPT Desktop, but now it's there.

I just checked out Hammerspoon, I'm happy for you that you wrote it, and looks great, but it has the same problem that I had: for security reasons Apple stopped allowing the window APIs to get all important information on other workspaces. You can only do it with Accessibility API. I was trying to fight with it but have up.

cosmic_cheese 14 hours ago

Einenlum 7 hours ago

I don't understand how absolutely basic things are not possible on Mac OS. Switching between two windows easily, displaying hidden files in the finder... These things would be way easier to solve than building the next generation hardware.

AbsurdCensor 14 hours ago

How are you liking Omarchy? I saw a video on it recently, and it looks 'pretty' but still looks like it's a lot of memorization of shortcuts and feels like the 40% keyboard of OS's. Like some people it's absolutely amazing, but lets be honest, it's going to be really difficult to be as productive as a full fat keyboard.

pantulis 10 hours ago

As a long time Emacs user, I beg to differ. Muscle memory will settle in after a few days. I still use Emacs shortcuts to navigate text boxes on macOS.

The most disruptive thing in Omarchy is not the keyboard, it's the tiling WM in my opinion.

rrgok 15 hours ago

On what hardware you running Omarchy?

xiphias2 14 hours ago

Just Beelink, but it doesn't matter at all.

I ordered an ASUS Zephyrus G16 with 5090 NVIDIA card + 1.9kg (quite an overkill, and I know that I will have to limit power output), but hasn't arrived yet.

But what's fun is that I love QML+QuickShell with its hot reloading, Hyprland with its Lua support.

With AI nowdays it's just so easy to do deep UI changes that wasn't possible a year ago.

xacky 7 hours ago

Add ARM boot camp, MacOS is too restrictive compared to modern Linux. Asahi's devs can't keep up with the constant hardware releases so official support is important.

SilverSlash 15 hours ago

The 512GB Ultra is amazing, sure. But who is it for exactly? VC funded big spender founders? In that case why would they need local AI? The ultra rich enthusiast? But there can't be too many of those. So who actually buys these?

ericd 15 hours ago

I think there's some mental inertia around what a computer is and what it's worth. This thing can build custom software for you, mostly autonomously. It can monitor things happening on the internet that are relevant to you, in a holistic and flexible way. We have one crawling the web for local events we'll like, and it judges them based on what it knows about us, and it tells us about the best matches every weekend, which has yielded some awesome outings we wouldn't have known about. It reads the literature on a subject in seconds and uses it as context to help in decision support. It's not the same value proposition as a computer 3 years ago, where most people are mentally anchored on what a computer should cost. Having it at home means that you can use it as a personal agent that always puts your interests first, regardless of what ad model the commercial providers decide to put in, and you can stash in it your medical data, what you buy, what you make, your worries, hopes, and dreams, without worrying about that being used as training data, or worse, something to exploit you commercially. I think it'll become considered totally reasonable to consider spending the cost of a small car on a computer, for many families.

Also, a lot of companies are looking at how to run capable models locally to cut some of their (massive) cloud AI bills. An easy answer is worth a lot to them.

zamadatix 12 hours ago

By this kind of logic we'd paying something like ~$10,000/month for our internet connections. The perceived value needs to exceed the cost but that does not make it the only factor to consider price with.

What makes this expensive & sell well is it's not very fungible at the moment. Where else are you going to get 512 GB of high speed memory with a well supported accelerator attached that you can throw in the corner of anyone's home and not really have them notice? There are plenty of lesser options, plenty of noiser/power hungry options, plenty of harder to support options, but not really something in direct competition at the moment. Even the next rounds of the integrated AMD/Nvidia solutions are only targeting 196 GB of much slower memory and compute.

ericd 12 hours ago

hectdev 15 hours ago

I like this train of thought. The inverse is saying that the cost of this computer is the value we give away to AI companies by doing compute on their servers with our data. And to take it another way, is the value to you, the cost of a small used car?

ericd 15 hours ago

conmod278 12 hours ago

Nvidia is definitely working on a AI Rack machine fully built for on-prem uses for companies.

Jesus_piece 11 hours ago

Could you share what you did to find events to do? That sounds really cool

ericd 11 hours ago

DrScientist 14 hours ago

Remember core customers of Apple studio type products is content creation/video editing, etc.

AI based tools are very useful here - thinks like object removable or cleanup etc, not just AI generation.

For example Apple mentioned performance increases for https://learn.foundry.com/nuke/content/reference_guide/air_n...

maherbeg 15 hours ago

If I can get Sol level capabilities on a $20k machine, then it is well worth it for my employer to buy me that machine for work as a workstation. When you start paying in tokens vs subscription costs due to enterprise agreements, you really start to see how much cash utilizing frontier models at the frontier costs (and I'm efficiently using luna and other models where possible!)

ericd 14 hours ago

Yeah, I'm not sure people realize how expensive ZDR/Zero Data Retention is, and how important it is to a lot of businesses, this kind of thing starts looking really cheap really fast if it's a reasonable substitute.

ltbarcly3 12 hours ago

I don't think this is accurate.

Even using multiple windows in parallel for as many as 5-10 hours per day, I find that I am not fully using my claude max (20x) and chatgpt pro (20x) accounts. I can for sure use up the claude max account, but chatgpt either gives me a free reset before I run out of tokens or I just fail to use the full quota. The quota for Sol seems like 10x that of Claude Opus at the same level, and forget Fable, you can use a 5 hour quota in 20 minutes.

But lets do the math:

Lets say a 20k workstation can run 1 inference at a time at the same speed you get with Sol hosted by openai (big assumption) and run an equally capable model (big assumption).

Each month this gives you about 100-170 inference hours on a Sol 20x Pro account, and 720 hours (if you utilize 24/7) on the workstation.

Assuming a 36 month amortization before the workstation has to be replaced due to no longer being able to run frontier models or is too inefficient due to electrical costs or what have you:

The monthly workstation cost is about $550 capex and $150 electricity -> $700/month

You would need about 6 Pro accounts to reach that capacity, which would cost you $1200 a month.

But this fails because:

- You most likely can't utilize the workstation 24/7. Your work hours will be concentrated into 6-10 hours per day.

- During work hours you are capable of utilizing more than 1 concurrent session. 6 Sol accounts would support as many as 20-30 during working hours, not all the time but if you could burst to that many (don't forget sub-agents and agent directed parallel agent workloads).

- In 1 year the cost of Sol level models is likely to cost a fraction of what it does now.

this leads to:

                       Workstation   1 Sol Pro   2 Sol Pro

  Monthly cost            $700          $200        $400

  Raw capacity (hrs)      720           120         240

  Usable capacity (hrs)   100-130       120         240

  Concurrent sessions     1             3-5         6-10

  $ per usable hour       ~$6.00        $1.67       $1.67

  Usable hours per $700   ~115          ~420        ~420

spacedcowboy 9 hours ago

hellohello2 11 hours ago

timfsu 12 hours ago

slashdave 10 hours ago

mathisfun123 12 hours ago

searealist 11 hours ago

Don't forget about electricity costs, esp in California. Even with free hardware you may be better off using APIs.

sanderjd 14 hours ago

I think "ultra rich enthusiast" is in the right ballpark. There are people betting on being able to create their own revenue generating products and services with their own local hardware and very little operating costs. That may or may not make sense as a business idea. But people with wealth and risk appetite trying a new kind of business model and cost structure has a strong tradition.

Put another way: If $25k is the full extent of the start up capital costs, and operating costs are very low, that is a much cheaper business to start than most! The question is whether this is actually a useful model for a revenue generating business. I think that remains to be seen.

My guess is that there will be a few hits (which we'll hear a lot about - especially when someone actually pulls off "the first single-person unicorn", which I do suspect will happen someday) and a huuuge number of misses, which we won't hear much about.

Aurornis 13 hours ago

Enthusiasts buying these for fun are not the target market. These aren’t big sellers to begin with but a lot of the sales are going to companies where people have budgets for gear like this and can make a business case for it.

This is, sadly, probably a foreign concept to a lot of people who have only worked at companies where hardware purchases are viewed as something to minimize and everyone is stuck with the same low spec laptops that the finance department picked out. At companies where someone might have a legitimate use for a $20K machine, their fully loaded costs (not their salary) are $300K or more, and other teams like sales are spending thousands of dollars per week on things like travel and hotels for their job, spending $20K on a computer that’s going to last several years is not a hard choice.

zitterbewegung 14 hours ago

Other than the local AI crowd which is much recent it is professionals using Final Cut Pro for video editing, Logic Pro as a DAW and music production, Video transcoding, Photoshop and other tasks for high performance computing that don't need Laptops but want above 128GB of ram and prefer a Mac. Then there is the obvious group of developers that are making Apps for all of their products. Also, these are great for the workplace. AI is much more recent thing that Apple products were used for.

If Apple didn't sold these things they wouldn't make them but, also the level of marketing that Apple is talking about for AI is basically the new group they need to capture because the ones I just listed are already buying Macs and or easily to motivate with the other obvious CPU / GPU performance upgrades for code compilation, faster memory and video transcoding.

LeBit 15 hours ago

For some , the idea that some proprietary information could potentially leak is enough to justify any price.

zmmmmm 6 hours ago

Anyone dealing with sensitive or regulated data can get started instantly with local models where they may need time consuming process or complexities to send sensitive data outside.

SXX 15 hours ago

You can connect up to 4 of them via RDMA so 2TB total RAM.

Its cheaper than Nvidia AI hardware.

serf 15 hours ago

also way slower if we're just going against 'nvidia hardware'.

SXX 12 hours ago

eigenspace 15 hours ago

If you want to run reasonably big, local AI models, what are your alternatives?

That may not be many people, but there certainly will be some people who want to do that, and are willing to pay big bucks to do so.

tencentshill 15 hours ago

The competition is a custom multi-GPU NVIDIA RTX pro desktop, which go for much much more. $20k is cheap for 512GB addressable memory. The old mac pro could easily be configured to cost that much.

mschuetz 15 hours ago

I know people who would get it for local LLMs for use in their company.

serf 15 hours ago

this comment has always existed behind every apple release, most especially anything vaguely pro-ish.

to answer your question : looking at the aftermarket availability of Apple's prior best and brightest : practically no one buys them.

"people here buy them" , well, 'here' is one of the most affluent groups of people in the world.

They're available as movie and television set pieces (undoubtedly disappearing into the home of someone close to the staff post-production), and for administrative/boss types that can slip the cost into a ledger somewhere that few will ever see.

It has been a hobby of mine every few years to check out the apple site and see how big I can option a machine. My record was when I was in high school years ago and was able to option some pro studio-ish apple desktop thing to like 61,000 usd out the door.

avalys 15 hours ago

Movie set pieces, as a motivation for Apple making these high-end configs available? That makes no sense.

For one thing, you can’t tell from a movie what the specs are. A $999 Mac Studio looks exactly the same as a $20,000 one.

For another, Apple updates the industrial design on their products so rarely, a 6-year-old Mac, iMac or MacBook also looks nearly indistinguishable from a brand-new one.

michaelbuckbee 12 hours ago

kylehotchkiss 7 hours ago

I realize it's not a 512, but for context on why I ordered a 96GB. $95/month after a trade in. I'll use it for a long term project where I'm building a national sized dataset/processing video transcripts with a rubric (of churches/sermon health). I'm willing to trade SOTA models for local ones for cost of regenerating/model consistency/ethical reasons.

I'll find other ways to use the power though, opencode or maybe start working on more video projects.

teaearlgraycold 8 hours ago

My friend plans to get the 512GiB M5 Ultra ASAP. He makes money by selling synthetic data and training models for companies in San Francisco and it's the cheapest way to be able to do that on your own local hardware. It's also a bit irrational as he could save money by just renting, but I get the appeal of owning something outright.

skinfaxi 15 hours ago

A number of people in these comments, it would seem.

usrnm 15 hours ago

So, rich enthusiasts it is, then

fearmerchant 14 hours ago

Mistletoe 11 hours ago

I always just assume that super expensive computers are like hot rods and an expensive hobby.

lenerdenator 15 hours ago

Local AI is the future, and a lot of people want the first mover advantage or to toy around with it. I know a guy with a small rack of Nvidia Spark machines that he uses for that purpose; it's as much as a decent used car.

brianwawok 15 hours ago

But is it? If it’s cheap enough latency doesn’t matter. Unlike say cloud gaming, where latency does matter. I’ll take my games local and my text bots cloud

lenerdenator 10 hours ago

intrasight 15 hours ago

It's as much as a new car

mikert89 14 hours ago

you can run open source models in the privacy of your own home :)

try-working 15 hours ago

Twitter users.

sinpif 8 hours ago

John Siracusa, for sure. He's not getting an EV. He's getting this.

c0rruptbytes 10 hours ago

it's for me

j45 15 hours ago

Companies used to have local server rooms in their office, like mini centers, and buy all the equipment end to end.

It’s when self hosting and local hosting was the norm, and why it’s also starting to come back.

There will be workloads that can never touch a public cloud, and for it solutions like this are an option.

diddid an hour ago

I like my Mac mini as much as the next person, but I don’t think an M5 ultra 64gb with 4tb should be as much as a DGX Spark with 128gb and 4tb.

apparent 9 hours ago

I wonder to what extent the timing of this release was driven by their need to increase prices, but not wanting to apply it to in-market hardware. It's kind of a weird time to drop new Macs, between WWDC and the iPhone release, but not early enough that it could be purchased by college students. I get that most students use laptops, but if I were heading off this year I might use an iPad + Mac mini for more horsepower while maintaining portability.

mark_l_watson 12 hours ago

I run a lot of local models (I am always experimenting) on my 32G M2-Pro MacMini - I would love to upgrade.

The financial aspects don’t work however: I can learn and experiment with what I have for local models, and I pay as I go on FireWorks.ai for open model inferencing and no matter how much I use this service my monthly bill is between $10 and $40 and much faster than any reasonable home rig.

Hybrid ‘small local’ and buying inference is the way I choose.

ActorNightly 11 hours ago

Honest question - why are you so stuck on Macs for local inference?

A 4 GPU linux box with 3090s, which are $1500 a piece right now, will blow this thing out of the water. Even 2x3090 rig will run most of the good local models like Gemma4:31b at 100+ tok/sec

The VRAM of the GPUs are MUCH faster than the unified ram within Apple Silicon. The only difference is the initial model load, which takes longer from disk to VRAM due to PCIE limitations, but once the model is loaded, GPUs can prefill and and generate tokens way faster than any Apple Silicon.

So is your desire to upgrade to mac because you just aren't aware of how to set up a GPU rig, or is it something else?

nomel 8 hours ago

That's 6 YEARS of their cloud inference!

And, you have to include power. Where I am, the power for a rig with 2x 3090, running for four hours a day, would be around $70/month!

It's kinda like datacenter only exist to optimize compute cost through oversubscription of hardware/time share, cheaper business energy rates, and bulk discounts, compared to self hosting. ;)

mft_ 9 hours ago

AIUI you can only connect two 3090s at a time with NV link? So you’d only have 48GB of fast combined memory? That’s not tremendously interesting as you’re still limited to the smaller models which, while impressive in their own right, are still IMO too limited to use as your only model.

Zagitta 4 hours ago

TruthSHIFT 10 hours ago

Upgrading RAM is still probably cheaper than spending $6000 on a linux box. You're correct that inference will be much faster on the Linux box. But, the mac's unified memory can load larger models. And as OP mentions, it's still hard to beat cloud pricing at home.

mark_l_watson 9 hours ago

Yes, GPUs are much better for dense models. On Macs, MOE models run better, so I agree Macs are more limited and expensive. I have a Linux laptop with a 10GB 1080 GPU, dated, but I should add even more system RAM and try that.

theshrike79 9 hours ago

A Mac mini running an LLM is quiet

A PC with similar capabilities is going to sound like a jet taking off.

manmal 9 hours ago

lowbloodsugar 9 hours ago

w10-1 15 hours ago

Leasing now an option, only $50/month (cheaper than inference subscription?), so even cash-poor can go the amortized-investment route.

I've often felt there is tremendous value locked up in underutilized old computers. It would be interesting to see Apple in 3 years offering compute as a service using lease returns (or more likely, partnering with someone else to operate it (perhaps exclusively in secondary markets like China or India, to address political demands for local siting or jobs). Apple is in the best position to work around or even gap-fix older software/hardware limitations in a controlled environment, and now they can do so without cannibalizing new hardware sales.

GoofGarage 12 hours ago

I looked at multiple configurations, and mathed it out. With leasing, you pay ~75% of the capital cost (excl. tax) over 3 years, but end up with no asset.

Apple computers tend to have excellent resale value, and Mac Minis/Studios have the least depreciation of them all. I understand the benefits to both taxes and cash flow, but boy is Apple winning big on those lease offers for Studios.

mathisfun123 12 hours ago

> but end up with no asset

consumer electronics has literally never been an asset.

> Apple computers tend to have excellent resale value

do you think the new leasing category might change that? hmmmmmmmmmmmmmm

edit:

https://www.reddit.com/r/LocalLLaMA/comments/1vxzg6v/apple_i...

echoangle 8 hours ago

cromka 13 hours ago

> Leasing now an option, only $50/month (cheaper than inference subscription?)

For which configuration, though?

anshumankmr 15 hours ago

>fluid frame rates in demanding games like Mixtape.

not getting on that bandwagon but wasn't that not the most demanding game as its a just a nonstop cutscene.

JauntyHatAngle 10 hours ago

But it has the right creative vibe which is the point really. Apple has a general creative aesthetic which plays well with artsy games like mixtape.

It's a very deliberate choice when if it doesn't make sense to gamers.

wilg 10 hours ago

cutscenes are often the most demanding part of a game!

nemomarx 15 hours ago

it's not super well optimized I think. unreal engine 5 is taxing even without a lot of gameplay or stuff on screen

flaunf221 14 hours ago

I'm not sure who that line is supposed to impress. Gamers focusing on graphically demanding AAA games would laugh at this. People who don't game much probably won't know whether this is good or not.

gizmodo59 13 hours ago

I somehow find it better to give 2 frontier model companies 100-200/month than dropping 10 grand on a hardware that will get old in no time with bad TPS. I really want to have a fully local model but seems like one more generation wait and we will be there?

jameshart 10 hours ago

You could spend 100 a month leasing one of these for three years and get the best of both worlds

chis 2 hours ago

You’re still stuck paying for a 3 year contract for deprecating hardware. And the 256gb model which is still not enough is $230 a month. And it runs models 8 months behind frontier

henry2023 13 hours ago

You just described why the datacenter business is hard and as a corollary why space datacenters will not be economically viable.

tyleo 13 hours ago

Lots of people use the Mac Mini to run the frontier models over night or while traveling. I have a rack in my basement and have thought about throwing one in. You can get a cheaper machine but Apple feels a little more, “rack and forget,” if you have less price sensitivity.

Mac Mini + MacBook Neo w/ ssh can be a better setup than MacBook Pro for many people.

throwaway219450 12 hours ago

If it’s purely for experimentation then why not the DGX Spark/GB10? It’s up about 10% from release RRP which is quite good (you might argue it was overpriced then, but prosumer and workstation GPU prices are up 100%). 4TB NVMe is not cheap these days - it’d cost at least $500 for a stick - and you get 128GB at a similar bandwidth to an M5 Pro.

Nevermind that Apple still insists on providing base systems with only 512GB of non-upgradable SSD. The equivalent spec mini (4TB/64/10G) is almost $5k for half the VRAM. Not as good a CPU compared to the M5/6 but you also get 20 cores and full CUDA.

tyleo 11 hours ago

LeoPanthera 14 hours ago

I bought a 128GB M4 Max Mac Studio a while back, and for a while I thought like I had done really well to buy it when I did.

The problem I'm having now is that no models are targeting RAM of that size. Everything is either much smaller, targeting laptops, or much larger, targeting hardware well out of reach of enthusiasts.

Please, AI people, start making models targeting 128GB machines again. The last interesting one was Qwen 3.5 122B.

rahimnathwani 11 hours ago

If I had 128GB unified RAM I'd try hf.co/unsloth/Qwen3.8-27B-GGUF:BF16 which needs 55GB for just the weights.

Something like this would give you three concurrent sessions, each with 240k token context:

  sudo sysctl iogpu.wired_limit_mb=110000
  
  llama-server -hf unsloth/Qwen3.8-27B-GGUF:BF16 -c 786432 --parallel 3 -ngl 99 -fa on

ericboehs 14 hours ago

Great news. Qwen 3.8 Flash Next (125B A6B) is coming out tomorrow. 4 or 6-bit should run nicely on 128GB.

Should bench better than Opus 4.7.

AbsurdCensor 13 hours ago

I have had a difficult time with running 120b models on my 128gb setup, especially with any larger context size. The 6bit of Qwen 3.5 is already just over 100gb, and when you go down to 4bit it seems a bit lobotomized.

fghorow 4 hours ago

It's not exactly straight out of one of the labs -- it's heavily quantized -- but have a look at [1].

[1] https://github.com/antirez/ds4

Marsymars 13 hours ago

Well the upside is that you can run a laptop-sized model and still have enough memory left over to run a couple of Electron apps.

Einenlum 7 hours ago

Why do they focus so much on hardware when their biggest problem is software? I don't get it. My Dell XPS 13 is probably not that powerful in terms of performance but Linux is so much more productive. This drives me crazy

apatheticonion 5 hours ago

Nice! Linux Please.

My M5 MacBook Pro, while amazing, is basically relegated to being a thin client with amazing battery life that exclusively SSH's into my desktop PC for work.

I could spawn a Linux VM / use Docker/Podman locally, but dealing with allocating memory, hard drive space and whatever other limitations non-native containerisation incurs isn't worth the squeeze.

Plus I really want to have Vulkan access, both so I can actually play games like a sane person and also use standardized local LLM tooling (MLX is cool but I don't like dedicating time learning things that I can't leverage elsewhere).

If the Mac Mini / Studio range had Linux support, I might actually consider buying one for my home lab. I know others already do and just put up with MacOS - but if I buy a "pro" product, I want it for "professional" usage damn it

Great devices for watching YouTube and video editing I guess?

SXX 15 hours ago

96GB -> 256GB upgrade costs 4000 GBP in UK or $5460. $34 for GB.

In US its $4000 upgade so $25 for 1GB.

Also:

> 512GB memory option for M5 Ultra coming late October

dgellow 15 hours ago

That US price is before sales tax no?

cute_boi 14 hours ago

Correct. It is better to go to delaware and purchase it.

AbsurdCensor 14 hours ago

rootusrootus 12 hours ago

Void_ 15 hours ago

VAT?

cs02rm0 15 hours ago

I think the $34/GB figure might be inclusive of VAT and the $4560 not, which would be $28.5 otherwise. Not sure.

SXX 15 hours ago

SXX 15 hours ago

AFAIK UK VAT is 20% and it's 27% higher price. Its just what you get for living in UK I guess.

5ersi 10 hours ago

Just bought AMD AI 395+ 64GB RAM for 2000eur. Mac mini would be 2x for about similar performance. Pass.

int32_64 14 hours ago

I was just comparing this to an rtx6000 96gb build and when the f*ck did nvidia double the price?

If you want to comfortably afford this gen you had to trade options on memory stocks...

Roark66 15 hours ago

The page says 170G/s memory bandwidth for the NPU and 1.2T/s for the GPU. Why the discrepancy if it's all "unified memory"? The former is nothing to write home about as far as AI compute is. The latter is really nice.

Which one is it you can run local models on? I suppose the NPU only.

kamranjon 15 hours ago

I think you misread, it’s 170gb/s for base M6 model and 1.2tb/s for M5 ultra.

riobard 15 hours ago

Unified memory is about address space. The bandwidth is still determined by bottlenecks to the processor. CPU/RAM links are still fairly narrow.

Axsuul 15 hours ago

Can anyone recommend the perfect sweet spot for someone who wants to run their own inference?

AbsurdCensor 14 hours ago

For me it's be Strix Halo, 128gb machine, especially running Qwen models. Except when I bought it, it was $1,900, now it's $4,600 for the same box. (Wow that's insane)

For tinkering and learning, it's been great. Tie it into something like Hermes and you have a pretty powerful AI assistant in a box. And when you need to step up your model, you just do something like OpenRouter and it makes it pretty easy.

bsagdiyev 9 hours ago

Seconded. I just got a Strix Halo box a few months back and it is great. Does everything I need it to.

rkangel 14 hours ago

Thinkstation PGX maybe?

Got the recommendation from these articles: https://www.xda-developers.com/qwen-3-8-27b-reverse-engineer... https://www.xda-developers.com/lenovo-thinkstation-pgx-revie...

But haven't had a chance to try it myself.

vldmrs 14 hours ago

I would love to see real LLM performance benchmarks for these machines. Apple statement regarding LLM performance seem little vague.

gehsty 6 hours ago

I still struggle with local llm being a reason to drop insane money on one of these - they are targeting people who want high performance local LLMs, that value privacy over using 3rd party api, but also dont want to use Nvidia? small part of the pie by any reckoning?

This feels like paying a lot for something that is just not very good yet - cloud models are too good vs local models (may change in the future..)

kulahan 7 hours ago

Does anyone know if they’re actually at 2nm transistors, or if this is more marketing talk? It’s kinda like when TVs advertised their contrast ratios (do they still do that?) but they all used their own measurement methods, so dynamic contrast ratio became a worthless metric.

Do you think that little moniker will just disappear in a decade or so as we reach 0nm advertisements, or do you think they'll just add more decimal places? 0.0001 nm! Next year, 0.00001!!

upboundspiral 7 hours ago

It's all marketing talk, sort of.

Our transistors are about 30 nm give or take. But we've found new ways of aligning them so that if we had continued using old techniques, the density we get would be "2nm".

https://en.wikipedia.org/wiki/2_nm_process

throwaway128967 3 hours ago

Imagine if any other industry worked like this.

"Our Quarter Pounder may weigh only 1/8 oz, but we figured out how to pack double the flavor in each mouthful, so we're still selling it as a Quarter Pounder."

patatino 10 hours ago

My macbook pro M1 is still running fast and silent.

hackersnooze1 4 hours ago

I feel like the M series macs have been some of the most positively received computers ever made. I am yet to meet someone who doesn't love theirs, myself included.

bel8 4 hours ago

I tried to love my work issued m4 pro for many months but couldn't stand macOS so asked for a linux compatible machine.

regexorcist 3 hours ago

Yeah for a lot of us macOS really gets in the way of using the otherwise excellent hardware. My daily driver is an M1 Pro with Asahi and it's easily my favorite computer ever. It's a real shame that the newer M models can't run Linux.

iandanforth 15 hours ago

FWIW scaling up from https://huggingface.co/avlp12/Qwen3.8-27B-Alis-MLX-6bit and some other sources:

You might expect the M5 Ultra to produce 50 t/s from Qwen 3.8 27B with a good context length.

mlhpdx 9 hours ago

I did a little stint studying thermal cyclic fatigue in multi-die packages (many years ago) and I'm wondering how the issues there are solved these days.

znpy 8 hours ago

You just never let tour cpu/gpu die get cold! No cycles, no issues! /s

logotype 14 hours ago

Damn. I just bought a maxed out MacBook Pro M5 Max 128GB 8TB, still waiting for it to be delivered. I could get 256GB RAM M5 Ultra 1TB for roughly the same price, and it's double the memory bandwidth. Which one would you recommend? I do plan to run local LLMs.

darken 11 hours ago

M5 Ultra if the portable form factor is not a requirement. (I have a M5 Max 128GB 2TB for context.)

That being said: you might want to consider at least 2TB storage. Having 256GB RAM to fit models is less useful when you can only store a 3 or 4 large models on your disk. The M4 -> M5 transition doubled the drive bandwidth (at least for the MacBook Pro, I'd assume the Studio is no different) making them extra nice for loading large models. Then again, you can always add an external NVMe drive over thunderbolt, so the tradeoff is less straightforward than with a portable MBP.

post_break 14 hours ago

Contact Apple care and see what they can do. They have been known to do upgrades if you buy around the same time. But with the ram situation that courtesy might be gone now.

pornel 8 hours ago

You should be able to cancel it for free.

In EU you also have 14 days to return products bought online, for any reason.

sail0rm00n 7 hours ago

M5 Ultra and toss in a MacBook Neo or older MacBook Air to SSH in

nelsonic 15 hours ago

Sick. Particularly stoked for the 10gb network card ($100 option) when using the Mac Mini as a server. Just wish the memory + NVMe prices could come back down to pre ai-goldrush prices. As $2999 for the M5 Pro with 64GB RAM feels painfully over-priced.

oscarteg 15 hours ago

As someone who is a beginner at home networking and have a Mac Mini running as a Plex server at home; what is the use case for the 10gb network card?

user00005 14 hours ago

My example is I'm looking for a new media creation machine to replace my homebuilt PC from 2015. Since that old machine can't run Windows 11 and also because Apple storage is so expensive, my idea is to turn the PC into a Linux storage machine with a 10G NIC. Then I should just be able to edit off of the storage instead of worrying about caching it locally.

The prices are ridiculous though. I may just keep rolling with my Windows 10 setup.

AbsurdCensor 13 hours ago

As long as everything is using 10gb, faster transfer speeds when moving data between computers. For downloads, it wont help unless you have 10gb fiber, but for most folks, 2.5gb is quite fast. Hell my spinning media NAS has a hard time saturating when moving files between internal servers.

snovv_crash 13 hours ago

It feels stupid having my internet be faster than my computer can connect to it

Phemist 15 hours ago

RAM and SSD in apple gear has always been way over-priced. There was a short blessed period in March where the M5 Max macbook pro was out, but the general 30% price hike had not yet happened. In this period, given the insane inflated RAM prices, the price apple was charging for the M5 Max with 128 GB RAM was actually _reasonable_.

sethd 7 hours ago

The M4 Mac Mini had that option too.

rconti 11 hours ago

Was the quad die layout expected? I've checked a couple articles and can't find any commentary on it, but I don't remember hearing this rumored.

g42gregory 10 hours ago

How many Neural Accelerators does M5 Ultra has in its 64 vs 80-GPU variants?

Anybody knows?

Just to clarify, Neural Accelerators have nothing to do with Neural Engine.

g42gregory 9 hours ago

Ok, I just read the announcement word by word. There is a neaural accelerator in each GPU core. So presumably 64 vs 80 neural accelerators, with corresponding inference performance difference. It will make a difference for pre-fill.

senderista 7 hours ago

So the idea of networking multiple Mac Minis via RDMA over Thunderbolt 5 to run local LLMs is intriguing, but doesn't really seem reasonable at this price point? What are the more cost-effective alternatives?

shepherdjerred 4 hours ago

Honestly, waiting 5 years until the supply constraints are lesser

xattt 15 hours ago

Tangential, but what would be the ideal Mac option for home movie editing, casual gaming and amateur CAD fiddling in Fusion?

I plan on maximizing my residual student benefits, and taking advantage of education pricing.

j45 15 hours ago

The regular Mac mini will blow you away, search YouTube for video editing reviews using different Mac mini’s.

geerlingguy 15 hours ago

I use both the base M4 Mac mini and an M4 MacBook Air for Final Cut Pro, Photoshop, and Fusion, and while they're not as almost-always-perfectly-smooth as my Mac Studio, they're about 100x better than the experience I used to have on my old Intel MacBook Pros in the 2010s.

I edit 4K ProRes and H.265 footage, sometimes with multicam (up to 4 streams) and color adjustments, titles, etc. It's only after stacking 3-5 effects before things can stutter, really.

Or if you try doing something CPU-intense in the background _while_ running some heavy creative software. I just don't do that.

callamdelaney 15 hours ago

Usable ram amounts in late October

pixl97 15 hours ago

Usable, not affordable.

nozzlegear 14 hours ago

Subjective

ricardobayes 15 hours ago

Interesting that "coding" is now part of the marketing brochure as one of the use cases, while that was historically kind of missing. Is this new?

ComputerGuru 14 hours ago

0% APR for 12 months (24 for iPhones only?) from Apple Financial Services for a device that can approach or even exceed what we were paying for new cars just a few years ago. Apple is definitely making bank off these financing offers, and with very little risk as unlike a car these Mac Studios don’t lose 20% of their value when you drive them off the lot.

Interesting times, to say the least!

stasomatic 6 hours ago

Are you sayin 0% is bad? What is better then? If you have the means, pay outright, no? It used to be a lot worse, paying $16K+ for a 128MB Quadra something based RIP in mid nineties . Do you mean that these things are overpriced from the get go?

ComputerGuru 6 hours ago

I am merely pointing out additional revenue streams for Apple here. They make money off the hardware and again off the financing. Car manufacturers and have much lower margins and finance via their financial arms with much less predatory terms than your average credit card. The zero percent APR is very attractive, and easy to convince yourself to go with something above what you can afford. Times are good for Apple.

stasomatic 5 hours ago

zimzam 14 hours ago

How are they "making bank" by giving out 0% loans?

ComputerGuru 14 hours ago

My friend, the same way everyone else does. It goes from 0% to 28% interest when you miss a payment. Those are rates normal lenders fall asleep dreaming of.

throwfaraway135 11 hours ago

"M6 features a powerful, larger 12-core GPU that provides higher geometry rates and updated Dynamic Caching to deliver stunning visuals and fluid frame rates in demanding games like Mixtape."

Why choose the worst game of the year? Just because it's made by the daughter of Larry Ellison?

kridsdale1 11 hours ago

Just the other day I mentioned how odd it was that Mixtape felt just like AI-Art. At first glance it has great visual style and seems cool. But spend more than 5 minutes with it and you’ll agree there’s nothing there. It has zero ART inside. It’s one hundred percent vibes.

I’m not claiming this title was made by GenAI. I’m saying something much more insulting: that the human artists who made it have no talent.

JauntyHatAngle 11 hours ago

Whether or not you don't like the game, it's a weird misrepresentation to say it's made by Megan ellison.

She's been the co-founder and major backer of Annapurna for a decade.

She's not a developer, she's a publisher, and this game is one of the tons of games Annapurna has put out over a decade.

I get that Annapurna is a lightning rod of politics due to ellison and is increasingly under scrutiny for many debates but they are a mainstay of the industry, hardly a blow in, and like it or not, a lot of the games industry and media really like these kinda of artistic pieces, with this being yet another instance of the age old walking simulator debate.

It should be judged on its own merits. Not it's Annapurna link and it's not a shock to see it come up in an artsy Apple Mac hipster circle.

chmod775 10 hours ago

Despite all the exposure the game has gotten, it currently has less online players[1] than games like "Tennis Elbow 4"[2] (by a factor of 4).

It's not even in the top 5000, because it is objectively terrible. People would rather play the original Life is Strange one more time (despite a remaster being out), than play this game.

At some point you really have to start getting suspicious why it keeps coming up.

The number of reviews vs. number of actual players online doesn't make sense when compared to peers in its genre either. It has a similar number of reviews as Life is Strange Remastered, but it loses to the 4 years old re-release of an 11 years old story-based game by an order of magnitude. For a genre that that has extremely top-heavy player count charts this doesn't make sense.

Funnily enough Life is Strange Remastered had a bit of a revival around that game's release, probably because people decided they'd rather play LiS.

Entertainment media entertaining nobody is just objectively bad at its job and the blatant astroturfing and nepo-baby-pampering adds an unsavory dimension to it.

1: https://steamcharts.com/app/2582320

2: https://steamcharts.com/app/760640

JauntyHatAngle 9 hours ago

tshaddox 11 hours ago

I've never heard of Mixtape, but I'm surprised to see such a weirdly contemptuous post about a video game get so much traction on HN. At a glance, critical review aggregators are showing 80+ on this game. Is there some drama or culture war issue here that I'm missing?

boobsbr 11 hours ago

It's not a game, think of it as a long FMV sequence which barely requires any input at all through it all, except in one quicktime event.

tshaddox 11 hours ago

wilg 10 hours ago

Yes, it's a culture war thing and the commenters here are participating in it: https://www.pcgamer.com/games/adventure/mixtape-is-at-the-ce...

tshaddox 10 hours ago

docmars 11 hours ago

That's pretty embarrassing. It's such a poor representation of gaming. I'm surprised anyone is still talking about it.

SockThief 11 hours ago

Well, there's 24 people still playing it now on Steam

dprkh 11 hours ago

bigyabai 11 hours ago

It would have been funny to see Tomb Raider return for it's 12th annual performance comparison in a 2026 Apple keynote.

rxyz 11 hours ago

FuckButtons 15 hours ago

~12k for 80 core gpu with 256gb, 14k in October for 512gb. Seems like that could make for a very descent on prem inference server.

SXX 15 hours ago

It cant be 14k for 512GB because 96 -> 256 upgrade alone cost $4000

TimByte 15 hours ago

Gonna go sell a kidney, should just about cover a base Mac Studio. Guess I'll need a payday loan for the power cable

Jskewel 12 hours ago

The M6 is useless for AI. Is there any model which is actually useful and fast on 32GB?

bottlepalm 6 hours ago

My jaw dropped, not even a 64GB option, 128 would have been nice. 32 is an insult.

dabeeeenster 12 hours ago

Qwen3.8

Jskewel 7 hours ago

Not nearly fast enough on 32GB, would like to be wrong though.

siavosh 11 hours ago

What's everyones recommendation for one to run a good local LLM model on?

manmal 11 hours ago

1-2 RTX5090 will be better value than Macs because they have the memory bandwidth for somewhat fast local inference.

bigyabai 11 hours ago

If you don't want to wait for prefill, you're going to want a CUDA dGPU system.

maestroquirk 8 hours ago

Will forever miss the 499$ mac mini!

walrus01 15 hours ago

If I compare to like, January 2024, the prices for RAM these days make me want to weep.

r0fl 15 hours ago

Maxed out Studio is $30,000+ tax in Canada if financed through Apple.

That's wild!

brianwawok 15 hours ago

The storage is pretty silly. Bring that down and the max isn’t nearly as bad, more like 12k

stuff4ben 15 hours ago

M5 Pro in a Mac Mini with 64GB RAM and 10Gbit Ethernet seems like the perfect Jellyfin server and Ollama test server. All for just over $3K (I specced with only 1TB local nvme).

paxys 15 hours ago

Probably worth it for Ollama but you can run Jellyfin off a raspberry pi.

al_borland 15 hours ago

> you can run Jellyfin off a raspberry pi.

This may depend on the size of your library. I tried installing Jellyfin on a Synology NAS, which runs Plex just fine, and it ran so poorly it was basically unusable. It “worked”, but it was painful.

Keyframe 14 hours ago

doublepg23 12 hours ago

Yeah, if you're transcoding for clients a lot I'd just spend the cash on upgrading the clients to support HEVC at minimum.

stuff4ben 15 hours ago

True re: the Raspberry Pi, but I was thinking the 10Gbit Ethernet would allow more concurrent streaming in my household. But it's probably overkill.

AndroTux 12 hours ago

stasomatic 6 hours ago

Can't say about Ollama but my 2017 Intel NUC 32 GB runs all of the arr and fin stack while it's idling, swimmingly.

anigbrowl 10 hours ago

Hmm, I was about to get a MBP with an older Max chip, guess I should wait for prices to slide a bit.

neverrroot 15 hours ago

Wouldn’t it be amazing for Apple to give us a MacBook Air 15” M6 with a 15W sustained passive TDP capability?

Just amazing engineering push, the competition got the message and we benefit.

Artgor 15 hours ago

I have Mac M1 Max and I'm quite happy with it. But these advances make me think that maybe I should upgrade to Mac M6 (or something) when it is released.

chknkachunga 8 hours ago

My m2 max is still running strong, but may upgrade soon

thomasfl 11 hours ago

This fits neatly in the backpack with the MacBook Pro, if I need more compute power.

mixtureoftakes 10 hours ago

cool but maybe i was expecting much more from both m5 ultra and the next gen so it feels somewhat underwhelming. Hopefully m6 max is more than just a 10% improvement over m5 max

bilsbie 12 hours ago

Is this the best bet for running local AI now? The choices are overwhelming.

madduci 14 hours ago

A Macbook Neo with an M6 and 16 GB RAM at $699/€699 would be a killer feat

tester756 15 hours ago

When will Apple's Mx CPUs use Intel's 18A/18A-P/14A node(s)?

etempleton 15 hours ago

Maybe in a year or so or maybe never. It depends on how 14a turns out and if it is comparable to TSMC 2NM. They may also choose to utilize 18a-p / 14a for other chips and not the M-series.

diebillionaires 7 hours ago

i wish i could use their hardware, but i refuse their software

jbverschoor 12 hours ago

Very well timed for John Ternus's first quarter.

shafkathullah 14 hours ago

Saw a 768GB RAM mac coming soon, would wait for that.

knollimar 5 hours ago

Saw like a leak or just speculation?

chmod775 10 hours ago

How much did Larry Ellison pay to have his daughter's pet video game project featured on there?

coverband 5 hours ago

I'm so disappointed with the memory pricing we have to endure... MacStudio M5 Pro is $2,499 base with 36GB RAM, but when you increase it to 256GB, the price jumps to $9,499!!!

lvl155 13 hours ago

Every time Intel/AMD gets close enough, Apple just crushes competition in terms of SoC. I don’t know who’s on that chip team but they’re world-class. Hope they get paid more than a bunch of AI idiots Meta hired to do absolutely nothing (but I know they are not even close).

notenlish 14 hours ago

When is the m6 air coming though

calf 11 hours ago

So I had just bought from Amazon in July an M4 mini, brand new, for a lucky post-hike price of 832 CA$ (682 USD); it was the very last unit at that price and I snatched it the morning it listed on the Apple/Amazon.ca official vendor. So far I've been using it for a month and it's been great (switching back from a Windows desktop for a decade).

Today I entered this new M4 mini's serial as a trade in for the M6 base mini, and the retail price went from $1249 CAD to $824 "once trade-in received". That's the automatic estimate, so basically I'd be paying twice for an upgrade...

jambalaya8 11 hours ago

Super psyched for the upcoming Mac Mini. Maybe the old NUC can be tossed.

FpUser 12 hours ago

Call me when Linux will be officially supported. After that I can look and see what else can I get for the price and maybe then ...

ciupicri 15 hours ago

> M6 supports up to 32GB of unified memory to multitask across demanding apps

I can't believe that Apple still comes with this bullshit like 32 GBs is a lot. It's a lot for video memory - vRAM, but not RAM.

al_borland 13 hours ago

The M6 is a base level chip, for normal users. Anyone needing more than 32GB of RAM is likely going with higher end chip that supports more RAM.

ciupicri 7 hours ago

I can accept the fact that something is low level, but don't present it like it's high level.

tomcatawk 10 hours ago

Apple is a terrible company through and through that should have been broken up million years ago. But, nobody dares to question apple.

My 2019 macbook pro recently started giving me CATERR errors. There are a few forums and LLMs tell me it is logic board. I took it to Best Buy - a location suggested by apple support and they say we could replace battery but there is no guaranteee it will work. Logic board replacement would be $600 to $800. Unfortunately, only Apple can repair it given how every component is integrated and soldered. There is no help available from Apple support or anyone on this issue.

Apple creates "Planned Obsolescence" deliberately. Every year they launch new products with minor improvements and that basically distorts markets. There is MEGA scalping going on for Mac Mini but Apple does not care. As a trillion dollar corporation seeking profits Apple does nothing to help price gauging. Unfortunately, there is no competition. Microsoft is 10x deep into its own issues.

I wish we had startups who came up with strong competition for Apple.

stasomatic 6 hours ago

My 2019 macbook pro recently started giving me CATERR errors.

It's a seven year old laptop. Did you want to be buried with it? All in good humor, my guy, only wondering about your expectations. The error seems to be Intel related, Apple is the manufacturer, but you are out of warranty. What is your issue?

m3kw9 14 hours ago

yesterday someone posted a link saying xiaomi "matched" apple's latest M series performance. Was that for less than 24 hours?

LoganDark 15 hours ago

Is Apple just going to announce everything silently from now on? No more getting excited for the big events to see what's new -- it just appears on the blog one day?

Also: "a staggering 1.2TB/s of unified memory bandwidth" -- yay, the GPU has reached the year 2020! (I'm a bit bitter that my M4 Max is near useless for local LLMs because of its low memory bandwidth.)

wmf 12 hours ago

I assume they'll have events for the MacBook Ultra and M7.

LoganDark 5 hours ago

I'm getting kind of tired of them announcing the base level chip and then waiting forever to release the more powerful versions. I'm also pretty upset that it's unlikely to change now that they've found it's good for business. Like releasing only the base level iPhones first.

amazingamazing 15 hours ago

I should have bought a 100 m4 mac minis when I had the chance. Thanks hyperscalers for buying all the supply and renting it back.

A m4 mac mini is better than al of these per dollar, msrp adjusted.

Hopefully by the end of the decade China figures out manufacturing at scale and fixes this.

j45 15 hours ago

How much ram would each of those have 100 had?

amazingamazing 15 hours ago

16gb unified

AbsurdCensor 13 hours ago

j45 8 hours ago

tw1984 15 hours ago

will be great fun if one M5 Ultra with 512GB memory at 1.2T bandwidth capable of doing 3x smallish local model inferencing each at Opus 4.5 level of intelligence.

brianwawok 14 hours ago

The memory bandwidth and size seems to be there, but what is the tokens per sec on like a qwen model? And you can basically do 3x opus 4.5 on the $100 a month claude plan. Your payback will be near infinity years after electricity.

tw1984 5 hours ago

you are assuming the idea, the data, the code being touched by opus worths nothing.

how about measuring returns in the sense that I no longer need to share my flagship idea with some random 3rd party just because it hosts the LLM I am using?

hn0tdqaek4 14 hours ago

Well said

rvz 15 hours ago

> M5 Ultra features a massive amount of high-bandwidth unified memory, up to 512GB, and delivers a staggering 1.2TB/s of unified memory bandwidth that is 50 percent higher than M3 Ultra.

Apple never needed to participate in the AI race to zero. Because they were already at the finish line years ago building their own chips that can run large >100B parameter AI models locally.

nasaeclipse 15 hours ago

As someone who works in AI now, I have found it pretty amazing that Apple basically didn't do much with AI software, and focused more on the hardware side. I think this is what the future of AI is going to look like, local models run on your mac for your workflow.

It's possible that they're working on their own LLM that's going to work very well on their chips, and possibly outperform anything out there when they do release it.

compounding_it 15 hours ago

>local models run on your mac for your workflow.

10 years ago 32GB ram laptops sounded too much. 8 was enough. These days even I would get that much ram since it’s soldered. 64GB is higher end.

In a few years we should see such high end hardware commonplace. Working with a local LLM to get work done is the ideal way to go which has mostly hardware limitation as of now that gets solved in due time.

parineum 15 hours ago

llm_nerd 15 hours ago

>I have found it pretty amazing that Apple basically didn't do much with AI software

The iPhone 15 was almost entirely marketed based upon AI (I would say fraudulently so, advertising features they still haven't delivered), and a huge portion of the OS work was on local AI or AI integration.

And for that matter Apple has been dumping enormous sums into their own AI development. Their failure to have a lot to show for it doesn't void the fact that they tried really, really hard.

It's bizarre how often this "Apple sat on the sidelines and let the AI people fight...so smart!" narrative appears on HN. Apple hasn't gone down the path of spending hundreds of billions on nvidia GPU data centres, but they absolutely tried really hard to matter in AI.

givinguflac 15 hours ago

|It's possible that they're working on their own LLM

Yep, Siri AI; they’re doing it in public.

robotresearcher 14 hours ago

ngvrnd 15 hours ago

nth mover advantage.

Havoc 12 hours ago

LeBit 15 hours ago

1.2TB/s is 2/3 the speed of an nVidia 5090.

But you get a generic computer and much more RAM.

And you lose a couple of organs.

bel8 15 hours ago

The real downside for me is not having Linux support.

It would take Apple one or two engineers to make Linux life much easier on macs. But Linux is outside their walled garden so it's ignored.

3form 13 hours ago

LeBit 15 hours ago

mhast 14 hours ago

It's worth noting that the 5090 (or the RTX Pro 6000 big brother with 92GB VRAM) will run rings around the Mac when it comes to compute.

My old 3090 is typically significantly faster (almost 2x token/s) than my M4 Max 128GB machine, as long as the model fits in the 24GB of VRAM.

In most situations it's a better idea to just buy tokens. But there are definitely cases when that's not an option. And then a machine like the M5 Ultra can allow you to do things locally for a fairly limited budget. And in a simpler package to manage than a machine with multiple GPUs.

snapcaster 15 hours ago

is it still effectively 2/3rds? Don't know enough to compare a discrete GPU/CPU setup to something like this where it's more integrated

danielEM 15 hours ago

noodletheworld 15 hours ago

How much memory does that come with?

rbinv 15 hours ago

jjice 15 hours ago

I was so blown away at all the discourse surrounding "Apple fumbling on models". They should never have been in the model game to begin with. Apple crushes hardware over the last decade and that's a huge advantage today. In the end, massive models have proven to be very strong, but small models have proven to be good enough (especially with the recent Qwen 2.8 27B drop) and that's where I imagine the future will lie for consumers.

chasd00 15 hours ago

I suspected Apple would let everyone else blow all their money then, when the dust settles, deliver a better experience to end users and clean up.

jjice 15 hours ago

dgellow 15 hours ago

They did participate early on with Apple Intelligence and failed miserably. Really good move to not double down and let the others explore the space first

teekert 15 hours ago

Is there anything comparable that runs Linux, doesn't necessarily look as good, but is perhaps (a lot) cheaper/fixable? Or is this really pretty optimal?

I mean this is not nvidia based right? It's all custom? So we can use it under Asahi perhaps?

I want to get something for my company to run local models, wondering what would be a good option.

datakan 15 hours ago

I love linux and would be using it if the ARM support was better. It's just not there and most distros that support ARM do it a little poorly. I just haven't seen anything even remotely comparable to Apple Silicon and unfortunately Linux is struggling very hard to support it.

Marsymars 13 hours ago

jlokier 14 hours ago

You can't run Linux directly on these. Asahi Linux supports up to M2 only.

Linux runs very well in a VM on macOS. There are many good options for this, some free and open source (QEMU, UTM, Lima, Colima), some proprietary (VMware Fusion, Parallels).

But Linux in a VM doesn't get access to the real GPU, so model performance is limited. Those running on the CPU perform well, and those needing the GPU don't.

However, macOS on M-series macs is excellent for local models. (Maybe not as excellent as a box full of the best nVidia GPUs, but still excellent).

So if you're getting Apple hardware, like Linux, and want to run all of it locally, a fine setup for a machine to run local models, with agentic characteristics:

- macOS running one of the many local model runners. I used to use Ollama and Whisper, and now use llama.cpp instead of Ollama. Others use LM Studio, oMLX, etc. Provide HTTP endpoints to access the models.

- Linux in a VM for overall control and orchestration, with standard VM settings, and bridged networking so it appears as its own machine on your network. Also, in here provide a robust shared file server for shared state. Use this VM as your desktop and primary access to the machine, if you like Linux.

- Linux in a VM to launch ephemeral, volatile containers, with the containers using a memory-only tmpfs overlay on top of a read-only Linux filesystem in a VM disk image, with tools in this filesystem. Alternatively, a writable Linux filesystem in a VM disk image, with disk buffering set to use macOS host buffering and discard fsync requests. These settings optimise for container disk performance for data that's only ephemeral which will be deleted soon or on system shutdown. (You can combined both VMs, but need to use two VM disks to get equivalent behaviour, and be careful about VM disk configuration of the two disks.)

- Containers spawned within that second Linux VM can be spawned very quickly and run quickly, so are ideal for LLM agents that need a quick sandbox. These sandboxes generally run faster than a macOS sandbox, despite being on the same machine with VM overhead, because Linux is faster at some things. Teach the LLMs to store files and memories they want to keep in the shared file server.

teekert 15 hours ago

I guess, what I mean is: Why are these tiny aluminum boxes so optimal?

I just want my butt ugly repairable beast machine to do the same trick. Why is my ram not unified? I have an iGPU in my server, but it can't access the 64 GB ram (I got last year for 150 euro) directly or something? It's on the CPU right? Why did only Apple go for this architecture? So many questions...

Lunar5227 15 hours ago

Strix platform maybe?

mhast 14 hours ago

intelkishan 15 hours ago

Asahi was stuck at M3 last time I checked it out.

notenlish 14 hours ago

rowanG077 14 hours ago

terminalcommand 15 hours ago

AFAIK, apple does not release drivers open source, asahi is a reverse-engineering endeavour and does not support GPU. For nvidia, there are both proprietary and open-source linux drivers. CUDA and inference works on linux with nvidia. I would recommend checking out this video of Alex Ziskind to shop for a computer to run local LLMs: https://www.youtube.com/watch?v=mevUEQcumzU&t=224s. TL;DR besides Apple he recommends, DGX Spark, Tenstorrent Wormhole N300, AMD Radeon 7900 and NVIDIA RTX 5090.

rtaylorgarlock 11 hours ago

"hacker news"

znpy 9 hours ago

I wonder why they even bothered with m5 ultra instead of going m6 ultra directly, honestly.

What’s the point?

bottlepalm 5 hours ago

Yield probably.

xyst 10 hours ago

Now if only I can natively run Linux on their hardware.

cute_boi 15 hours ago

> Apple’s developer frameworks and tools — including Core AI, Core ML, Metal, and Xcode

Can we please kill the xcode. It is worst pile of garbage I have to use just to develop ios app.

hyperbovine 9 hours ago

This is why so many iOS apps these days are based on Electron/Capacitor/React Native/etc.

blueTiger33 14 hours ago

fucking awesome

trompetenaccoun 5 hours ago

>up to 1.2x faster multithreaded performance as compared to M5

Massive. I feared it would only be up to 1x the speed of an M5 /s

coldtea 15 hours ago

>M6 supports up to 32GB of unified memory

Is this a joke?

>Additionally, M5 Ultra features a massive amount of high-bandwidth unified memory, up to 512GB

Now we're talking. But at what cost?

arcatech 15 hours ago

The Pro and Ultra variants are the ones with the higher RAM amounts. They didn’t announce the M6 Pro yet.

coldtea 15 hours ago

Yeah, but they still write regarding plain M6:

"M6 also introduces a Dual 16-core Neural Engine, providing up to 2x the peak compute over previous generations to make on-device AI workflows run even faster" .

kjs3 14 hours ago

They've announced there won't be a M6 Pro in favor of getting M7 out the door.

brianwawok 14 hours ago

At the price points they are hitting, can’t afford over 32 GB on the cheaper model.

256 memory gets you to like 11k. So like 15-20k.

varispeed 15 hours ago

512GB late october sounds lame.

and 512GB is so 2025.

Give us 1TB version. Where is the competitive spirit?

rrgok 15 hours ago

Yeah, for developers it should be 128GB base version.

bilbo0s 14 hours ago

>Where is the competitive spirit?

To be fair, where is the competitor at this form factor?

varispeed 10 hours ago

Xiaomi is coming. Hopefully they'll make 1TB box.

nonewideas 15 hours ago

Cannot believe "moar transistors" is still the only idea they have.

simlevesque 15 hours ago

They pionneered unified memory a few years ago.

artisin 14 hours ago

No. Apple did not invent or pioneer the concept of unified or shared memory, but they did create an exceptional implementation of it.

bigfishrunning 10 hours ago

GreenLightGo 15 hours ago

From what I’ve noticed, Apple products have been getting worse in quality year after year. Sometimes they even ruin their own devices with updates... I guess it’s all because of marketing.

LeoPanthera 14 hours ago

Extraordinary claims require extraordinary evidence.

GreenLightGo 14 hours ago

I’m mostly talking about their iPhones, where new updates sometimes make older models worse. I know a lot of people whose iPhones started lagging after iOS updates.

delduca 15 hours ago

I know they are a phone company, but I think they should focus on local models software, not only hardware.

kksweet 15 hours ago

They aren't a phone company, and haven't been ever. They're a hardware company first

flyingjoe 15 hours ago

More like an "ecosystem company".

It's the Hardware, Software and Services in combination. None would work without the other (to reach the scale apple is)

dosisking 15 hours ago

> They're a hardware company first

More specifically, they're a hardware dongle company first

Matl 15 hours ago

Software wise there's plenty to choose from already. Ollama/llama.cpp, LM Studio, Lemonade, vllm etc. Anything Apple would bring to the table?

evilduck 15 hours ago

Maybe https://mlx-framework.org

FWIW, Ollama, LM Studio and Lemonade (and oMLX) also wrap Apple's MLX framework.

mleo 15 hours ago

Apple has the mlx framework. Most/all major software for running models locally support it. Apple also has RDMA for interconnecting multiple machines across Thunderbolt connections.

rrgok 15 hours ago

False, they are a Marketing Company.

micromacrofoot 15 hours ago

their strength has been hardware for over 30 years now

givinguflac 15 hours ago

Uhhh, they are? They’re a hardware co for sure, but to say they aren’t focusing on on-device models is absurd on its face. They’ve spent over 2 years on Siri AI which is (mostly) local.

wookmaster 15 hours ago

My 100k company only buys Mac laptops and you're calling them a phone company. Such an odd comment.