at the moment yes. The one possible silver lining with all of the current hardware crunch is that it _should_ force some hardware advancements. The last couple years hardware has been kinda boring. My m1max is still zippy as all hell and doesn't really need to be upgraded, unless I am committing to local AI inference.

I kinda assume phones are going to be battery powered for the foreseeable future. "Gaming" phones with better cooling do exist, but they are a tiny niche. Most local AI users will want to serve their inference needs through a very different kind of system.

Yes, but the battery tech itself is improving. We're already seeing new phones approach 8000 mAH internal batteries, which is large enough that you can splurge on compute and still have some left over at the end of the day.

> it _should_ force some hardware advancements

I'm very curious what kind of hardware advancements you're imagining. Because we're already kind of near a physical wall regarding heat dissipation on phones.

I mean hey, maybe foundational physics will surprise the world with a radical breakthrough that disappears heat into a black hole or something, but I sure wouldn't hold my breath

More likely it would force software advancements. Current models are horribly inefficient.

eGPU cradles, presumably, for people with intense local model execution requirements until it can be made to work in the device? This is exactly like the POS dongles Square had until tap to pay was more widespread?

Launch everyone's phones into space.

Heat dissipation is even harder in space

water cooled pant pockets

The iPant? Or a Samsung WCPP1?

It is three years old, but maybe they are just being the foundry like this article? https://www.pcmag.com/news/intels-foundry-business-strikes-d...

I'd love to see this in oMLX too. It has been a rather nice tool

It it was a startup, sure, I'd feel for them. This is Microsoft though. They have the money and resources

I should say that I don't feel for the business. The SRE's and admins though I certainly do

There is a link to the repo to verify the code and explain their process

This is 100% AI's fault. It is a mix of more commits coming in, most likely code quality degradation, and I would not be surprised if capex that could be used to help with load is going towards AI instead

Because my corporate overlord does

i have a lot of sway over what git+cicd system my corporate overlord uses. As I am very Github alternative curious right now, if anyone is pushing alternative git+cicd stack, I want to hear it.

Not only that but Zig was working on a similar improvement to their change already

meanwhile I've just started learning it after being in the GUI for decades

It really has been infuriating lately. Between this and my company's proxy screwing with HTTP/2 at least once a day the frustration is very very real. While I'm nowhere as invested in GitHub its decline does make me sad.