So AMD is introducing new CPUs with NPUs, aka Ryzen AI, for inferencing, but only for some of the lineup, making Ryzen AI even less relevant.

Not to mention that AMD comes up with new HW that nobody knows how to use, that no SW exists for, and...

Oh, wait. Making AI capable HW while completely failing on the SW side. Now it makes sense. It's just AMD being AMD.

So I search :"AI AMD github" and found this:

https://github.com/amd/...

Looks brand new. I wonder if they are working with OS vendors to provide APIs for this.

@Demolishun That's the point. They still havn't understood that software is not an afterthought, it is part of the fucking product.

By the time AMD manages to get any useful AI software running, if at all (given AMD's track record), the NPUs that they released now will be outdated and useless anyway.

Following for interest

rockchip ARM devices have "neural acceleration units" as well but they can't run standard formats, they have to be converted and you have to use a 4 year old pytensor build to run them. no support by a company that tends to embrace open source software is far better than shitass support by a company that has to distribute protected RAM init blobs and custom u-boot trees to run an OS at all because they can't see the difference between a git repo and tofu dregs.

my guess is AMD may also put support for these cores into their rocm torch builds, which require installing kernel modules with dkms anyway if you follow their official install steps. they usually have support for, or at least leak testing logs for, any new hardware long before release, so it is weird that it's not already in the kernel yet...