AMD Ryzen AI NPUs can now run large language models through Unsloth Desktop. The demonstrated 35B model requires around 28GB of available NPU memory.
AMD has announced a collaboration with Unsloth to enable dedicated NPU acceleration in Unsloth Desktop. According to AMD, its XDNA 2 architecture is the first NPU architecture supported by the applic… [+1588 chars]