Garlic LLM uses custom GPU kernels and 3-bit and 4-bit quantization to run a 9B AI model on PS4. The application also supports voice conversations and code generation.
As you know, we don’t usually cover AI model releases. We believe GPUs are better suited for gaming and rendering, but some projects still catch our interest. One example is a developer who managed t… [+2200 chars]