Benoit ClouetRunning llama3 on the GPU of a RK1 Turing PiLlama3 runs well on an ARM GPU thanks to mlc-ai’s (https://mlc.ai/) approach. Performance is still modest but definitely decent. And there…Apr 212Apr 212