Sipeed's new K3 RISC-V SBCs can run 30B-parameter LLMs at 10 tokens per second
…The company claims the X100 performs similarly to ARM's Cortex-A76 core. The K3 also offers 8 A100 AI matrix units with TCM (Tightly Coupled Memory) and supports up to 1024…
