Run Splash on M1 & M2 Macs 0 ▲ tinyapps.org 1 hour ago · Tech · hide · 0 comments Splash is making waves in LLM inference on Apple silicon: "It delivers 2× the decode speed of the next-fastest engine we measured on Qwen3.8-27B and stays ahead at every context length we tested, to 32K tokens. At four parallel subagents, the speedup increases to almost 4×." The official release requires M3 or newer, but Erik Paperniuk has backported Splash for M1 and M2 Macs: You can now run Qwen3.8-27B on a 2021 M1 Max at 39 tok/s: I ported Splash (M3+ only) and wrote custom Metal kernels Splash on M1, part 2: 35B-A3B at 144 tok/s on a 2021 M1 Max, plus a head-to-head with oMLX and MTPLX (speed, temperature, power, memory) Steps Install: curl -fsSL https://github.com/paperniuk/splash/releases/download/1.0.2-m1/install-m1.sh | sh Serve: splash-m1 serve --model incoai/Qwen3.8-27B-Splash (First run downloads the 17.4GB model package and prepares it for the GPU; later starts are much faster.) Chat at http://127.0.0.1:8000. To disable the chat page, add --no-webui to the command in step… No comments yet. Log in to reply on the Fediverse. Comments will appear here.