MTPLX is a free Mac app and CLI that runs Inkling 2 Mini and Qwen 3.8 locally with native MTP speculative decoding. It reaches up to 128 tok/s on an M5 Max and serves an OpenAI- and Anthropic-compatible API.

Youssof Al Toukhi
6.8K 160 7 13 7h ago