| Rated↓ Article |
|---|
My thousand dollar iPhone can't do mathTL;DR: My iPhone 16 Pro Max produces garbage output when running MLX LLMs. An iPhone 15 Pro runs the same code perfectly. A MacBook Pro also runs the same code perfectly. The tensor outputs on the 16 show numerical values an order of magnitude wrong. I suspect it points to a hardware defect in the Neural Engine or some other ML-needed system. It was a PITA to debug, but at least I got a blog post out of it. How did I get there? This was supposed to be a simple, unwinding-time project. For 2026-01-28T00:52:11-0800 Rafael's Journal Rafael Costa 2,000 words Rated 2026-02-02T07:58:32-0800 - sethherr
|