| Rated ↓ Article |
|---|
My thousand dollar iPhone can't do mathTL;DR: My iPhone 16 Pro Max produces garbage output when running MLX LLMs. An iPhone 15 Pro runs the same code perfectly. A MacBook Pro also runs the same code perfectly. The tensor outputs on the 16 show numerical values an order of magnitude wrong. I suspect it points to a hardware defect in the Neural Engine or some other ML-needed system. It was a PITA to debug, but at least I got a blog post out of it. How did I get there? This was supposed to be a simple, unwinding-time project. For 2026-1-28 12:52am Rafael's Journal Rafael Costa 2,000 words Rated 2026-2-2 7:58am - sethherr
|