Show HN: I shrank DeepSeek V4 Flash to 57GB and it wrote a compiler on my Mac https://ift.tt/q2DJupl
Show HN: I shrank DeepSeek V4 Flash to 57GB and it wrote a compiler on my Mac I built a specialized package of DeepSeek V4 Flash 0731 (originally 284B total parameters, 13B active), preserving reasoning, tool calling and coding capabilities: https://ift.tt/oDj3zTs... I let it write a minimal C compiler targeting ARM64, then test the result with Fibonacci and FizzBuzz programs, and it succeeded in less than 1 hour, with the full recording at: https://youtu.be/XiwSilmV8B0 You can run it on Silicon Macs with my engine https://ift.tt/LApE8oI , while one of the core libraries developed to obtain this result is available at https://ift.tt/zQ6yYBK . The above recording was on a 128GB memory MacBook M3 Max, but you can also run it on 32GB MacBooks with a very usable context (128K tokens) and projected 5 tok/s. I did try it on a fanless 16GB memory MacBook Air M1 (1.39 tok/s), but unfortunately the available context was very small. How: - First, efficient quantisation: mlx-iqk takes advan...