BlogViral

Show HN: Semantic Overlays – an NX bit for LLM prompt injection (live demo) I've built a new method for steering LLMs called Semantic Overlays, small trained adapters on a frozen model which change how it perceives a piece of its context. The most readily applicable usage is to mitigate prompt injection, and it lets us take a very-injectable Qwen-3.5-9B to SOTA scores on all the prompt injection benchmarks I could find. (They are only blackbox attacks, but I did NOT train on anything like them — whitebox attacks are out of scope for this paper) I'm excited for you to play with the tech — see if YOU can break it! (let me know if you can) Paper at https://ift.tt/lOJMxfq if you want to read more about it, code at https://ift.tt/lzQi5kc , adapters at https://ift.tt/xBkVXOe... Also https://ift.tt/7zmOEcl if you wanna watch a little video I made! https://semantic-overlays.vercel.app/ September 2, 2026 at 12:40AM

Celebrate Transit Month on Muni By Service improvements and increasing ridership numbers are making Transit Month even more joyful for us. Muni moves San Francisco all year long. But September is special because it’s Transit Month! We kicked things off this morning with a rally featuring Mayor Daniel Lurie and Director of Transportation Julie Kirschbaum on the steps of San Francisco City Hall. And we have a lot to celebrate this year: • A strong Muni ridership recovery that shows an increasing demand for public transit since COVID. Earlier this year, our weekend ridership surpassed pre-pandemic levels! • Service improvements... Published 2026-09-01T00:00:00Z https://ift.tt/Fhw0NsY

Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s I built slotstream, a way to run Qwen3.8-Flash-Next 4-bit on a low-memory mac starting from 16GB, a 125B parameter model that would need 100GB+ memory/RAM, thanks to expert-offloading/ssd-streaming. Easy to install/update, and mac-native using MLX and Swift. It ships with auto-mode, which makes a good tradeoff between memory usage and speed. I'll be implementing and porting the MTP module for speculative decoding next https://ift.tt/1z973fV September 1, 2026 at 11:42PM