Show HN: Chrome extension to run DeepSeek, LLMs and Whisper locally in browser https://ift.tt/ELoyA8w

Show HN: Chrome extension to run DeepSeek, LLMs and Whisper locally in browser Hi all, I open sourced my toy project that runs Generative AI models LOCALLY in the side panel of a Chrome extension. The Chrome extension uses Transformers.js to run models in browser under the hood. I've integrated and tested these models so far. \1. LLM: Llama 3, Phi 3.5, Qwen 2.5, SmolLM2 \2. Reasoning: DeepSeek R1 \3. Multimodal LLM: Janus \4. Speech-to-Text: Whisper On an M1 MacBook, DeepSeek R1 1.5B runs at ~30 tokens/sec If you're interested in, you can download the extension from chrome web store or clone my github repository. \1. chrome web store: https://ift.tt/ukwZVpf... \2. github: https://ift.tt/sFu6txG \3. demo: https://www.youtube.com/watch?v=MSCDdFG5Lls It's my first react project. Feedback is always welcome! https://ift.tt/sFu6txG February 3, 2025 at 12:49AM

Komentar

Posting Komentar

Postingan populer dari blog ini

Twin Peaks for All: Survey Results

Gambar
Twin Peaks for All: Survey Results By Benjamin Barnett Last month, the SFMTA and San Francisco Recreation and Parks Department released a survey seeking public feedback regarding  five proposed roadway options for Twin Peaks Boulevard . San Franciscans responded to the survey, ranked support for each alternative and shared opinions about how the different options met their needs.  The Twin Peaks for All survey was open for almost three weeks and received more than 1,700 responses. This number reflects the high level of interest for this San Francisco park and its future access.   Survey Background Conditions on Twin Peaks Boulevard between Portola Drive and Barnett Avenue before COVID street closures.   The Twin Peaks Boulevard gates were closed early in the pandemic to reduce crowding at the lookout point parking lot. The gates were closed on the north, at Burnett Avenue, and the south, at Portola Drive. Since then, Twin Peaks Park use by hikers, joggers and peopl...
Baca selengkapnya

Launch HN: Riot (YC W20) – Phishing training for your team https://ift.tt/2QIueZL

Launch HN: Riot (YC W20) – Phishing training for your team Ahoy Hacker News! I'm Ben, founder of Riot ( https://tryriot.com ), a tool that sends phishing emails to your team to get them ready for real attacks. It's like a fire drill, but for cybersecurity. Prior to Riot, I was the co-founder and CTO of a fintech company operating hundred of millions of euros of transactions every year. We were under attack continuously. I was doing an hour-long security training once a year, but was always curious if my team was really ready for an attack. In fact, it kept me up at night thinking we were spending a lot of money on protecting our app, but none on preparing the employees for social engineering. So I started a side project at that previous company to test this out. On the first run, 9% of all the employees got scammed. I was pissed, but it convinced me we needed a better way to train employees for cybersecurity attacks. This is what grew into Riot. For now we are only training for...
Baca selengkapnya

Show HN: Guish – A GUI for constructing and executing Unix pipelines https://ift.tt/HrXz5ub

Show HN: Guish – A GUI for constructing and executing Unix pipelines guish is a dynamic data pipeline UI that allows users to visually construct and execute complex command-line pipelines. It provides an intuitive interface for chaining together various Unix commands and custom plugins, making it easier to build and understand data processing workflows. It also features optional LLM support for updating pipelines with a natural language interface. https://ift.tt/2lsA0r5 August 2, 2024 at 10:00PM
Baca selengkapnya