Show HN: GEITje-7B – A New Large Open Dutch Language Model https://ift.tt/W1HsYdy

Show HN: GEITje-7B – A New Large Open Dutch Language Model Tried my hand at training a large open Dutch language model, for which the pickings are slim right now. GEITje is a large open Dutch language model with 7 billion parameters, based on Mistral 7B. I've continued pretraining it on 10 billion tokens of Dutch text. This has improved its Dutch language skills and increased its knowledge of Dutch topics. There's an experimental chat-finetuned model too, called GEITje-chat. I have to say the experience of gathering a dataset and training a model has been very educational for me. Being forced to deal with every detail yourself really deepens your understanding of a subject. It's all in the hands of the community now. Can't wait to see what they do with it! Want to try it out? There's a demo live at Hugging Face Spaces right now: https://ift.tt/QTVf1LY https://ift.tt/rXDldwB December 15, 2023 at 11:55PM

Komentar

Posting Komentar

Postingan populer dari blog ini

Youth Voices for Vision Zero SF

Gambar
Youth Voices for Vision Zero SF By Christine Osorio Starting in the month of February, Muni buses and transit shelters will feature youth artwork illustrating Vision Zero traffic safety messages. The students are part of Youth Art Exchange (YAX), an arts-education non-profit based whose mission is to support San Francisco’s public high school students in becoming leaders, thinkers, and artists by sharing creative practices with professional artists. As part of Supervisor Norman Yee’s District 7 participatory budget process, YAX students consulted with SFMTA staff to develop traffic safety messages and artwork that reflect their experiences around traffic safety. Themes highlighted through Youth Voices for Vision Zero SF include general traffic safety such as: Yielding to pedestrians in the crosswalk. Slowing down. Understanding that traffic deaths are preventable. Watching for people biking. Not blocking the sidewalk with a scooter. The student artwork also included Covid-...
Baca selengkapnya

Tracks in the Sky: Overhead Lines Then and Now

Gambar
Tracks in the Sky: Overhead Lines Then and Now By Jeremy Menzies After telling you about the Track Department through the years , this month we take a look back at the Overhead Line Department. The focus of this group is to maintain our “tracks in the sky” which provide electric power to the LRVs, historic streetcars and trolley buses that are critical to keeping San Francisco moving.  SF Municipal Railway Tower Truck No. 1 on Van Ness Avenue circa 1917.  The earliest overhead transit power lines were built for San Francisco’s first electric streetcar line, which opened in 1892. As more electric streetcar lines came into service over the years, the electric grid above them expanded into a complex network requiring more power and more maintenance. Within 20 years, electric streetcars provided nearly all transit in the city.  A complicated overhead line operation at Bryant and Alameda, 1951. The building on the right- built as a power generating plant in 1893 -was ...
Baca selengkapnya

Show HN: Thread – AI-powered Jupyter Notebook built using React https://ift.tt/vy2PWqS

Show HN: Thread – AI-powered Jupyter Notebook built using React Hey HN, we're building Thread ( https://thread.dev/ ) an open-source Jupyter Notebook that has a bunch of AI features built in. The easiest way to think of Thread is if the chat interface of OpenAI code interpreter was fused into a Jupyter Notebook development environment where you could still edit code or re-run cells. To check it out, you can see a video demo here: https://www.youtube.com/watch?v=Jq1_eoO6w-c We initially got the idea when building Vizly ( https://vizly.fyi/ ) a tool that lets non-technical users ask questions from their data. While Vizly is powerful at performing data transformations, as engineers, we often felt that natural language didn't give us enough freedom to edit the code that was generated or to explore the data further for ourselves. That is what gave us the inspiration to start Thread. We made Thread a pip package (`pip install thread-dev`) because we wanted to make Thread as easily ac...
Baca selengkapnya