Show HN: Ggml.js – Serverless AI Inference on Browser with Web Assembly https://ift.tt/WUPNh25

Show HN: Ggml.js – Serverless AI Inference on Browser with Web Assembly What is ggml.js? Run any ggml ported ML models directly on your web browser with ggml.js This project provides JavaScript bindings on ggml models, so that you can embed GGML models to your web apps to build serverless AI inferencing. Currently the framework supports following model types: - Dolly v2 - GPT2 - GPT J - GPT NEO X - MPT - Replit - StarCoder You can find more details about the framework: https://ift.tt/G0vIgax For live demo examples, you can visit here: https://ift.tt/yWpxgXd Source Code: https://ift.tt/i5CL4n1 Please do provide any feedback/questions/suggestions in the comments. I'll be happy to take it up :) https://ift.tt/G0vIgax August 9, 2023 at 02:20AM

Komentar

Postingan populer dari blog ini

Show HN: Interactive exercises for GNU grep, sed and awk https://ift.tt/OxeFwah

Show HN: Create demos & guides just with a simple prompt https://ift.tt/HfWo3mz