Show HN: GPTBanker – map/reduce over documents of any length with OpenAI https://ift.tt/2n7wF40

Show HN: GPTBanker – map/reduce over documents of any length with OpenAI Hi all! I created a app that can map/reduce over documents of an arbitrary length with OpenAI completions. You can enter in your OpenAI key and try it out. The backend is built with LangChain, which made it easy to manage the models, workflows (chains), and troubleshoot pipelines with buffer issues. Learnings: - Tokens was the most helpful key for calls rather than characters or words. LangChain also just implemented a token splitter, which made it easier for me to adapt to documents of any type. - Davinci performed much better than Curie for summarizing long documents over multiple chunks - Oftentimes a map step was the only thing needed and the reduce/combine introduced more errors instead of improving context. https://ift.tt/8P0zwqh February 5, 2023 at 12:07PM

Komentar

Postingan populer dari blog ini

Show HN: Interactive exercises for GNU grep, sed and awk https://ift.tt/OxeFwah

Show HN: Create demos & guides just with a simple prompt https://ift.tt/HfWo3mz