Show HN: Crawlee Cloud Self-hosted platform for running Crawlee and Apify actor https://ift.tt/XOejHfb

Show HN: Crawlee Cloud Self-hosted platform for running Crawlee and Apify actor Hey HN, I built Crawlee Cloud, an open-source, self-hosted platform that lets you run Crawlee and Apify Actors on your own infrastructure. The problem: The Apify ecosystem (Crawlee, SDK, Actors) is fantastic for web scraping, but it's tied to their cloud. If you want to keep your data on-prem, run on your own servers, or save on costs at scale, you're stuck. The solution: Crawlee Cloud implements Apify's REST API so your existing Actors work without code changes. Just point APIFY_API_BASE_URL to your own server. What's included: SDK compatible: Datasets, Key-Value Stores, Request Queues all work Docker-based: Each Actor runs in an isolated container Dashboard: Monitor runs, explore datasets, manage Actors CLI: Push, run, and manage Actors from your terminal Stack: Node.js, Fastify, PostgreSQL, Redis, S3/MinIO, Next.js GitHub: https://ift.tt/JRtKbHo Happy to answer questions! https://crawlee.cloud December 26, 2025 at 10:07PM

Komentar

Posting Komentar

Postingan populer dari blog ini

Show HN: Guish – A GUI for constructing and executing Unix pipelines https://ift.tt/HrXz5ub

Show HN: Guish – A GUI for constructing and executing Unix pipelines guish is a dynamic data pipeline UI that allows users to visually construct and execute complex command-line pipelines. It provides an intuitive interface for chaining together various Unix commands and custom plugins, making it easier to build and understand data processing workflows. It also features optional LLM support for updating pipelines with a natural language interface. https://ift.tt/2lsA0r5 August 2, 2024 at 10:00PM
Baca selengkapnya

Twin Peaks for All: Survey Results

Gambar
Twin Peaks for All: Survey Results By Benjamin Barnett Last month, the SFMTA and San Francisco Recreation and Parks Department released a survey seeking public feedback regarding  five proposed roadway options for Twin Peaks Boulevard . San Franciscans responded to the survey, ranked support for each alternative and shared opinions about how the different options met their needs.  The Twin Peaks for All survey was open for almost three weeks and received more than 1,700 responses. This number reflects the high level of interest for this San Francisco park and its future access.   Survey Background Conditions on Twin Peaks Boulevard between Portola Drive and Barnett Avenue before COVID street closures.   The Twin Peaks Boulevard gates were closed early in the pandemic to reduce crowding at the lookout point parking lot. The gates were closed on the north, at Burnett Avenue, and the south, at Portola Drive. Since then, Twin Peaks Park use by hikers, joggers and peopl...
Baca selengkapnya

Taken with Transportation Podcast: For the Love of Muni

Taken with Transportation Podcast: For the Love of Muni By A light rail train displays the sentiment that we hear from scores of our riders. So many things make San Francisco unique and beloved, including the hills, the cool summers and the Golden Gate Bridge. You also can add our public transit system to that list. From buses to light rail lines to the iconic cable cars, residents and visitors alike love Muni. The latest episode of our Taken with Transportation podcast celebrates that love. Our customers embrace Muni In “For the Love of Muni,” riders discuss what the system means to them and how they express their appreciation. Artist Kurt... Published March 24, 2025 at 07:00AM https://ift.tt/zxrJwv9
Baca selengkapnya