Change log

Apify for developers

For sure, you already know our Developers’ portal, a place where you can go from beginner to expert scraper builder with the Web Scraping Academy, join our open-source community, and find information about earning money by building your own actors (no matter if you prefer to work on your own projects, as a freelancer, or be a part of a great team, all options are covered). You can now find it on it’s own domain: developers.apify.com.

Increasing plans limits

Eager to scrape more? We’ve got your back - the FREE plan now comes with 500 Search Engine Results Pages, and 0.5 GB of residential proxy traffic. Plus,the TEAM plan now has 128 GB of actor memory instead of 64 GB. Find out more on our pricing page.

Slack integration

In the last change log, we informed you about the Webhooks tab being renamed to Integrations due to integration diversification. We're excited to finally reveal our new Slack integration!

!Screenshot 2022-04-13 at 19.11.07.png

SDK 2.3.0 is out

This release should resolve the 0 concurrency bug 🐛 by automatically resetting the internal RequestQueue state after 5 minutes of inactivity.

Actor environment variables documentation

Actor environment variables have new documentation.

Developer portal launch

We are launching a new portal for developers with a comprehensive web scraping academy and more resources on robotic process automation (RPA) coming soon. Join us to learn new skills, become a part of our open-source community, and earn income from your personal projects.

Organization account improvements

We have redesigned our organization account UI to make it easier for you to distinguish between your personal account and organizations. This design refresh involves changes in the left-side menu, subscription management, and a couple of other components.

Store

• We extended Apify Store with 3 new categories for scrapers and web automation actors - real estate, sports, and education.

As our users' use cases become more complex, actor builds are become more system resource-intensive. In some recent cases, multi-stage actor builds have even run out of memory.

To fix this, we have increased the memory allocated to actor builds to 2 GB, while also boosting other resources necessary for the build process. This will increase the cost of running your actors, however the amount is negligible in comparison to other resources.

Crawlee is an open-source web scraping and browser automation library that helps you build reliable scrapers. Fast.

Now is the best time to show your love for Crawlee. If you’ve already tried it out, or are a user of the Apify SDK, leave a review on Product Hunt and join the discussion on Hacker News! ❤️

Support Crawlee and help spread the word by leaving a star on GitHub! ⭐️

Wondering what makes Crawlee unique? Check out Crawlee's introduction video.

Some content