Change log

What's new at Apify?

New Integrations Space

The Integrations page is now available in the left navigation menu of Apify Console. This central location lets you view, access, and manage all your connected integrations in one place.

⭐ Why it matters:

  • Integrations are powerful, and now they're easier to find. You can see all your configured integrations in Apify Console, understand the connections between Actors and their integrations, and manage your setup in one place.
  • Increase visibility: We want make your integrations more accessible and easy to use. Integrations automate common tasks like data processing, email notifications, image downloads, and database uploads - tasks that would typically require manual work. organized.

Integrate to get the most out of Apify!

New Integration Space

Introducing Dataset validation - Increase trust in your actors

You can now define dataset schemas in your Actor builds. This feature lets you monitor data at the field level and validate that your scraped data matches your specified format - helping both Apify team creators and users ensure data quality and completeness.

🚀 Key Features:

  • Actor run alerts: Dataset schemas in your Actor enable field-level alerts, letting you monitor specific data points to verify quality.
  • Run Statistics: During Actor runs, you'll see real-time statistics comparing valid and invalid results based on your dataset schema, giving you visibility into data quality as the Actor executes.
  • Dataset Preview: The upcoming dataset preview feature will show you the exact data structure each Actor returns, helping you quickly identify the right Actor for your needs.

For detailed guidance, refer to our Dataset schema documentation.


New

Update

Web

Console

Docs

SDK

Apify for developers

For sure, you already know our Developers’ portal, a place where you can go from beginner to expert scraper builder with the Web Scraping Academy, join our open-source community, and find information about earning money by building your own actors (no matter if you prefer to work on your own projects, as a freelancer, or be a part of a great team, all options are covered). You can now find it on it’s own domain: developers.apify.com.

Screenshot 2022-04-14 at 10.00.23.png

Increasing plans limits

Eager to scrape more? We’ve got your back - the FREE plan now comes with 500 Search Engine Results Pages, and 0.5 GB of residential proxy traffic. Plus,the TEAM plan now has 128 GB of actor memory instead of 64 GB. Find out more on our pricing page.

Slack integration

In the last change log, we informed you about the Webhooks tab being renamed to Integrations due to integration diversification. We're excited to finally reveal our new Slack integration!

!Screenshot 2022-04-13 at 19.11.07.png

SDK 2.3.0 is out

This release should resolve the 0 concurrency bug 🐛 by automatically resetting the internal RequestQueue state after 5 minutes of inactivity.

Actor environment variables documentation

Actor environment variables have new documentation.

Kateřina Hroníková

Front-end developer


New

Update

Web

Console

Developer portal launch

We are launching a new portal for developers with a comprehensive web scraping academy and more resources on robotic process automation (RPA) coming soon. Join us to learn new skills, become a part of our open-source community, and earn income from your personal projects.

Developer portal.png

Organization account improvements

We have redesigned our organization account UI to make it easier for you to distinguish between your personal account and organizations. This design refresh involves changes in the left-side menu, subscription management, and a couple of other components.

CleanShot 2021-12-28 at 15.10.49@2x.png

Store

Marek Trunkát

CTO


Update

Actor

As our users' use cases become more complex, actor builds are become more system resource-intensive. In some recent cases, multi-stage actor builds have even run out of memory.

To fix this, we have increased the memory allocated to actor builds to 2 GB, while also boosting other resources necessary for the build process. This will increase the cost of running your actors, however the amount is negligible in comparison to other resources.

small_image_2_575def06b8.png

Marek Trunkát

CTO


New

Update

Crawlee is an open-source web scraping and browser automation library that helps you build reliable scrapers. Fast.

Now is the best time to show your love for Crawlee. If you’ve already tried it out, or are a user of the Apify SDK, leave a review on Product Hunt and join the discussion on Hacker News! ❤️

Support Crawlee and help spread the word by leaving a star on GitHub! ⭐️

Wondering what makes Crawlee unique? Check out Crawlee's introduction video.

Crawlee_npx.png

Daniel Do

Product Manager


Making the web programmable, Apify is built with ❤️ and 🍺 in Prague