As our users' use cases become more complex, actor builds are become more system resource-intensive. In some recent cases, multi-stage actor builds have even run out of memory.
To fix this, we have increased the memory allocated to actor builds to 2 GB, while also boosting other resources necessary for the build process. This will increase the cost of running your actors, however the amount is negligible in comparison to other resources.
The Integrations page is now available in the left navigation menu of Apify Console. This central location lets you view, access, and manage all your connected integrations in one place.
⭐ Why it matters:
Integrations are powerful, and now they're easier to find. You can see all your configured integrations in Apify Console, understand the connections between Actors and their integrations, and manage your setup in one place.
Increase visibility: We want make your integrations more accessible and easy to use. Integrations automate common tasks like data processing, email notifications, image downloads, and database uploads - tasks that would typically require manual work. organized.
Introducing Dataset validation - Increase trust in your actors
You can now define dataset schemas in your Actor builds. This feature lets you monitor data at the field level and validate that your scraped data matches your specified format - helping both Apify team creators and users ensure data quality and completeness.
🚀 Key Features:
Actor run alerts: Dataset schemas in your Actor enable field-level alerts, letting you monitor specific data points to verify quality.
Run Statistics: During Actor runs, you'll see real-time statistics comparing valid and invalid results based on your dataset schema, giving you visibility into data quality as the Actor executes.
Dataset Preview: The upcoming dataset preview feature will show you the exact data structure each Actor returns, helping you quickly identify the right Actor for your needs.
Crawlee is an open-source web scraping and browser automation library that helps you build reliable scrapers. Fast.
Now is the best time to show your love for Crawlee. If you’ve already tried it out, or are a user of the Apify SDK, leave a review on Product Hunt and join the discussion on Hacker News! ❤️
Support Crawlee and help spread the word by leaving a star on GitHub! ⭐️
For sure, you already know our Developers’ portal, a place where you can go from beginner to expert scraper builder with the Web Scraping Academy, join our open-source community, and find information about earning money by building your own actors (no matter if you prefer to work on your own projects, as a freelancer, or be a part of a great team, all options are covered). You can now find it on it’s own domain: developers.apify.com.
Increasing plans limits
Eager to scrape more? We’ve got your back - the FREE plan now comes with 500 Search Engine Results Pages, and 0.5 GB of residential proxy traffic. Plus,the TEAM plan now has 128 GB of actor memory instead of 64 GB. Find out more on our pricing page.
Slack integration
In the last change log, we informed you about the Webhooks tab being renamed to Integrations due to integration diversification. We're excited to finally reveal our new Slack integration!
