This changelog summarizes all changes of the RAG Web Browser
🐛 Bug Fixes
- Cancel requests only in standby mode
🐛 Bug Fixes
- Cancel crawling requests from timed-out search queries
🐛 Bug Fixes
- Updated selector for organic search results and places
🐛 Bug Fixes
- Selector for organic search results
🚀 Features
- Handle all query parameters in the standby mode (including proxy)
🚀 Features
- Change default value for
scrapingTool from 'browser-playwright' to 'raw-http' to improve latency.
🚀 Features
- Add a new
scrapingTool input to allow users to choose between Browser scraper and raw HTTP scraper
🚀 Features
- Update Readme.md to include information about MCP
🚀 Features
- Handle double encoding of URLs
🐛 Bug Fixes
- Change default value of input query
- Retry search if no results are found
🚀 Features
- Include Model Context Protocol in Standby Mode
🚀 Features
- Improve README.md and simplify configuration
- Add an AWS Lambda function
- Hide variables initialConcurrency, minConcurrency, and maxConcurrency in the Actor input and remove them from README.md
- Remove requestTimeoutContentCrawlSecs and use only requestTimeoutSecs
- Ensure there is enough time left to wait for dynamic content before the Actor timeout (normal mode)
- Rename googleSearchResults to searchResults and searchProxyGroup to serpProxyGroup
- Implement input validation
🚀 Features
- Add functionality to extract content from a specific URL
- Update README.md to include new functionality and provide examples
🚀 Features
- Handle errors when request is added to Playwright queue.
This will prevent the Cheerio crawler from repeating the same request multiple times.
- Silence error: Could not parse CSS stylesheet as there is no way to fix it at our end
- Set logLevel to INFO (debug level can be set using the
debugMode=true input)
🚀 Features
- Increase the maximum number of results (
maxResults) from 50 to 100
- Explain better how to search a specific website using "llm site:apify.com"
🚀 Features
- Add a short description how to create a custom action
🚀 Features
- Updated README.md to include tips on improving latency
- Set initialConcurrency to 5
- Set minConcurrency to 3
🐛 Bug Fixes
- Fix response format when crawler fails
🚀 Features
- Add ability to create new crawlers using query parameters
- Update Dockerfile to node version 22
🐛 Bug Fixes
- Fix playwright key creation
🚀 Features
- Initial version of the RAG Web Browser
