Hello HN,
AutomatiQ is an open-source reverse-engineering AI agent, that can write requests-based(no browser) automation/scraper scripts on its own, all we have to do is, to normally browse the website once.
This makes it a lot easier to create and maintain the scripts. This is not a completely autonomous agent, you can , talk, guide the agent on its RE path.
Despite the limitations of this approach, up to 60%-90% of websites can be automated/scraped with just raw requests and TLS-spoofing(links to sources provided in the blog)
The tool successfully ran against popular websites like, bookmyshow, makemytrip. And to test it in the open, it was able to produce scraper solutions for 2 problems posted on r/webscraping in a single try.
As the scripts provided by the tool are requests-based, you can expect a 10-100x speed increase, and reduction of 5-7x memory footprint in your existing browser-based automations and scraper workflows.
Github: [https://github.com/StoneSteel27/AutomatiQ](https://github.com/StoneSteel27/AutomatiQ)
Blog for verbose explanation and techincal implementation details: [https://shiny-sushi-116.notion.site/automatiq](https://shiny-sushi-116.notion.site/automatiq)
Demo video of using Automatiq on bookmyshow website to get current running movies, showtimes, seat layout of a particular screen: https://www.youtube.com/watch?v=OfMvAQP5pkM
Thanks for your time, hope you have a great day/night ahead :)
Comments URL: [https://news.ycombinator.com/item?id=48581817](https://news.ycombinator.com/item?id=48581817)
Points: 1