Create a new datasource in a couple of hours
You don't need to be a developer to crawl a website!
Easier to maintain and to improve
Speed
Easy to understand how the data is being transformed
Quicksight!
Using temporal tables to run heavy operations
Using dedicated geolocation DB
Avoids using so many tables
Loading of images happening in same transaction
Watermark handling
No longer using complex sql queries and many tables
Improved deduplication logic
By optimising how the data is loaded for use in DoorFeed.com and Admin portal