Willhaben Scraper
Who am i?
I am litte website scraper targeting one of the biggest austrian advertising portal
.What am i doing?
Since Willhaben is not provding us with an official API, we need to do some tricks:
- By the use of puppeteer, a headless chrome API i am opening different pages on willhaben and scraping it for all the relevant data.
- This is all happening inside a serverless netlify function.
- By the use of a netlify scheduled function the data is grabbed every day on 09:00-AM and written into a firebase realtime database..
What's the deal?
Coming back to Willhaben: We are fetching the data from the database, transform it, and show it inside the chart section...