puppeteer-daily-menu-scraper
puppeteer-daily-menu-scraper copied to clipboard
theDavidBarton
Puppeteer daily menu scraper from downtown Budapest.
https://github.com/theDavidBarton/puppeteer-daily-menu-scraper/actions/runs/4978733036/jobs/8909450121 regenerating lock file might bump to the correct base.
The scrape pipeline still manually installs `libgbm-dev` on Linux, with the latest puppeteers it is not required anymore (seems bundled). Let's remove it with the next pptr upgrade 👍
e.g.: in `lib/stringValueCleaner.js` https://github.com/theDavidBarton/puppeteer-daily-menu-scraper/pull/351/files#diff-ef69677ab0f00bff1af735cde9285df4d1e9f206291cbe1e77442e4de2dc52edR35 (it seems to be there was an async-mania during these developments 😅 )
[`20 9 * * 1-5`](https://crontab.guru/#20_9_*_*_1-5) runs 30 minutes earlier since 3 days. According to [this thread](https://stackoverflow.com/questions/65132563/why-is-github-actions-workflow-scheduled-with-cron-not-triggering-at-the-right-t) there can be issues in GH Actions at the moment.
The app still works till this day, but its core was written more than a year ago as my very first JavaScript project. **Problems:** - bad design - usage of...
just pass `page` as parameter and you can shorten the boilerplate script.
https://github.com/theDavidBarton/puppeteer-daily-menu-scraper/runs/530095601?check_suite_focus=true
the Kamra restaurant shows - by purpose - 0 HUF as price as an ongoing joke which distorts the saved prices of course, the real price is shown as the...
Metadata
Owner
Metadata
Puppeteer daily menu scraper from downtown Budapest.