Skip to content

About

Web scrapper with deep subpage loader, pagination loop, with Puppeter and clean web-requests

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

26 Commits

Folders and files

Repository files navigation

Web scraper for humans

Extended and fully async version of scrape-it

npm install --save flamescraper
Features and usage
  • Multiple pages parse per request
  • Recursive subpage loading per each parameter with subpage field
  • Pagination infinity loop, where Next page param detected and next page link is finded
  • You can select for each page: use Puppeteer for SPA sites or default web request
  • If Convert and How is a string => make functions
  • Async PageConvertor callback after each page (in pagination) for bulk processing/save results, but with full control after each step
  • Async stopCallback for stop scraping if results are right for you (for example you scraped next pages last time)

About

Web scrapper with deep subpage loader, pagination loop, with Puppeter and clean web-requests

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages