Top alternative scraping utilities for Nodejs
Updated :
July 11, 2024
cheerio
Github stargazers
28055
Github forks
1
Commits
2905
Code contributors Contributors
136
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
Created
Oct. 9, 2011
Updated
July 11, 2024
License
mit
Github repo
Type
Module/library
Primary Language, based on Github DataLanguage
TypeScript
Issues
54
jsdom
Github stargazers
20199
Github forks
1680
Commits
3639
Code contributors Contributors
293
A JavaScript implementation of various web standards, for use with Node.js
Created
Jan. 19, 2010
Updated
May 26, 2024
License
mit
Github repo
Type
Module/library
Platform
Node.js, Browser
Primary Language, based on Github DataLanguage
JavaScript
Issues
519
apify-js
Github stargazers
13074
Github forks
567
Commits
4056
Code contributors Contributors
90
Crawleeโ€”A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Created
Aug. 26, 2016
Updated
July 11, 2024
License
apache-2.0
Github repo
Type
Cli
Platform
Node.js, Browser
Primary Language, based on Github DataLanguage
TypeScript
Issues
115
Homepage
scrape-it
Github stargazers
3992
Github forks
220
Commits
202
Code contributors Contributors
19
๐Ÿ”ฎ A Node.js scraper for humans.
Created
April 28, 2016
Updated
April 23, 2024
License
mit
Github repo
Type
Module/library
Primary Language, based on Github DataLanguage
JavaScript
Issues
1
google-play-scraper
Github stargazers
2279
Github forks
625
Commits
469
Code contributors Contributors
68
Node.js scraper to get data from Google Play
Created
April 7, 2015
Updated
May 30, 2024
License
mit
Github repo
Type
Module/library
Primary Language, based on Github DataLanguage
JavaScript
Issues
97
node-website-scraper
Github stargazers
1532
Github forks
272
Commits
493
Code contributors Contributors
16
Download website to local directory (including all css, images, js, etc.)
Created
Sept. 4, 2014
Updated
June 17, 2024
License
mit
Github repo
Type
Module/library
Platform
Node.js
Primary Language, based on Github DataLanguage
JavaScript
Issues
7
Homepage
noodle
Github stargazers
745
Github forks
69
Commits
531
Code contributors Contributors
15
A node server and module which allows for cross-domain page scraping on web documents with JSONP or POST.
Created
June 29, 2012
Updated
May 14, 2024
Github repo
Type
Module/library
Platform
Node.js
Primary Language, based on Github DataLanguage
JavaScript
Issues
14
openGraphScraper
Github stargazers
644
Github forks
102
Commits
1001
Code contributors Contributors
37
Node.js scraper service for Open Graph Info and More!
Created
Sept. 1, 2013
Updated
June 29, 2024
License
mit
Github repo
Type
Module/library
Platform
Browser
Primary Language, based on Github DataLanguage
TypeScript
Issues
1
node-scraper
Github stargazers
519
Github forks
63
Commits
13
Code contributors Contributors
1
Easier web scraping using node.js and jQuery
Created
Dec. 5, 2010
Updated
May 31, 2011
License
mit
Github repo
Type
Module/library
Platform
Node.js
Primary Language, based on Github DataLanguage
JavaScript
Issues
22
webster
Github stargazers
509
Github forks
57
Commits
119
Code contributors Contributors
2
a reliable high-level web crawling & scraping framework for Node.js.
Created
Nov. 4, 2017
Updated
Nov. 9, 2023
License
gpl-3.0
Github repo
Type
App
Primary Language, based on Github DataLanguage
JavaScript
Issues
1
node-google
Github stargazers
454
Github forks
124
Commits
96
Code contributors Contributors
15
A Node.js module to search and scrape Google.
Created
July 10, 2012
Updated
Sept. 20, 2016
License
mit
Github repo
Type
Module/library
Platform
Node.js
Primary Language, based on Github DataLanguage
JavaScript
Issues
30
micro-open-graph
Read-only repository, archived by owner Archived
Github stargazers
381
Github forks
51
Commits
44
Code contributors Contributors
7
A tiny Node.js microservice to scrape open graph data with joy.
Created
Feb. 21, 2017
Updated
Feb. 11, 2019
License
mit
Github repo
Primary Language, based on Github DataLanguage
JavaScript
Issues
3
node-readability
Github stargazers
342
Github forks
36
Commits
261
Code contributors Contributors
3
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.
Created
May 10, 2014
Updated
Aug. 1, 2018
Github repo
Platform
Node.js
Primary Language, based on Github DataLanguage
JavaScript
Issues
7
yakuza
Github stargazers
298
Github forks
29
Commits
383
Code contributors Contributors
6
Highly scalable Node.js scraping framework for mobsters
Created
Sept. 30, 2014
Updated
Sept. 30, 2015
Github repo
Type
Tool/utility
Platform
Node.js
Primary Language, based on Github DataLanguage
JavaScript
Issues
10
synth-secrets
Github stargazers
287
Github forks
34
Commits
5
Code contributors Contributors
1
Screen-scraped articles on subtractive synthesis (using Node.js)
Created
Dec. 10, 2014
Updated
Dec. 10, 2014
Github repo
Platform
Node.js
Primary Language, based on Github DataLanguage
JavaScript
Issues
1
node-web-scraper
Github stargazers
272
Github forks
196
Commits
13
Code contributors Contributors
4
Code for the tutorial: Scraping the Web With Node.js by @kukicado
Created
March 13, 2014
Updated
Jan. 10, 2018
Github repo
Platform
Node.js
Primary Language, based on Github DataLanguage
JavaScript
Issues
6
Homepage
link-preview-generator
Github stargazers
254
Github forks
64
Commits
32
Code contributors Contributors
8
Get preview data (a title, description, image, domain name) from a url. Library uses puppeteer headless browser to scrape the web site.
Created
Nov. 12, 2019
Updated
March 3, 2022
License
mit
Github repo
Primary Language, based on Github DataLanguage
JavaScript
Issues
8
nutella-scrape
Github stargazers
209
Github forks
12
Commits
20
Code contributors Contributors
2
:chocolate_bar: learn to scrape the web with Node.js -- it tastes like chocolate
Created
Aug. 14, 2015
Updated
Sept. 11, 2015
Github repo
Platform
Node.js, Browser
Primary Language, based on Github DataLanguage
JavaScript
Issues
1
Humanoid
Github stargazers
205
Github forks
28
Commits
31
Code contributors Contributors
2
Node.js package to bypass CloudFlare's anti-bot JavaScript challenges
Created
Oct. 20, 2018
Updated
May 21, 2023
License
mit
Github repo
Type
Module/library
Platform
Node.js, Browser
Primary Language, based on Github DataLanguage
JavaScript
Issues
8
node-scrapy
Github stargazers
154
Github forks
27
Commits
185
Code contributors Contributors
5
Simple, lightweight and expressive web scraping with Node.js
Created
June 4, 2014
Updated
Aug. 24, 2020
License
mit
Github repo
Platform
Node.js
Primary Language, based on Github DataLanguage
JavaScript
Issues
4