Non-official client to get some info about products sold on Amazon

source for Open States scrapers

Universal Reddit Scraper - A comprehensive Reddit scraping/archival command-line tool.

:scissors: High performance, multi-threaded image scraper

Google play scraper for Python inspired by <facundoolano/google-play-scraper>

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

DaProfiler is an OSINT tool allowing you to collect certain information about yourself in order to rectify by rgpd requests the traces you may have left on the net. DaProfiler is indeed able to recover: Addresses, Social media accounts, e-mail addresses, mobile / landline number, jobs. On a specified subject in a limited time. DaProfiler is designe

Powerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically

Advanced python library to scrap Twitter (tweets, users) from unofficial API

Fast, flexible, sync/async, Python 3.7+ screen scraping client specifically for network devices

Dorks Eye Google Hacking Dork Scraping and Searching Script. Dorks Eye is a script I made in python 3. With this tool, you can easily find Google Dorks. Dork Eye collects potentially vulnerable web pages and applications on the Internet or other awesome info that is picked up by Google's search bots. Author: Jolanda de Koff

Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs

[not actively maintained] A lightweight Python library that uses Webkit to enable easy scraping of dynamic, Javascript-heavy web pages

Search google, bing, yahoo, and other search engines with python

A Python library for scraping the Google search engine.

Lightweight package to query popular search engines and scrape for result titles, links and descriptions

Lightweight package to query popular search engines and scrape for result titles, links and descriptions

Fetch user's data across social media

List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)

A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.