Non-official client to get some info about products sold on Amazon

source for Open States scrapers

:scissors: High performance, multi-threaded image scraper

Universal Reddit Scraper - A comprehensive Reddit scraping/archival command-line tool.

Google play scraper for Python inspired by <facundoolano/google-play-scraper>

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

DaProfiler is an OSINT tool allowing you to collect certain information about yourself in order to rectify by rgpd requests the traces you may have left on the net. DaProfiler is indeed able to recover: Addresses, Social media accounts, e-mail addresses, mobile / landline number, jobs. On a specified subject in a limited time. DaProfiler is designe

Powerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically

Advanced python library to scrap Twitter (tweets, users) from unofficial API

Fast, flexible, sync/async, Python 3.7+ screen scraping client specifically for network devices

[not actively maintained] A lightweight Python library that uses Webkit to enable easy scraping of dynamic, Javascript-heavy web pages

Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs

Dorks Eye Google Hacking Dork Scraping and Searching Script. Dorks Eye is a script I made in python 3. With this tool, you can easily find Google Dorks. Dork Eye collects potentially vulnerable web pages and applications on the Internet or other awesome info that is picked up by Google's search bots. Author: Jolanda de Koff

Search google, bing, yahoo, and other search engines with python

Lightweight package to query popular search engines and scrape for result titles, links and descriptions

Lightweight package to query popular search engines and scrape for result titles, links and descriptions

List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)

A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Fetch user's data across social media

A Python library for scraping the Google search engine.