Webscraping GitHub Repositories

The context API to search, scrape, and interact with the web at scale. 🔥

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Create agents that monitor and act on your behalf. Your agents are standing by!

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.

Python scraper based on AI

An autonomous agent that conducts deep research on any data using any LLM providers

🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥

A cli tool to browse and play anime

📊 APIs for web automation, testing, and bypassing bot-detection.

🦊 Anti-detect browser

List of libraries, tools and APIs for web scraping and data processing.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

Undetected version of the Playwright testing and automation library.

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Make your job hunt easy by automating your application process with this Auto Applier

Web Scraper in Go, similar to BeautifulSoup

Vision utilities for web interaction agents 👀

The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping

Persistent HTTP cache for python requests

Undetected Python version of the Playwright testing and automation library.

👻 Experimental library for scraping websites using OpenAI's GPT API.

A blazing fast, async-first, undetectable webscraping/web automation framework based on ultrafunkamsterdam/nodriver. Now with Docker support!

Lightweight library for scraping web-sites with LLMs

Watch everything from your terminal.

This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.

Creating Scrapy scrapers via the Django admin interface

Scalable Python web scraping scripts for +40 popular domains

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.