All

66 repositories

llm_models
Public
Auto-updated registry of LLM model capabilities (vision, audio, etc.)
Rust
•
MIT License
•1•3•0•0•Updated Aug 7, 2026Aug 7, 2026
spider-browser
Public
Remote AI Browser
browser puppeteer playwright
browser puppeteer playwright
TypeScript
•
MIT License
•1•2•0•0•Updated Aug 3, 2026Aug 3, 2026
ua_generator
Public
Pre-compiled random real User-Agents. Updated weekly for windows, mac, linux, and android
useragent user-agent-string ua-generator
useragent user-agent-string ua-generator
Rust
•
MIT License
•9•40•0•0•Updated Aug 2, 2026Aug 2, 2026
spider
Public
Get web data for AI agents and LLMs
rust crawler automation
rust crawler automation spider web-crawler scraping web-scraping headless-chrome web-data ai-agent
Rust
•
MIT License
•222•2.6k•0•0•Updated Aug 1, 2026Aug 1, 2026
firewall
Public
Firewall for Rust
rust blacklist networking
rust blacklist networking firewall adblock adguard
Rust
•
MIT License
•0•1•0•1•Updated Jul 27, 2026Jul 27, 2026
spider-nodejs
Public
Spider ported to Node.js
nodejs distributed-systems crawler
nodejs distributed-systems crawler scraper typescript spider indexer headless-chrome
Rust
•
MIT License
•10•59•0•0•Updated Jul 23, 2026Jul 23, 2026
spider-clients
Public
Python, Javascript, and Rust libraries for the Spider Cloud API.
crawler scraper ai
crawler scraper ai spider html-to-markdown web-scraping ai-agents supabase ai-scraping llm-webcrawler
Rust
•
MIT License
•9•26•0•0•Updated Jul 19, 2026Jul 19, 2026
chromey
Public
Chrome DevTools Protocol for Rust
automation cdp headless-chrome
automation cdp headless-chrome chrome-devtools-protocol
Rust
•
Apache License 2.0
•13•51•1•0•Updated Jul 16, 2026Jul 16, 2026
spider_network_blocker
Public
Network blocking lists on ads, scripts, and analytics for Spider
networking
networking
Rust
•
MIT License
•0•1•0•0•Updated Jul 6, 2026Jul 6, 2026
gottem
Public
Router for scraping vendors under one API
scraper router scraping
scraper router scraping web-scraper
Rust
•
Apache License 2.0
•2•3•0•0•Updated Jul 3, 2026Jul 3, 2026
spider-claude-plugin
Public
mcp-tools claude-code-plugin claude-code-skills
mcp-tools claude-code-plugin claude-code-skills
MIT License
•0•0•0•0•Updated Jun 25, 2026Jun 25, 2026
spider-grok-plugin
Public
grok-ai grok-build grok-build-skills
grok-ai grok-build grok-build-skills grok-plugin
MIT License
•0•0•0•0•Updated Jun 24, 2026Jun 24, 2026
hermes-plugins
Public
A collection of plugins for Hermes Agent
browser ai web-crawler
browser ai web-crawler web-scraping hermes ai-agents hermes-plugins
Python
•
MIT License
•0•0•0•0•Updated Jun 23, 2026Jun 23, 2026
pi-extensions
Public
A collection of extensions for the Pi coding agent — native tools and commands within the Pi coding agent community.
pi coding-agent pi-coding-agent
pi coding-agent pi-coding-agent pi-extension pi-extensions pi-coding
TypeScript
•0•0•0•0•Updated Jun 19, 2026Jun 19, 2026
spider-peers-dist
Public
Spider Peers agent - P2P earn money to share resources
proxy peer-to-peer earn-money
proxy peer-to-peer earn-money
0•0•0•0•Updated Jun 3, 2026Jun 3, 2026
spider-cloud-mcp-server
Public
MCP server for the Spider Cloud web crawling and scraping API
spider web-crawler scaper
spider web-crawler scaper mcp-server mcp-scraper mcp-crawler mcp-spider
JavaScript
•
MIT License
•0•2•0•0•Updated May 22, 2026May 22, 2026
spider-cloud-mcp-v2
Public
Spider MCP server v2: crawl, scrape, search, and automate browsers at scale
TypeScript
•
MIT License
•0•3•1•0•Updated May 22, 2026May 22, 2026
http-cache
Public
A caching middleware that follows HTTP caching rules
Rust
•
Apache License 2.0
•28•0•0•0•Updated May 14, 2026May 14, 2026
znz
Public
embedded web tech
Rust
•
Mozilla Public License 2.0
•3.7k•0•0•0•Updated May 3, 2026May 3, 2026
html2md
Public
HTML to markdown for Rust
html markdown rust
html markdown rust html2md
HTML
•
MIT License
•3•79•0•0•Updated Apr 30, 2026Apr 30, 2026
markup5ever_rcdom
Public
Send/Sync-friendly fork of markup5ever_rcdom on the spider-* atomic-tendril stack
Rust
•
Apache License 2.0
•0•0•0•0•Updated Apr 30, 2026Apr 30, 2026
spider_scraper
Public
html5ever web scraper used for some of spider-rs CSS transformations
Rust
•
MIT License
•0•1•0•0•Updated Apr 30, 2026Apr 30, 2026
spider_transformations
Public
HTML transformation library for Rust
html-to-markdown transform-data html-transformation
html-to-markdown transform-data html-transformation
Rust
•
MIT License
•1•2•0•0•Updated Apr 30, 2026Apr 30, 2026
readability
Public
The readability library for Rust
rust readability data-cleaning
rust readability data-cleaning clean-data safari-reader llm-training
Rust
•
MIT License
•2•17•0•0•Updated Apr 30, 2026Apr 30, 2026
html5ever
Public
Send-able fork of html5ever, depends on spider-markup5ever and spider-tendril
Rust
•
Apache License 2.0
•0•0•0•0•Updated Apr 30, 2026Apr 30, 2026
markup5ever
Public
Send-able fork of markup5ever, depends on spider-tendril
Rust
•
Apache License 2.0
•0•0•0•0•Updated Apr 30, 2026Apr 30, 2026
tendril
Public
Send-able Tendril fork (atomic refcount) for high-concurrency HTML parsing
Rust
•
Apache License 2.0
•0•0•0•0•Updated Apr 30, 2026Apr 30, 2026
auto-encoder
Public
Auto encoding library bytes to strings
encoding string-encoding auto-encoder
encoding string-encoding auto-encoder
Rust
•
MIT License
•1•1•0•0•Updated Apr 29, 2026Apr 29, 2026
spider_remote_cache
Public
Rust
•0•0•0•0•Updated Apr 24, 2026Apr 24, 2026
hybrid_cache_server
Public
High performance cache index server
cache cache-server remote-caching
cache cache-server remote-caching
Rust
•
MIT License
•0•0•0•0•Updated Apr 15, 2026Apr 15, 2026

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.

All

All

Repositories list

66 repositories