unbrowseBlog
Notes
Route-first web agents: benchmarks, comparisons with browser automation tools, and guides to getting website data without scraping. RSS
2026-09-28 · Opinion
We Killed the Apify Actor. Agents Build Them Now, for FreeAn Apify actor is a scraper a person wrote and maintains. Unbrowse has an agent compile the same thing from a site's own requests, free in beta.
2026-05-24 · Benchmark
30 to 70 in One Fix: An Honest Multi-Lane Benchmark of unbrowse@6.17.2Honest agent-judged bench across 37 probes spanning anchor, semantic-rank, ssr-list, graphql. 70% coverage. 96% browser-avoided. Named failure rows. Matches the arXiv 2604.00694 claim.
2026-04-05 · Technical
Skip the Browser from Claude DesktopUnbrowse is now a real MCP server. One JSON block in your config and your agent gets the web - without a browser.
2026-04-05 · Technical
3 Lines to Skip the BrowserUnbrowse v2.12.0 ships a first-party TypeScript SDK. If you're building on top of the local Unbrowse runtime, you no longer need to shell out to the CLI - just import, resolve, and execute.
2026-04-05 · News
v3: The Browser Is Now the FallbackFor two years the default answer to "how does an AI agent interact with a website?" has been "spin up a headless browser." That answer is expensive, fragile, and slow. With Unbrowse v3 we are making it official: the structured API is the primary path, and the browser is what you reach for when nothing else works.
2026-04-05 · Whitepaper
Why We Wrote a Paper Against Browser AutomationEvery browser automation agent does the same thing: spin up a headless browser, click through page elements, wait for renders, retry on failure, and burn tokens narrating what it sees. We spent the last year asking: what if most of that work is unnecessary?
2026-04-04 · News
Unbrowse 3.0: From Browser Tool to Agentic InfrastructureUnbrowse 3.0 ships DAG workflow publishing, a publish review pipeline, MCP overhaul, and a full browser proxy mode. The wedge was speed. The cathedral is the shared route graph. This release builds the bridge.
2026-04-03 · Guide
How to Access Airbnb Listing Data Without ScrapingAirbnb has no public API for listing data. Their website uses internal GraphQL and REST endpoints to serve search results, pricing, availability, and reviews. Unbrowse discovers these shadow APIs from real browsing sessions and makes them callable.
2026-04-03 · Guide
How to Access Amazon Product Data via Shadow APIsAmazon blocks scrapers and charges for its Product Advertising API. Learn how to discover Amazon's internal product APIs from browsing traffic using Unbrowse — pricing, reviews, and availability data without scraping.
2026-04-03 · Guide
How to Access Craigslist Data Without ScrapingLearn how to access Craigslist listing data, search results, and classified ads through shadow APIs discovered from browsing traffic — no HTML parsing or scraping required.
2026-04-03 · Guide
How to Access Discord Data Without the Bot APILearn how to access Discord server data, messages, and channels through shadow APIs discovered from browsing traffic — no bot tokens, no scraping required.
2026-04-03 · Guide
How to Access eBay Data Without ScrapingLearn how to access eBay listing data, pricing, and search results through shadow APIs discovered from browsing traffic — no scraping, no official API keys required.
2026-04-03 · Guide
How to Access GitHub Data Faster Than the REST APIGitHub's REST API is rate-limited to 5,000 requests per hour. Learn how to discover GitHub's internal APIs from browsing traffic using Unbrowse — faster data access without rate limit constraints.
2026-04-03 · Guide
How to Access Google Search Results ProgrammaticallyGoogle Custom Search API costs $5 per 1,000 queries. Learn how to discover Google's internal search endpoints from browsing traffic using Unbrowse — structured SERP data without per-query costs.
2026-04-03 · Guide
How to Access HackerNews Data in Real-TimeHN's Firebase API is slow and limited. Learn how to discover Hacker News's internal endpoints for stories, comments, and search using Unbrowse — real-time data without polling delays.
2026-04-03 · Guide
How to Access Instagram Data Without ScrapingInstagram's Graph API requires Facebook business verification and approved use cases. Shadow APIs offer direct access to public profiles, posts, reels, and hashtag data through the same internal endpoints Instagram's web app uses.
2026-04-03 · Guide
How to Access LinkedIn Data Without a BrowserLinkedIn blocks scrapers aggressively. Learn how to discover LinkedIn's internal APIs from your authenticated browsing session using Unbrowse — structured profile and job data without automation detection.
2026-04-03 · Guide
How to Access Netflix Catalog Data ProgrammaticallyNetflix has no public API. Their catalog data -- titles, genres, ratings, cast, and availability by region -- is served through internal APIs that power the Netflix web interface. Unbrowse discovers these endpoints from real browsing sessions.
2026-04-03 · Guide
How to Access Notion Data Without the Official APILearn how to access Notion pages, databases, and workspace data through shadow APIs discovered from browsing traffic — no official API integration or token setup required.
2026-04-03 · Guide
How to Access Pinterest Data Without ScrapingLearn how to access Pinterest pin data, boards, and search results through shadow APIs discovered from browsing traffic — no scraping, no developer tokens required.
2026-04-03 · Guide
How to Access Product Hunt Data Without ScrapingLearn how to access Product Hunt launch data, upvotes, comments, and maker profiles through shadow APIs discovered from browsing traffic — no scraping or official API approval required.
2026-04-03 · Guide
How to Access Reddit Data Without ScrapingReddit killed free API access with $100/month minimum pricing. Learn how to discover Reddit's internal shadow APIs from browsing traffic using Unbrowse — no scraping, no paid API keys.
2026-04-03 · Guide
How to Access Shopify Store Data via Shadow APIsShopify's official APIs require store owner approval and OAuth credentials. Shadow APIs -- the internal endpoints every Shopify storefront calls -- let you access product catalogs, pricing, inventory status, and collection data from any public store without authentication.
2026-04-03 · Guide
How to Access StackOverflow Data Without Rate LimitsStackOverflow's public API caps you at 300 requests per day without authentication. Shadow APIs -- the internal endpoints powering the StackOverflow frontend -- offer higher throughput and richer data than the official API ever provided.
2026-04-03 · Guide
How to Access Stripe Dashboard Data ProgrammaticallyLearn how to access Stripe dashboard analytics, charts, and internal reports through shadow APIs discovered from browsing traffic — data the official API does not expose.
2026-04-03 · Guide
How to Access TikTok Data Without the Official APITikTok's official API is restricted to approved partners with weeks-long review processes. Shadow APIs -- the internal endpoints TikTok's web app calls -- provide access to video metadata, user profiles, trending content, and search results without partner approval.
2026-04-03 · Guide
How to Access Twitter/X Data Without ScrapingX API costs $100/month minimum. Learn how to discover Twitter's internal GraphQL APIs from browsing traffic using Unbrowse — structured data without paid API access or fragile scraping.
2026-04-03 · Guide
How to Access Twitter Spaces Data ProgrammaticallyLearn how to access Twitter/X Spaces data including live audio rooms, speaker lists, and listener counts through shadow APIs discovered from browsing traffic.
2026-04-03 · Guide
How to Access Walmart Product Data via Shadow APIsWalmart's Affiliate API has limited product data and strict approval requirements. Shadow APIs -- the internal endpoints powering walmart.com -- provide complete product details, real-time pricing, inventory status, and reviews without affiliate approval.
2026-04-03 · Guide
How to Access YouTube Data Without the Official APIYouTube's official API has strict quotas that run out fast. Learn how to discover YouTube's internal APIs from browsing traffic using Unbrowse — video data, search results, and comments without quota limits.
2026-04-03 · Guide
How to Access Zillow Real Estate Data Without ScrapingZillow's official API was shut down in 2021, and scraping their site triggers aggressive anti-bot defenses. Shadow APIs offer a third path: the same internal endpoints Zillow's own frontend uses, discovered automatically from real browsing traffic.
2026-04-03 · Technical
Your Agent Fleet Can Fund Itself: The Economics of API MiningA detailed economic analysis of how running AI agent fleets with Unbrowse generates revenue through API route mining, with breakeven calculations and scaling projections.
2026-04-03 · Guide
The Agentic Browser Wars: 2026 Landscape MapA comprehensive map of the 2026 agentic browser landscape. Categorizes and compares Browser Use, Stagehand, Browserbase, Steel, Browserless, Playwright, Puppeteer, Selenium, Firecrawl, Crawl4AI, Unbrowse, AgentQL, and Skyvern across five categories.
2026-04-03 · Guide
AI Agent Web Access: The Complete Guide for 2026The definitive guide to giving AI agents web access in 2026. Compare browser automation, web scraping, and API discovery with cost analysis and tool recommendations.
2026-04-03 · Guide
The arXiv Paper Explained: Internal APIs Are All You NeedAn accessible summary of the Unbrowse research paper (arXiv:2604.00694) for developers. Key findings: 3.6x mean speedup over browser automation, 5.4x median, 94 domains tested, sub-100ms cached routes.
2026-04-03 · Tutorial
Automate Job Applications Without SeleniumUse Unbrowse to interact with job boards like LinkedIn, Indeed, and Glassdoor through their shadow APIs. Skip the brittle Selenium scripts and call the real endpoints directly.
2026-04-03 · Guide
10 Best AI Browser Agents in 2026A comprehensive comparison of the top AI browser agents in 2026, including Browser Use, Stagehand, Unbrowse, AgentQL, Skyvern, and more. Find the right tool for your AI automation needs.
2026-04-03 · Guide
6 Best Browser Automation Tools That Actually Work in 2026A head-to-head comparison of the six browser automation tools that actually deliver in 2026, from AI-native agents to API-first approaches.
2026-04-03 · Guide
Best MCP Server for Web Browsing in 2026A ranked comparison of the best MCP servers for web browsing in 2026, covering Unbrowse, Playwright, Browserbase, Firecrawl, Chrome DevTools, AgentQL, and Puppeteer MCP servers.
2026-04-03 · Guide
7 Best MCP Servers for Web Scraping in 2026Compare the top MCP servers for web scraping in 2026. Detailed breakdown of Unbrowse MCP, Playwright MCP, Firecrawl MCP, Puppeteer MCP, and more for Claude and AI agent workflows.
2026-04-03 · Guide
Best Open Source Browser Automation in 2026A comprehensive guide to every major open-source browser automation tool in 2026, from API discovery engines to LLM-driven browser agents.
2026-04-03 · Guide
5 Best Playwright Alternatives for AI AgentsLooking for Playwright alternatives that work better with AI agents? Compare Unbrowse, Stagehand, Browser Use, Steel, and Browserless for agent-first browser automation.
2026-04-03 · Guide
5 Best Tools for Extracting API Data From WebsitesDiscover the top tools for reverse-engineering and extracting API data from websites, from automated shadow API discovery to manual traffic proxies.
2026-04-03 · Guide
8 Best Web Scraping Tools for AI in 2026Compare the top web scraping and data extraction tools for AI agents in 2026, from API discovery to managed proxies to open-source crawlers.
2026-04-03 · Guide
Browser Automation in 2026: The Complete GuideAn evergreen guide covering every browser automation approach in 2026: Selenium, Playwright, Puppeteer, Browser Use, Stagehand, Firecrawl, and Unbrowse. Covers use cases, performance, and when to use each tool.
2026-04-03 · Technical
The $0.53 Tax: What Browser Automation Really Costs Per ActionA breakdown of the real cost of browser automation for AI agents: compute, LLM tokens for DOM processing, and latency opportunity cost. Compared to API-native alternatives.
2026-04-03 · Tutorial
Build an AI Research Assistant That Reads the Whole WebBuild an AI research assistant that collects data from multiple websites, extracts structured information via shadow APIs, and produces comprehensive summaries. No scraping frameworks needed.
2026-04-03 · Tutorial
Build a Price Monitoring Agent in 10 LinesBuild an automated price monitoring agent that tracks Amazon and Walmart prices using Unbrowse's shadow API discovery. No scraping, no browser automation — just clean API calls discovered from real browsing traffic.
2026-04-03 · Technical
CrewAI + Unbrowse: Build Agents That Skip the BrowserTutorial for integrating Unbrowse with CrewAI to give your agent crews direct API access to websites. Skip browser automation entirely with cached API routes.
2026-04-03 · Technical
Foundry: Turn Your AI Workflow History Into Reusable SkillsFoundry mines your local AI coding assistant history to discover repeated workflow patterns and turns them into portable, installable skills. Open source, works with Claude Code, Codex, and OpenClaw.
2026-04-03 · Technical
How Unbrowse Works: Architecture of an API Discovery EngineA complete technical walkthrough of Unbrowse's architecture, from passive traffic capture through endpoint extraction, authentication detection, graph construction, and cache-first resolution.
2026-04-03 · Technical
How to Give Your LangChain Agent Direct API AccessTutorial showing how to use Unbrowse as a LangChain tool to replace browser-based web access with direct API calls. Includes code examples, setup, and performance comparison.
2026-04-03 · Comparison
MCP Browser Servers Compared: Speed, Tokens, and ReliabilityHead-to-head benchmark of Playwright MCP, Unbrowse MCP, Browserbase MCP, and Firecrawl MCP across speed, token efficiency, and reliability.
2026-04-03 · Guide
Mine the Internet: A Developer's Guide to Earning With UnbrowseLearn how to earn USDC micropayments by using Unbrowse normally. Every API route you discover gets indexed to the marketplace, and every time another agent uses your route, you get paid.
2026-04-03 · Tutorial
Monitor Competitor Pricing With 3 Lines of CodeTrack competitor prices across any e-commerce site with just 3 lines of code. Unbrowse discovers the internal pricing APIs automatically — no scrapers, no selectors, no maintenance.
2026-04-03 · Technical
The 50 Most Valuable Domains to Mine With UnbrowseA ranked guide to the highest-value websites for API mining with Unbrowse. Discover which domains yield the most endpoints, earn the most micropayments, and offer first-mover bonuses.
2026-04-03 · Comparison
Playwright MCP vs Unbrowse MCP: Which Should Your Agent Use?A detailed comparison of Playwright MCP and Unbrowse MCP for AI agent web browsing. Covers architecture, speed, token cost, authentication, and when to use each.
2026-04-03 · Tutorial
Replace Playwright in Your Agent Pipeline in 5 MinutesMigrate from Playwright to Unbrowse in 5 minutes. Before/after code comparisons, performance benchmarks (3.6x faster), and a step-by-step migration guide for AI agent pipelines.
2026-04-03 · Tutorial
Shadow API Discovery: A Step-by-Step TutorialLearn how to discover hidden shadow APIs behind any website. A practical step-by-step tutorial using Unbrowse to find, document, and call internal API endpoints.
2026-04-03 · Guide
Top 10 Selenium Alternatives in 2026Ten Selenium alternatives that solve the problems WebDriver cannot -- from AI-native agents to API-first approaches that skip the browser entirely.
2026-04-03 · Tutorial
How to Set Up Unbrowse MCP Server for Claude DesktopStep-by-step guide to install and configure Unbrowse MCP server for Claude Desktop. Covers installation, MCP configuration, testing with example resolves, and troubleshooting.
2026-04-03 · Comparison
Unbrowse vs Apify: Actor-Based Scraping vs Route CachingApify industrialized web scraping. Unbrowse makes scraping obsolete for data retrieval. Compare actor-based scraping platforms vs API-native route caching.
2026-04-03 · Comparison
Unbrowse vs Bright Data: Cloud Proxy vs Native API CallsBright Data powers the web's presentation layer. Unbrowse bypasses it entirely. Compare proxy-based data collection vs API-native resolution for AI agents.
2026-04-03 · Comparison
Unbrowse vs Browser Use: Which AI Browser Agent Wins?Browser Use teaches AI to use browsers. Unbrowse teaches AI to skip them. Compare LLM-driven browser control vs API-native resolution — 3.6x faster, 40x fewer tokens.
2026-04-03 · Comparison
Unbrowse vs Browserbase: Infrastructure vs IntelligenceBrowserbase makes browsers better. Unbrowse makes browsers unnecessary. Compare cloud browser infrastructure vs API-native resolution for AI agents.
2026-04-03 · Comparison
Unbrowse vs Firecrawl: Scraping vs API DiscoveryFirecrawl scrapes HTML into markdown. Unbrowse discovers the APIs behind pages. Compare web scraping against API discovery for AI agent data retrieval.
2026-04-03 · Comparison
Unbrowse vs Playwright: The Full Benchmark (94 Domains)Detailed benchmark results from the arXiv paper comparing Unbrowse API calls vs Playwright browser automation across 94 domains with site-by-site breakdown.
2026-04-03 · Comparison
Unbrowse vs Scrapy: Traditional Scraping vs API-FirstScrapy parses the web's presentation layer. Unbrowse taps the data layer directly. Compare Python scraping frameworks vs API-native resolution for modern web data.
2026-04-03 · Comparison
Unbrowse vs Selenium: Why Browser Automation LostSelenium automates browsers. Unbrowse eliminates the need for them. Compare browser automation vs API-native resolution for AI agents — 3.6x faster, 40x fewer tokens.
2026-04-03 · Comparison
Unbrowse vs Stagehand: AI SDK vs API DiscoveryStagehand adds AI to browser automation. Unbrowse removes the browser entirely. Compare AI-powered browser SDKs against API discovery for agent web interaction.
2026-04-03 · Comparison
Unbrowse vs Steel: Open Source Browser Infra ComparedSteel provides open-source cloud browser fleets. Unbrowse provides API-native intelligence. Compare open source browser infrastructure against API discovery for AI agents.
2026-04-03 · Technical
Web Data Extraction Without Scraping: The API-First ApproachWhy scraping is an unnecessary tax when websites already expose their data via internal APIs. The API-first paradigm for web data extraction.
2026-04-03 · Guide
What Is a Shadow API? The Complete Developer's GuideA comprehensive guide to shadow APIs: the internal, undocumented endpoints that power every modern website. Learn what they are, how to find them, and why they matter for AI agents and browser automation.
2026-04-03 · Technical
x402 Micropayments: How AI Agents Pay for API AccessA technical explainer of the x402 micropayment protocol, how it enables AI agents to pay for API access in real time, and how Unbrowse uses it to create a self-sustaining marketplace for shadow API routes.
2026-04-02 · Benchmark
94 Domains: The Warmed-Cache BenchmarkThe paper benchmark compares warmed cached route execution against Playwright across 94 live domains, with 3.6x mean and 5.4x median speedup.
2026-04-02 · Opinion
Browser Automation Is Dead. Here's What Replaces It.Browser-first agent work often pays for rendering and page parsing when the structured route already exists underneath. Across 94 domains in the paper benchmark, warmed cached routes averaged a 3.6x mean speedup over Playwright.
2026-04-02 · Opinion
Every MCP Server Is a Mass HallucinationThere are 10,000+ MCP servers on GitHub. Each is a hand-written wrapper around one API. But most websites don't have official APIs, and the ones that do change constantly. The entire approach doesn't scale.
2026-04-02 · Guide
Your Personal Agent Is 3.6x Slower Than It Should BePersonal AI agents waste time when every web task starts with browser rendering. Unbrowse lets an OpenClaw agent try a known first-party route first and fall back to the browser when needed.
2026-04-02 · Opinion
Google Indexed the Web for Humans. Who Indexes It for Agents?Google captured $2T in value by indexing HTML pages for human eyeballs. The agentic web needs its own index. Not an index of pages, but an index of machine-readable API routes. Unbrowse is building it, collectively, from the routes agents discover as they work.
2026-04-02 · Technical
Shadow APIs: The Hidden API Layer Every Website Already HasEvery modern website calls internal API endpoints behind its UI. These shadow APIs are not documented, not public, but fully functional. Unbrowse discovers them by intercepting network traffic during normal browsing.