Self-Hosted Web Scraping & Challenge Bypass — TRAWLSkip to contentget started

open source · self-hosted · zero external APIs<br>bypass anything.return in 500ms.<br>An adaptive, self-hosted scraping engine — tries the cheapest path first and only escalates when needed. Solves Cloudflare challenges natively in 4–15 seconds. Caches browser sessions per domain and returns sub-500ms on every repeat request. No tokens. No quotas. No cloud. Just Docker.<br>deploy now ⋆ view source<br>cached domain response

4–15sfresh CF challenge solve

4execution tiers

adaptive tier engine · cloudflare bypass · session cache · camoufox firefox · turnstile solver · recaptcha audio · geetest slide · hcaptcha · proxy escalation · self-healing pool · adaptive tier engine · cloudflare bypass · session cache · camoufox firefox · turnstile solver · recaptcha audio · geetest slide · hcaptcha · proxy escalation · self-healing pool · adaptive tier engine · cloudflare bypass · session cache · camoufox firefox · turnstile solver · recaptcha audio · geetest slide · hcaptcha · proxy escalation · self-healing pool · adaptive tier engine · cloudflare bypass · session cache · camoufox firefox · turnstile solver · recaptcha audio · geetest slide · hcaptcha · proxy escalation · self-healing pool ·<br>persistent pool · domain stickiness · zero cold starts · flaresolver compat · prowlarr · jackett · sonarr · radarr · redis cache · open source · persistent pool · domain stickiness · zero cold starts · flaresolver compat · prowlarr · jackett · sonarr · radarr · redis cache · open source · persistent pool · domain stickiness · zero cold starts · flaresolver compat · prowlarr · jackett · sonarr · radarr · redis cache · open source · persistent pool · domain stickiness · zero cold starts · flaresolver compat · prowlarr · jackett · sonarr · radarr · redis cache · open source ·

FlareSolverr v2 compatible —ProwlarrJackettSonarrRadarrLidarrReadarrWhisparr<br>— connect with a single URL change

execution tiers

0ms<br>cached domain latency

0×<br>faster on warm domains

external API keys needed

capabilities<br>one engine for the protected web.<br>Adaptive scraping tiers, browser-backed challenge handling, embedded CAPTCHA flows, and a general-purpose proxy.<br>Adaptive Tier Engine unique<br>Every request takes the cheapest path first — plain HTTP, then cached session, then live browser solve, then residential proxy. You pay the full browser cost only when you have to.

General HTTP/HTTPS Proxy v1.2+<br>Proxy ordinary HTTP, HTTPS, WebSockets, binary files, and Range requests through port 8192. Direct traffic stays lightweight; detected challenge pages escalate through TRAWL's solver tiers.

Camoufox Firefox stealthy<br>Powered by Camoufox — a hardened Firefox build that patches fingerprints at the C++ level. Cloudflare's bot score sees a real user. No CDP leaks. No Chrome fingerprint flags.

Cloudflare + WAF Bypass fastest<br>Fresh browser contexts handle Cloudflare managed mode, Akamai behavioral interstitials, and Imperva sensor flows. Solved cookies are extracted and cached immediately.

Captcha Suite auto<br>Turnstile via shadow DOM click, reCAPTCHA v2 via free audio STT, hCaptcha auto-pass, and GeeTest v4 slide via canvas gap detection. No external solver APIs. No cost per solve.

Custom Headers exclusive<br>Pass Authorization, Referer, Origin, or any custom header through the native API. The general proxy additionally preserves browser and authenticated traffic headers while filtering unsafe hop-by-hop values.

Session Cache<br>Solved cookies and browser identity are stored in Redis per domain. Accepted sessions avoid unnecessary re-challenges and keep repeat requests fast. TTL is configurable.

Persistent Pool<br>N browser instances stay warm and ready at all times. A request picks up a browser in ~50ms instead of waiting 3–5 seconds for a cold launch. Domain-sticky routing maximises session reuse.

Proxy Escalation<br>Datacenter IP for Tier 3 solves, residential proxy for Tier 4. Escalates automatically when an IP is reputation-flagged. Residential bandwidth is only consumed when truly needed.

FlareSolverr Compatible<br>Implements the FlareSolverr v2 API exactly — including response shape, cookie format, and version string. Prowlarr, Jackett, Sonarr, and Radarr connect with a single URL change.

challenge coverage<br>solve more than Cloudflare.<br>Native flows cover Cloudflare, Akamai, Imperva, and the captchas embedded inside protected pages — all within the same self-hosted tier engine.<br>Challenge handling support across TRAWL, FlareSolverr, and Byparr challenge typeTRAWLFlareSolverrByparrCloudflare Interstitial"Just a moment" redirect page✓ 4–15s · fresh context~ 11–18s~ 13–18sCF Turnstile WidgetEmbedded checkbox on target page✓ shadow DOM click · auto✗ not handled✗ not handledAkamai Bot ManagerBehavioral interstitial + press-and-hold✓ sensor flow · human-like input✗ not handled✗ not handledImperva / IncapsulaSensor-cookie WAF challenge~ browser sensor flow · best effort✗ not handled✗ not handledreCAPTCHA...