Skip to content

Commit ecced53

Browse files
committed
Add environment setup guide, pricing table, and interactive diagram
- Add comprehensive API key setup instructions for Windows/Linux/macOS - Add pricing comparison table showing Scrappey's competitive advantages - Add interactive Mermaid diagram showing request flow - Update version to 1.0.3
1 parent a83afc1 commit ecced53

File tree

3 files changed

+121
-2
lines changed

3 files changed

+121
-2
lines changed

README.md

Lines changed: 119 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,12 +18,120 @@ Official Python wrapper for [Scrappey.com](https://scrappey.com) - Web scraping
1818
- **Type Hints** - Full type annotations for IDE support and AI assistants
1919
- **Drop-in Replacement** - Use as a replacement for the `requests` library
2020

21+
## Pricing
22+
23+
Scrappey offers the best value for web scraping with JavaScript rendering and residential proxies:
24+
25+
| Feature | Scrappey | ZenRows | ScrapingBee | Scrapfly |
26+
|---------|----------|---------|-------------|----------|
27+
| **Price per 1K Scrapes**<br/>(JS Render + Residential Proxies) | **€1** | $25 | $25 | $187 |
28+
| **Concurrent Requests**<br/>(Simultaneous scraping) | **200** | 10 | 5 | 5 |
29+
| **Browser Automation**<br/>(Actions and interactions) | **30+ Actions** | Basic | Basic | Basic |
30+
| **Billing Model**<br/>(Payment flexibility) | **Pay-as-you-go** | Monthly | Monthly | Monthly |
31+
| **Success Rate**<br/>(Successful scrapes) | **95%** | 95% | 95% | 95% |
32+
33+
**Why Scrappey?**
34+
- 🚀 **25x cheaper** than competitors for JS rendering
35+
-**20x more concurrent requests** (200 vs 5-10)
36+
- 🎯 **30+ browser actions** vs basic automation
37+
- 💰 **Pay-as-you-go** - no monthly commitments
38+
-**Same 95% success rate** as premium services
39+
40+
## How It Works
41+
42+
```mermaid
43+
graph TB
44+
A[Your Application] -->|1. Send Request| B[Scrappey API]
45+
B -->|2. Route Request| C{Request Type?}
46+
C -->|Browser Mode| D[Headless Browser]
47+
C -->|Request Mode| E[HTTP Library + TLS]
48+
D -->|3. Execute| F[Browser Actions]
49+
E -->|3. Execute| G[HTTP Request]
50+
F -->|4. Bypass| H[Cloudflare/Datadome/etc]
51+
G -->|4. Bypass| H
52+
H -->|5. Solve| I[Captchas if needed]
53+
I -->|6. Return| J[HTML/JSON Response]
54+
J -->|7. Deliver| A
55+
56+
style A fill:#e1f5ff
57+
style B fill:#4CAF50,color:#fff
58+
style D fill:#2196F3,color:#fff
59+
style E fill:#FF9800,color:#fff
60+
style H fill:#9C27B0,color:#fff
61+
style I fill:#F44336,color:#fff
62+
style J fill:#4CAF50,color:#fff
63+
```
64+
65+
**Request Flow:**
66+
1. **Your application** sends a request to Scrappey API
67+
2. **Scrappey routes** to browser or HTTP mode based on `requestType`
68+
3. **Browser/HTTP engine** executes the request with fingerprinting
69+
4. **Antibot bypass** automatically handles Cloudflare, Datadome, etc.
70+
5. **Captcha solving** if needed (reCAPTCHA, hCaptcha, Turnstile)
71+
6. **Response returned** with HTML, JSON, or extracted data
72+
7. **Delivered** back to your application
73+
2174
## Installation
2275

2376
```bash
2477
pip install scrappey
2578
```
2679

80+
## API Key Setup
81+
82+
You can provide your Scrappey API key in two ways:
83+
84+
### Option 1: Environment Variable (Recommended)
85+
86+
Set the `SCRAPPEY_API_KEY` environment variable:
87+
88+
**Windows (PowerShell):**
89+
```powershell
90+
# Temporary (current session only)
91+
$env:SCRAPPEY_API_KEY = "your_api_key_here"
92+
93+
# Permanent (user-level)
94+
[System.Environment]::SetEnvironmentVariable('SCRAPPEY_API_KEY', 'your_api_key_here', [System.EnvironmentVariableTarget]::User)
95+
```
96+
97+
**Windows (Command Prompt):**
98+
```cmd
99+
# Temporary (current session only)
100+
set SCRAPPEY_API_KEY=your_api_key_here
101+
102+
# Permanent (user-level)
103+
setx SCRAPPEY_API_KEY "your_api_key_here"
104+
```
105+
106+
**Linux/macOS (Bash/Zsh):**
107+
```bash
108+
# Temporary (current session only)
109+
export SCRAPPEY_API_KEY="your_api_key_here"
110+
111+
# Permanent (add to ~/.bashrc or ~/.zshrc)
112+
echo 'export SCRAPPEY_API_KEY="your_api_key_here"' >> ~/.bashrc
113+
source ~/.bashrc
114+
```
115+
116+
**Linux/macOS (Fish):**
117+
```fish
118+
# Temporary (current session only)
119+
set -x SCRAPPEY_API_KEY "your_api_key_here"
120+
121+
# Permanent (add to ~/.config/fish/config.fish)
122+
echo 'set -x SCRAPPEY_API_KEY "your_api_key_here"' >> ~/.config/fish/config.fish
123+
```
124+
125+
### Option 2: Pass Directly in Code
126+
127+
```python
128+
from scrappey import Scrappey
129+
130+
scrappey = Scrappey(api_key="your_api_key_here")
131+
```
132+
133+
> **Note**: Get your API key from [https://app.scrappey.com](https://app.scrappey.com)
134+
27135
## Quick Start
28136

29137
```python
@@ -446,12 +554,23 @@ except ScrappeyError as e:
446554
print(f"API error: {e}")
447555
```
448556

557+
## Pricing & Plans
558+
559+
Visit [https://scrappey.com/pricing](https://scrappey.com/pricing) for detailed pricing information and plans.
560+
561+
**Key Benefits:**
562+
- 💰 **Pay-as-you-go** - Only pay for what you use
563+
- 🎯 **No monthly commitments** - Cancel anytime
564+
- 📊 **Transparent pricing** - See costs before you scrape
565+
- 🚀 **Volume discounts** - Better rates for high-volume users
566+
449567
## Links
450568

451569
- **Website**: https://scrappey.com
452570
- **Documentation**: https://wiki.scrappey.com/getting-started
453571
- **Request Builder**: https://app.scrappey.com/#/builder
454572
- **API Reference**: https://wiki.scrappey.com/api-reference
573+
- **Pricing**: https://scrappey.com/pricing
455574
- **GitHub**: https://github.com/pim97/scrappey-wrapper-python
456575

457576
## License

pyproject.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
44

55
[project]
66
name = "scrappey"
7-
version = "1.0.2"
7+
version = "1.0.3"
88
description = "Official Python wrapper for Scrappey.com - Web scraping API with Cloudflare bypass, antibot solving, and browser automation"
99
readme = {file = "README.md", content-type = "text/markdown"}
1010
license = {text = "MIT"}

src/scrappey/__init__.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -88,7 +88,7 @@ async def main():
8888
WhileAction,
8989
)
9090

91-
__version__ = "1.0.1"
91+
__version__ = "1.0.3"
9292

9393
__all__ = [
9494
# Main clients

0 commit comments

Comments
 (0)