Switch crawler to curl_cffi #63

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

OEvortex merged 1 commit into main from codex/improve-webscout-by-refining-scout-features

May 25, 2025

Owner

OEvortex commented May 25, 2025

Summary

use curl_cffi Session instead of requests in ScoutCrawler
document curl_cffi dependency in README

Testing

ruff check webscout/scout/core/crawler.py
ruff check webscout/scout/element.py
ruff check webscout/scout/core/scout.py


          refactor(crawler): switch to curl_cffi

78a033b

OEvortex added the codex label

— with

ChatGPT Codex Connector

OEvortex merged commit b29b2c0 into main

2 of 3 checks passed

OEvortex deleted the codex/improve-webscout-by-refining-scout-features branch

December 1, 2025 14:56

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels