Skip to content

Conversation

@theuvargas
Copy link
Collaborator

This pull request implements most features from issue #12 and its subissues.

  • Integrates Scraper and Navigator into the main pipeline with a rule-based query enhancer. If the evidence isn't strong enough, it uses the rules defined in the decideEnhancement function to decide to use either the scraper or the navigator.
  • URL deduplication: prevents the same URL from being processed more than once by the pipeline
  • LLM gate picker: uses a LLM to select the most promising URLs for processing
  • 3 tests: one for the validation (of a single example), one for the enhancement, and one end-to-end test with 10 fixed predictions from the DB

@linear
Copy link

linear bot commented Dec 17, 2025

@theuvargas theuvargas requested a review from kings177 December 17, 2025 22:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants