[2026.01.16] - 2026-01-16 by OEvortex · Pull Request #113 · OEvortex/Webscout

OEvortex · 2026-01-16T17:59:41Z

This pull request introduces major new functionality and improvements centered around Brave search engine support across multiple modalities, including videos, news, images, and suggestions. It also adds a new AI search provider, refines CLI output, and improves documentation. The most important changes are grouped by theme below.

Brave Search Engine Integration

Added new engines: BraveVideos, BraveNews, BraveSuggestions, and BraveImages, each capable of parsing HTML or API responses to extract rich results (videos, news articles, suggestions, images) with metadata and pagination support. ([changelog.mdR5-R31](https://github.com/OEvortex/Webscout/pull/113/files#diff-3bd14d078188074c410028847113ceae68865d0ad5b844a27183ef87fbe2fcc3R5-R31))
Implemented and unified these engines in BraveSearch interface, enabling seamless access to all Brave search types. ([changelog.mdR5-R31](https://github.com/OEvortex/Webscout/pull/113/files#diff-3bd14d078188074c410028847113ceae68865d0ad5b844a27183ef87fbe2fcc3R5-R31))

CLI and UI Improvements

Refactored webscout/cli.py to introduce specialized print functions for videos, news, suggestions, and images, improving result formatting and user experience. Helper functions for formatting and truncation were also added. ([changelog.mdR5-R31](https://github.com/OEvortex/Webscout/pull/113/files#diff-3bd14d078188074c410028847113ceae68865d0ad5b844a27183ef87fbe2fcc3R5-R31))

Provider and API Enhancements

Added BraveAI.py provider for AI-powered search and deep research, supporting both streaming and non-streaming modes. Updated exports and documentation for the new provider. ([changelog.mdR5-R31](https://github.com/OEvortex/Webscout/pull/113/files#diff-3bd14d078188074c410028847113ceae68865d0ad5b844a27183ef87fbe2fcc3R5-R31))

Testing and Quality Assurance

Added comprehensive unit and integration tests for BraveImages in tests/providers/test_brave_images.py, covering initialization, payload building, pagination, result extraction, and real web searches. ([tests/providers/test_brave_images.pyR1-R215](https://github.com/OEvortex/Webscout/pull/113/files#diff-b33b8220d17bb1b75eff4d256e0d0c7af22c83c7821a2da48b5b62d47b380efdR1-R215))
Added a demo script lol.py to exercise all new Brave engines and display their results using rich formatting. ([lol.pyR1-R63](https://github.com/OEvortex/Webscout/pull/113/files#diff-ee804a83ab10a6e0c63438659b6c7f76c9a7cf5dbcf4805424c65d8bb7a0240cR1-R63))

Documentation Updates

Updated CLI help text and endpoint documentation to reflect new Brave features and improved parameter handling. ([changelog.mdR5-R31](https://github.com/OEvortex/Webscout/pull/113/files#diff-3bd14d078188074c410028847113ceae68865d0ad5b844a27183ef87fbe2fcc3R5-R31))

These changes collectively provide robust Brave search capabilities, improved developer experience, and higher code quality across the project.

Signed-off-by: OEvortex <[email protected]>

…h and localization Signed-off-by: OEvortex <[email protected]>

…nguage and localization Signed-off-by: OEvortex <[email protected]>

…I capabilities; remove unused ChatZAI provider and line counter script; introduce docstring and reverse engineering agents Signed-off-by: OEvortex <[email protected]>

…tor Brave engine; update documentation and usage instructions Signed-off-by: OEvortex <[email protected]>

…d parsing - Updated the unified web search endpoint to include video search capabilities and enhanced suggestions handling. - Added Brave search engines for text, images, news, suggestions, and videos with comprehensive parsing logic. - Implemented unit tests for Brave text search parsing to ensure accuracy and reliability. - Introduced a new BraveSearch class to unify search functionalities across different media types. - Enhanced error handling in search engines to manage varying method signatures and improve robustness. Signed-off-by: OEvortex <[email protected]>

Signed-off-by: OEvortex <[email protected]>

Copilot

Pull request overview

This pull request introduces comprehensive Brave search engine support across multiple modalities (videos, news, images, suggestions) and adds a new BraveAI search provider. The implementation follows a consistent architecture pattern with a base class and specialized search engines for each content type, along with enhanced CLI formatting capabilities and server-side improvements.

Changes:

Added five new Brave search engines: BraveTextSearch, BraveVideos, BraveNews, BraveImages, and BraveSuggestions, each with HTML/API parsing capabilities
Introduced BraveAI provider for AI-powered search with streaming support
Enhanced CLI with specialized formatting functions for videos, news, suggestions, and images
Updated server routes with improved suggestions parameter handling

Reviewed changes

Copilot reviewed 38 out of 38 changed files in this pull request and generated 13 comments.

Show a summary per file

File	Description
webscout/search/engines/brave/base.py	New base class for all Brave search implementations with session management
webscout/search/engines/brave/videos.py	Complete video search implementation with view count parsing and metadata extraction
webscout/search/engines/brave/news.py	News search with date detection and thumbnail handling
webscout/search/engines/brave/suggestions.py	Autocomplete API with rich entity support
webscout/search/engines/brave/images.py	Image search with base64 URL extraction
webscout/search/engines/brave/text.py	Text search with fallback retry logic
webscout/Provider/AISEARCH/brave_search.py	New AI search provider with async support
webscout/cli.py	Added specialized print functions and formatting utilities
webscout/server/routes.py	Improved suggestions endpoint parameter handling
tests/providers/test_brave_images.py	Comprehensive unit and integration tests
tests/providers/test_brave_text.py	Text search parsing tests
Multiple files	Removed `# type: ignore` comments (type checking cleanup)

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-01-16T18:06:19Z

webscout/search/engines/brave/text.py

+
+        Uses server-rendered HTML and parses result containers with CSS selectors.
+        """
+        from typing import cast


The cast import is imported but never used in this method. This import should be removed or moved to the top of the file if it's needed elsewhere.

Copilot · 2026-01-16T18:06:20Z

webscout/Provider/AISEARCH/brave_search.py

+        self.country = country
+        self.ui_lang = ui_lang
+        self.geoloc = geoloc
+        self.last_response = {}


The last_response attribute is initialized as an empty dict but later assigned SearchResponse objects (line 248, 279). This inconsistent typing could cause issues. Consider initializing as self.last_response: Optional[SearchResponse] = None or self.last_response: Union[SearchResponse, Dict] = SearchResponse("") for type consistency.

Suggested change

self.last_response = {}

self.last_response: Optional[SearchResponse] = None

Copilot · 2026-01-16T18:06:20Z

webscout/server/routes.py

+                                    # Suggestions method might have different signature
+                                    try:
+                                        results = method(q, region=region, max_results=max_results)
+                                    except TypeError:
+                                        # Fallback for engines that don't accept region
+                                        results = method(q, max_results=max_results)


The bare except TypeError catches any TypeError, not just parameter-related ones. This could mask other TypeErrors from within the method call. Consider catching more specific exceptions or logging the error details to distinguish between parameter signature mismatches and other issues.

Copilot · 2026-01-16T18:06:20Z

webscout/cli.py

+        first_item = data[0]
+
+        # Handle dataclass objects by converting to dict
+        if hasattr(first_item, "__dataclass_fields__"):
+            # Convert dataclass to dict for each item
+            data = [
+                {k: getattr(item, k, "") for k in first_item.__dataclass_fields__}
+                for item in data
+            ]
+            first_item = data[0]


The dataclass-to-dict conversion uses getattr(item, k, "") which defaults to an empty string for missing fields. This could hide actual missing attributes. Consider using getattr(item, k) without a default, or use dataclasses.asdict() for more robust conversion that will raise AttributeError for truly missing fields.

Copilot · 2026-01-16T18:06:21Z

webscout/Provider/AISEARCH/brave_search.py

+if __name__ == "__main__":
+    ai = BraveAI()
+    res = ai.search("What is Python?", stream=True, enable_research=True)
+    from collections.abc import Iterable
+
+    if isinstance(res, Iterable):
+        for chunk in res:
+            print(chunk, end="", flush=True)
+    else:
+        print(res)


The import from collections.abc import Iterable is placed inside the if __name__ == "__main__" block after usage. While this works, it's unconventional. Move the import to the top of the block (line 290) for better readability: from collections.abc import Iterable before creating the ai instance.

Copilot · 2026-01-16T18:06:22Z

webscout/search/engines/brave/text.py

+from __future__ import annotations
+
+from time import sleep
+from typing import List, Optional


Import of 'Optional' is not used.

Copilot · 2026-01-16T18:06:22Z

webscout/search/engines/brave/images.py

+                        except (ValueError, IndexError):
+                            pass
+                    if "--height:" in style:
+                        try:
+                            height = int(style.split("--height:")[1].split(";")[0].strip())
+                        except (ValueError, IndexError):


'except' clause does nothing but pass and there is no explanatory comment.

Suggested change

except (ValueError, IndexError):

pass

if "--height:" in style:

try:

height = int(style.split("--height:")[1].split(";")[0].strip())

except (ValueError, IndexError):

except (ValueError, IndexError):

# Ignore malformed or missing width value; default width=0 is acceptable.

pass

if "--height:" in style:

try:

height = int(style.split("--height:")[1].split(";")[0].strip())

except (ValueError, IndexError):

# Ignore malformed or missing height value; default height=0 is acceptable.

Copilot · 2026-01-16T18:06:22Z

webscout/search/engines/brave/images.py

+                    if "--height:" in style:
+                        try:
+                            height = int(style.split("--height:")[1].split(";")[0].strip())
+                        except (ValueError, IndexError):


'except' clause does nothing but pass and there is no explanatory comment.

Copilot · 2026-01-16T18:06:23Z

webscout/search/engines/brave/images.py

+                decoded = base64.b64decode(normalized).decode("utf-8", errors="ignore")
+                if decoded.startswith("http"):
+                    return decoded
+        except Exception:


'except' clause does nothing but pass and there is no explanatory comment.

Copilot · 2026-01-16T18:06:23Z

webscout/search/engines/brave/text.py

+                    sib = fn("div", class_="snippet")
+                    if sib:
+                        candidates.append(sib.select_one(".generic-snippet"))
+            except Exception:


'except' clause does nothing but pass and there is no explanatory comment.

OEvortex added 10 commits January 15, 2026 14:06

feat: Add BraveAI provider for AI-generated responses using Brave Search

17b8f04

Signed-off-by: OEvortex <[email protected]>

feat: Enhance BraveAI provider with additional parameters for researc…

1d41add

…h and localization Signed-off-by: OEvortex <[email protected]>

feat: Update BraveAI provider to support additional parameters for la…

c8599d1

…nguage and localization Signed-off-by: OEvortex <[email protected]>

Jan 15, 2026, 2:57 PM

27f7e58

Jan 15, 2026, 2:59 PM

3e394b2

Jan 15, 2026, 3:08 PM

05dd54a

Jan 15, 2026, 3:09 PM

0dbcb78

feat: Add agent orchestration and subagent definitions for enhanced A…

655c285

…I capabilities; remove unused ChatZAI provider and line counter script; introduce docstring and reverse engineering agents Signed-off-by: OEvortex <[email protected]>

feat: Implement BraveImages search engine and associated tests; refac…

251938f

…tor Brave engine; update documentation and usage instructions Signed-off-by: OEvortex <[email protected]>

Copilot AI review requested due to automatic review settings January 16, 2026 17:59

Copilot started reviewing on behalf of OEvortex January 16, 2026 18:00 View session

feat: Remove deprecated testing script for Brave search engines

8896493

Signed-off-by: OEvortex <[email protected]>

OEvortex merged commit c6bde57 into main Jan 16, 2026
2 checks passed

OEvortex deleted the feature/search branch January 16, 2026 18:01

Copilot AI reviewed Jan 16, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[2026.01.16] - 2026-01-16#113

[2026.01.16] - 2026-01-16#113
OEvortex merged 11 commits intomainfrom
feature/search

OEvortex commented Jan 16, 2026

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Copilot AI Jan 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

	self.last_response = {}
	self.last_response: Optional[SearchResponse] = None

Uh oh!

Conversation

OEvortex commented Jan 16, 2026

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant