Skip to content

Ignore path option passed by Spark#184

Merged
staticlibs merged 1 commit intoduckdb:mainfrom
staticlibs:spark_path_option
Apr 9, 2025
Merged

Ignore path option passed by Spark#184
staticlibs merged 1 commit intoduckdb:mainfrom
staticlibs:spark_path_option

Conversation

@staticlibs
Copy link
Collaborator

Apache Spark passes the path option when a SELECT on a JDBC DataSource table is performed. It is the internal Spark option and is likely passed by mistake, so we need to ignore it to allow the connection to be established.

Testing: new test added that checks that the path option is ignored.

Fixes: #55

@staticlibs staticlibs force-pushed the spark_path_option branch 2 times, most recently from ed0cac2 to 23136a7 Compare April 8, 2025 16:29
Apache Spark passes the `path` option when a SELECT on a JDBC DataSource
table is performed. It is the internal Spark option and is likely
passed by mistake, so we need to ignore it to allow the connection
to be established.

Testing: new test added that checks that the `path` option is ognored.

Fixes: duckdb#55
@staticlibs staticlibs merged commit 1265bd0 into duckdb:main Apr 9, 2025
7 checks passed
@staticlibs
Copy link
Collaborator Author

Merging as reviewed offline.

@staticlibs staticlibs deleted the spark_path_option branch April 9, 2025 10:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: support spark jdbc write to duckdb.

1 participant