Skip to content

Conversation

@yliang412
Copy link
Member

@yliang412 yliang412 commented Jan 22, 2026

closes #29

Problem

Previously, we only had limited support for some data types and used our own schema. It makes sense to directly adopt arrow-schema.

Summary of changes

  • use arrow-schema.
  • support decimals and date ScalarValue and DataType.
  • Cleaner error handling in the datafusion connector.

Signed-off-by: Yuchen Liang <yuchenl3@andrew.cmu.edu>
Signed-off-by: Yuchen Liang <yuchenl3@andrew.cmu.edu>
Signed-off-by: Yuchen Liang <yuchenl3@andrew.cmu.edu>
Signed-off-by: Yuchen Liang <yuchenl3@andrew.cmu.edu>
Signed-off-by: Yuchen Liang <yuchenl3@andrew.cmu.edu>
Signed-off-by: Yuchen Liang <yuchenl3@andrew.cmu.edu>
Signed-off-by: Yuchen Liang <yuchenl3@andrew.cmu.edu>
@yliang412 yliang412 marked this pull request as ready for review January 22, 2026 19:54
Signed-off-by: Yuchen Liang <yuchenl3@andrew.cmu.edu>
@yliang412 yliang412 merged commit 92c9780 into main Jan 22, 2026
8 checks passed
@yliang412 yliang412 deleted the yuchen/arrow-data-types-and-schema branch January 22, 2026 21:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support More Data Types

2 participants