Skip to content

fix case where the nested field can have multiple types#2072

Closed
amitaggarwal1 wants to merge 5 commits intomalloydata:mainfrom
datairisplatform:amit/sflake_nested_field_fix
Closed

fix case where the nested field can have multiple types#2072
amitaggarwal1 wants to merge 5 commits intomalloydata:mainfrom
datairisplatform:amit/sflake_nested_field_fix

Conversation

@amitaggarwal1
Copy link
Collaborator

fix case where the nested field can have multiple types (based on the 100 sample).

In most cases, we should fail but in cases where the field types are integer and decimal we should not fail and make the field decimal. this can happen when there is a nested field and sometimes has a float value and sometimes an integer value

… 100 sample).

In most cases, we should fail but in cases where the field types are integer and decimal
we should not fail and make the field decimal. this can happen when there is a nested
field and sometimes has a float value and sometimes an integer value
I, Amit Aggarwal <[email protected]>, hereby add my Signed-off-by to this commit: 323229d

Signed-off-by: Amit Aggarwal <[email protected]>
Signed-off-by: Amit Aggarwal <[email protected]>
Copy link
Collaborator

@mtoy-googly-moogly mtoy-googly-moogly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

- make decimal and integer the same
- ignore null values
- remove any fields where there is conflicting types

Signed-off-by: Amit Aggarwal <[email protected]>
Signed-off-by: Amit Aggarwal <[email protected]>
lloydtabb added a commit that referenced this pull request Jan 8, 2025
Copy link
Collaborator

@mtoy-googly-moogly mtoy-googly-moogly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually I need to think about this.

mtoy-googly-moogly added a commit that referenced this pull request Jan 11, 2025
* Add these changes from #2072 and #2074

* Need to also change the way arrays are unnested.

* mtoy's take on the changes ... passes ci-snowflake

* add fix and test for array names ending in numbers

* Add changes from #2088

* delete line for linter

---------

Co-authored-by: Michael Toy <[email protected]>
@mtoy-googly-moogly
Copy link
Collaborator

#2086 has these changes in it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants