Skip to content

Data: Fix equality deletes failing for nested field identifiers.#16280

Open
vigneshc-dd wants to merge 6 commits into
apache:mainfrom
vigneshc-dd:vigneshc/nested_equality_filter_bug
Open

Data: Fix equality deletes failing for nested field identifiers.#16280
vigneshc-dd wants to merge 6 commits into
apache:mainfrom
vigneshc-dd:vigneshc/nested_equality_filter_bug

Conversation

@vigneshc-dd
Copy link
Copy Markdown

@vigneshc-dd vigneshc-dd commented May 10, 2026

Issue: #15826 DeleteFilter does not nested equality delete columns when the select did not include those columns.
Fix:

  • Use TypeUtil.project to preserve the struct hierarchy.
  • Paths that do not provide the table schema still has the bug, this path doesn't seem to be used anywhere.

AI Usage: Used claude code to understand the related files, and for the code. Reviewed all the changes, iterated few times before commits.

@github-actions github-actions Bot added the data label May 10, 2026
@github-actions github-actions Bot added the spark label May 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant