Skip to content

[fix] (inverted index) Disallow variant columns from using inverted index format v1 (#43599)#45179

Merged
airborne12 merged 4 commits intoapache:branch-2.1from
csun5285:pick43599_2.1
Dec 11, 2024
Merged

[fix] (inverted index) Disallow variant columns from using inverted index format v1 (#43599)#45179
airborne12 merged 4 commits intoapache:branch-2.1from
csun5285:pick43599_2.1

Conversation

@csun5285
Copy link
Copy Markdown
Contributor

@csun5285 csun5285 commented Dec 9, 2024

pick from master #43599

@doris-robot
Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@csun5285
Copy link
Copy Markdown
Contributor Author

csun5285 commented Dec 9, 2024

run buildall

@csun5285
Copy link
Copy Markdown
Contributor Author

csun5285 commented Dec 9, 2024

run buildall

…ndex format v1 (apache#43599)

Problem Summary:
1. When the inverted index of a variant column uses storage format v1,
schema changes can cause some segments to lack corresponding index
files.

2. By using storage format v2 for inverted indexes, all indexes
correspond to a single file, and the corresponding files will always
exist regardless of whether the variant includes subcolumn indexes.

When creating an inverted index for a variant column, file format v1 is
not supported
@csun5285
Copy link
Copy Markdown
Contributor Author

csun5285 commented Dec 9, 2024

run buildall

@csun5285
Copy link
Copy Markdown
Contributor Author

csun5285 commented Dec 9, 2024

run buildall

Copy link
Copy Markdown
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@airborne12 airborne12 merged commit ca85238 into apache:branch-2.1 Dec 11, 2024
@yiguolei yiguolei mentioned this pull request Jan 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants