Skip to content

fix: fixing splitting logic#4554

Open
mutianf wants to merge 5 commits intogoogleapis:mainfrom
mutianf:better-splits
Open

fix: fixing splitting logic#4554
mutianf wants to merge 5 commits intogoogleapis:mainfrom
mutianf:better-splits

Conversation

@mutianf
Copy link
Copy Markdown
Contributor

@mutianf mutianf commented Mar 31, 2026

The current split logic doesn't work well on very large tables because it caps the max number of splits too low and will merge tablets instead of using desired bundle size.

The updated logic will do the following:

  1. Get keys from sample row keys
  2. If the tablet is < desired bundle size, merge the tablets
  3. If step 2 generated more than 5 million splits, merge more tablets to cap the abosulte max number of splits to 5M.

mutianf added 4 commits March 27, 2026 13:14
Change-Id: I305c6b2182300f4ffdce8b8de523a5c0487d41ec
Change-Id: I68bbe7fd1b1026c13f9bf1c2f28b43a99280971e
Change-Id: I06e3cdec7bc246ec27e6a83240175af5143e61fe
Change-Id: I90db995cac0cf27de9520be459b06e834b23dae0
@mutianf mutianf requested a review from a team as a code owner March 31, 2026 18:12
@product-auto-label product-auto-label bot added size: m Pull request size is medium. api: bigtable Issues related to the googleapis/java-bigtable-hbase API. labels Mar 31, 2026
Change-Id: I09b61e2c740739fd26279b79e3d4f9eafb4f637c
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: bigtable Issues related to the googleapis/java-bigtable-hbase API. size: m Pull request size is medium.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant