Skip to content

Commit 38532d7

Browse files
committed
[CELEBORN-2166][FOLLOWUP] Update config celeborn.client.shuffleDataLostOnUnknownWorker.enabled version to 0.6.3
### What changes were proposed in this pull request? Update config celeborn.client.shuffleDataLostOnUnknownWorker.enabled version to 0.6.3 ### Why are the changes needed? Followup for #3496, it is better to merge into branch-0.6 as well. ### Does this PR resolve a correctness bug? No. ### Does this PR introduce _any_ user-facing change? No, it has not been releases yet. ### How was this patch tested? GA. Closes #3576 from turboFei/update_conf. Authored-by: Wang, Fei <fwang12@ebay.com> Signed-off-by: Wang, Fei <fwang12@ebay.com>
1 parent 526f7bb commit 38532d7

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6795,7 +6795,7 @@ object CelebornConf extends Logging {
67956795
val CLIENT_SHUFFLE_DATA_LOST_ON_UNKNOWN_WORKER_ENABLED: ConfigEntry[Boolean] =
67966796
buildConf("celeborn.client.shuffleDataLostOnUnknownWorker.enabled")
67976797
.categories("client")
6798-
.version("0.7.0")
6798+
.version("0.6.3")
67996799
.doc("Whether to mark shuffle data lost when unknown worker is detected.")
68006800
.booleanConf
68016801
.createWithDefault(false)

docs/configuration/client.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -121,7 +121,7 @@ license: |
121121
| celeborn.client.shuffle.rangeReadFilter.enabled | false | false | If a spark application have skewed partition, this value can set to true to improve performance. | 0.2.0 | celeborn.shuffle.rangeReadFilter.enabled |
122122
| celeborn.client.shuffle.register.filterExcludedWorker.enabled | false | false | Whether to filter excluded worker when register shuffle. | 0.4.0 | |
123123
| celeborn.client.shuffle.reviseLostShuffles.enabled | false | false | Whether to revise lost shuffles. | 0.6.0 | |
124-
| celeborn.client.shuffleDataLostOnUnknownWorker.enabled | false | false | Whether to mark shuffle data lost when unknown worker is detected. | 0.7.0 | |
124+
| celeborn.client.shuffleDataLostOnUnknownWorker.enabled | false | false | Whether to mark shuffle data lost when unknown worker is detected. | 0.6.3 | |
125125
| celeborn.client.slot.assign.maxWorkers | 10000 | false | Max workers that slots of one shuffle can be allocated on. Will choose the smaller positive one from Master side and Client side, see `celeborn.master.slot.assign.maxWorkers`. | 0.3.1 | |
126126
| celeborn.client.spark.fetch.cleanFailedShuffle | false | false | whether to clean those disk space occupied by shuffles which cannot be fetched | 0.6.0 | |
127127
| celeborn.client.spark.fetch.cleanFailedShuffleInterval | 1s | false | the interval to clean the failed-to-fetch shuffle files, only valid when celeborn.client.spark.fetch.cleanFailedShuffle is enabled | 0.6.0 | |

0 commit comments

Comments
 (0)