Add zero_division parameter to F1 metric#722
Open
Aaryaman3 wants to merge 1 commit intohuggingface:mainfrom
Open
Add zero_division parameter to F1 metric#722Aaryaman3 wants to merge 1 commit intohuggingface:mainfrom
Aaryaman3 wants to merge 1 commit intohuggingface:mainfrom
Conversation
Adds zero_division parameter to F1._compute() to match sklearn.metrics.f1_score interface. Controls behavior when precision/recall denominators are zero. Default value is 0 for backward compatibility.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add zero_division parameter to F1 metric
Fixes TypeError when passing zero_division argument to F1.compute().
sklearn.metrics.f1_score raises UndefinedMetricWarning suggesting use
of zero_division parameter, but evaluate.load("f1") did not accept it.
Changes:
This change adds the zero_division parameter that directly passes through to sklearn.metrics.f1_score, which already has comprehensive tests for this parameter
Resolves crashes when computing F1 with classes that have neither
predictions nor ground truth labels.
Fixes #699