[Enhancement] Add Self Refinement Feature #105
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
π SyGra now supports Self Refinement
Summary π§Ύβ¨
This PR adds Self Refinement as a first-class SyGra feature ππ€. This uses newly implemented sygra.recipes.self_refinement recipe as a subgraph inside a task π§©. Generated datasets that include judge scores β π and a reflection trajectory πͺπ§ for each prompt.
Feature implemented: π
Performance impact (if any): β‘
N/A
How to Test the feature π§ͺ
Steps for reviewers to verify functionality:
Run the example task and observe generated artifactsβΆοΈ :
Run: python main.py --task examples.self_refinement --num_records 2 πββοΈπ»
Observe output JSON under tasks/examples/self_refinement/ (e.g., output_.json) π¦π
self_refine.generate_candidate and self_refine.judge_candidate are tracked ππ§Ύ
Screenshots (if applicable) πΈ
N/A
Checklist β
Notes ποΈ
N/A