v0.1.0

Full Changelog: v0.1.0...v0.1.0

What's Changed

• feat: add GitHub Actions workflow for releasing Docker images by @Dallas98 in #136
• feat(SynthDataDetail): add chunk/synthesis data management with edit/delete & UI enhancements by @Dallas98 in #139
• feature: 增加压缩包上传功能 by @hefanli in #137
• feat(config): add proxy configuration for evaluation API endpoint by @Dallas98 in #141
• fix: k8s部署场景下，backend-python服务挂载需要存储 by @hefanli in #144
• feat(dependencies): update greenlet to version 3.3.0 and adjust Python version compatibility by @Dallas98 in #145
• docs: update README and Makefile for clarity and new development instructions by @Dallas98 in #147
• 修复部分功能 by @hhhhsc701 in #138
• feature: data management supports nested folders by @hefanli in #150
• feat(chart): add Helm chart for deploying Label Studio with PostgreSQL by @Dallas98 in #152
• feature: 增加水印去除/高级匿名化算子 by @hhhhsc701 in #151
• feat(milvus): update Milvus configuration to use URI and remove deprecated host/port settings by @Dallas98 in #153
• fix: fix the Data Evaluation Detail page by @hefanli in #154
• feat(milvus): update Milvus configuration to use URI and remove deprecated host/port settings by @Dallas98 in #155
• feat: enhance dataset file fetching with improved pagination and document loading support by @Dallas98 in #156
• feature: 增加data-juicer算子 by @hhhhsc701 in #157
• Revert "feature: 增加data-juicer算子" by @hhhhsc701 in #158
• fix: update MILVUS_URI in .env.example for correct service endpoint by @hhhhsc701 in #159
• feat: add .env and conf.yaml for deer-flow configuration by @hhhhsc701 in #160
• docs: update README files to include instructions for accessing the f… by @hhhhsc701 in #161
• Fix ratio by @hefanli in #162
• feat(frontend): 增强Synthesis Data Detail页面UX体验 by @Dallas98 in #163
• bugfix by @hhhhsc701 in #164
• 补充modal范围 by @hhhhsc701 in #165
• feature: 商业版构建 by @hhhhsc701 in #166
• feature: add the pipeline for pushing images to Huawei Cloud by @hefanli in #167
• 修改系统参数的预置数据 by @hefanli in #170
• fix: the interface for querying data set files is compatible with ret… by @hefanli in #171
• bugfix: update values.yaml to enhance ray-cluster configuration with security context, environment variables, and resource limits by @hhhhsc701 in #172
• fix: update Dockerfile to improve pip installation process and remove unnecessary uninstalls by @hhhhsc701 in #173
• 支持mineru npu处理 by @hhhhsc701 in #174
• fix: streamline Dockerfile by removing redundant mirror configuration… by @hhhhsc701 in #175
• fix(docker-compose): update entrypoint and command for mineru-openai-server configuration by @Dallas98 in #176
• fix: optimize PDF parsing by implementing concurrent processing with … by @hhhhsc701 in #177
• feat：问题生成过程优化及COT数据生成优化 by @Dallas98 in #169
• feat(model_chat): enhance JSON parsing by removing additional thought tags and improving fallback logic by @Dallas98 in #178
• feat: add operator-packages-volume to docker-compose and update Docke… by @hhhhsc701 in #179
• feat(generation_service): add document filtering to remove short documents based on chunk size by @Dallas98 in #180
• add export type settings and enhance metadata structure by @hhhhsc701 in #181
• feat(generation_service): add image URL extraction and random QA generation logic by @Dallas98 in #182
• 配置文件更改 by @Dallas98 in #186
• feat: add download functionality for example operator and update Dock… by @hhhhsc701 in #188
• add gateway by @hefanli in #187
• fix: fix the routes definition by @hefanli in #189
• Feat gateway by @hefanli in #191
• fix: prevent deletion of predefined operators and improve error handling by @hhhhsc701 in #192
• feat: deer-flow通过gateway转发 by @hhhhsc701 in #193
• Fix the ratio task bug by @hefanli in #194
• feat: add CodeQL analysis workflow configuration by @Dallas98 in #196
• feat: 支持npu自动扩缩容 by @hhhhsc701 in #197
• feat: label-studio构建脚本 by @hhhhsc701 in #198
• feat: label-studio支持指定sc by @hhhhsc701 in #200
• feature: LabelStudio jumps without login by @hefanli in #201
• feat: fix the problem in the Operator Market frontend pages by @o0Shark0o in #203
• Revert "feat: fix the problem in the Operator Market frontend pages" by @o0Shark0o in #204
• fix: reset pagination when switching operator market category filters by @o0Shark0o in #205
• feat: 增加label-studio的k8s部署卸载 by @Dallas98 in #206
• feat: 修复清洗任务创建 by @hhhhsc701 in #207
• refactor: modify data collection to python implementation by @hefanli in #214
• feat: 支持运行data-juicer算子 by @hhhhsc701 in #215
• feat: 算子上传适配 by @hhhhsc701 in #216
• polish(operator cards): improve icon color distinction and subtle UI … by @o0Shark0o in #217
• fix: fix the collection for nfs by @hefanli in #218
• feat: update Docker configuration to include backend Nginx settings by @Dallas98 in #219

New Contributors

• @o0Shark0o made their first contribution in #203

Full Changelog: v0.0.1-beta...v0.1.0

v0.0.1-beta

Full Changelog: v0.0.1-beta...v0.0.1-beta

What's Changed

• feat: Add download and load images functionality to Makefile by @JasonW404 in #115
• Integrated Redux for state management with auth and settings slices. by @chenghh-9609 in #117
• bugfix: 清洗/算子支持名称/描述搜索 by @hhhhsc701 in #116
• bugfix: 支持使用runtime单实例 by @hhhhsc701 in #118
• feat: new endpoint allowing only add file path to dataset record without any FS operations by @JasonW404 in #119
• feat: Add original file ID to document metadata in RagEtlService by @Dallas98 in #121
• feat: Implement data synthesis task management with database models and API endpoints by @Dallas98 in #122
• feat: Update Python version requirements and refine dependency constraints in configuration by @Dallas98 in #123
• bugfix: 修复deer-flow部署 by @hhhhsc701 in #124
• fix: Correctly extract file values from selectedFilesMap in AddDataDialog by @Dallas98 in #125
• 优化部分问题 by @hhhhsc701 in #126
• feature: 修改算子开发指南 by @hhhhsc701 in #127
• feature: add data-evaluation by @hefanli in #128
• feat: enhance backend deployment, frontend file selection and synthesis task management by @Dallas98 in #129
• feat(synthesis): add chunk-level synthesis data detail page & refine APIs/routing by @Dallas98 in #130
• feature: 增加对redis未部署时异常捕获 by @hhhhsc701 in #131
• feat(synthesis): add functionality to archive synthesis tasks to existing datasets by @Dallas98 in #132
• fix: 修复评估时模型输出json格式不对导致读取错误的问题 by @hefanli in #133
• 算子将抽取与落盘固定到流程中 by @hhhhsc701 in #134

New Contributors

• @chenghh-9609 made their first contribution in #12
• @JasonW404 made their first contribution in #13
• @Startalker made their first contribution in #17
• @szc0616 made their first contribution in #59

Full Changelog: https://github.com/ModelEngine-Group/DataMate/commits/v0.0.1-beta