Dataset

roboflow.com/formats
ultralytics/yolov5/data/coco128.yaml
COCO - Common Objects in Context
- by 微软研究院（Microsoft Research） at 2014
coco128
ultralytics/JSON2YOLO
- Convert JSON annotations into YOLO format
openlibrary
百度数据集 aistudio.baidu.com/datasetoverview
- 增值税发票数据集-适配PaddleOCR aistudio.baidu.com/datasetdetail/165561
huggingface/datasets
ConardLi/easy-dataset
- AGPLv3, JS
- creating fine-tuning datasets for LLM
- 不支持图片数据集
open-sciencelab/GraphGen
- Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

bash

git clone https://github.com/ConardLi/easy-dataset.git
cd easy-dataset
pnpm i
pnpm run build
pnpm run start


#
docker cp easy-dataset:/app/prisma/db.sqlite easy-dataset/prisma/

docker run --rm -it \
  -p 1717:1717 \
  -v $PWD/easy-dataset/data:/app/local-db \
  -v $PWD/easy-dataset/prisma:/app/prisma \
  --name easy-dataset ghcr.io/conardli/easy-dataset

# docker exec -it easy-dataset npx prisma db push

数据集格式
- coco
- yolo
- alpaca
- sharegpt
文件类型
- json
- jsonl
- csv
- parquet
- arrow

关联信息

参考资料