[Coati] Train DPO using PP (#6054)
* update dpo * remove unsupport plugin * update msg * update dpo * remove unsupport plugin * update msg * update template * update dataset * add pp for dpo * update dpo * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add dpo fn * update dpo * update dpo * update dpo * update dpo * minor update * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * update loss * update help * polish code --------- Co-authored-by:pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
显示
- applications/ColossalChat/coati/models/loss.py 3 个添加, 2 个删除applications/ColossalChat/coati/models/loss.py
- applications/ColossalChat/coati/models/utils.py 2 个添加, 2 个删除applications/ColossalChat/coati/models/utils.py
- applications/ColossalChat/coati/trainer/dpo.py 469 个添加, 189 个删除applications/ColossalChat/coati/trainer/dpo.py
- applications/ColossalChat/examples/data_preparation_scripts/prepare_dataset.py 1 个添加, 2 个删除...Chat/examples/data_preparation_scripts/prepare_dataset.py
- applications/ColossalChat/examples/training_scripts/train_dpo.py 43 个添加, 32 个删除...tions/ColossalChat/examples/training_scripts/train_dpo.py
- applications/ColossalChat/examples/training_scripts/train_sft.py 1 个添加, 1 个删除...tions/ColossalChat/examples/training_scripts/train_sft.py
- applications/ColossalChat/tests/test_templating.sh 11 个添加, 10 个删除applications/ColossalChat/tests/test_templating.sh
- colossalai/shardformer/modeling/llama.py 1 个添加, 0 个删除colossalai/shardformer/modeling/llama.py
想要评论请 注册 或 登录