Skip to content

ms-swift 默认是开启 train_on_responses_only 吗? #9133

@justStarG

Description

@justStarG

Checklist / 检查清单

  • I have searched existing issues, and this is a new question or discussion topic. / 我已经搜索过现有的 issues,确认这是一个新的问题与讨论。

Question Description / 问题描述

unsloth 有 train_on_responses_only 参数,相当于只训练 response 的部分,prompt 是不计算 loss的,据说启用这个参数,训练效果有明显提升。

请问这个在 ms-swift 有类似的参数控制吗?还是默认已经开启了?

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions