Skip to content

Finetuning: show training cost + validate JSONL files #45

@JCocola

Description

@JCocola

The flag/option should allow to

  1. Show the expected training cost for a finetuning run for that particular model.
  2. Validate finetuning JSONL files before starting

Note: 1. is particularly useful for big files and to decide whether to run with say 4.1 or 4.1-mini, etc
while 2. would reduce the number of failed training runs

Safety tooling (https://github.com/safety-research/safety-tooling) has something like that to validate jsonl files and get the training costs. See their readme

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions