README.md

HomebrewNLP

Overview

A case study of efficient training of large language models using commodity hardware.

Example Command

python3 main.py train --config_path configs/small.yaml

---

| Discord | WandB

Datasets

• Book Dataset
• 200MB Slice of ThePile