This project implements a GPT model from scratch using PyTorch, covering tokenization, attention mechanisms, transformer blocks, and text generation. It demonstrates pretraining, finetuning for classification, and instruction finetuning, including data handling and evaluation techniques.
- Stars
- 3
- Forks
- 1
- Pushed
- 11mo ago