GitHub - nusret35/gpt2: Reproduction of GPT2 124M parameter model. Trained with FineWeb 10B. · GitHub

Name		Name	Last commit message	Last commit date
__pycache__		__pycache__
hellaswag		hellaswag
.gitignore		.gitignore
fineweb.py		fineweb.py
hellaswag.py		hellaswag.py
inference.py		inference.py
input.txt		input.txt
ohmyrunpod_config.txt		ohmyrunpod_config.txt
requirements.txt		requirements.txt
train_gpt2.py		train_gpt2.py
upload_to_hf.py		upload_to_hf.py
utils.py		utils.py

About

Reproduction of GPT2 124M parameter model. Trained with FineWeb 10B.

0 stars

1 watching

Report repository

Releases

Packages

Used by

Contributors

Languages