rasbt

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Stars
108k
全站累计
Forks17k衍生分支贡献
LanguageJupyter Notebook核心开发语言
Created2023-07-23已运营 3.3 年
Last push2026-10-02最新代码提交

Star history

已连续追踪 69 天每日快照数据

期间增长:+19k (20.8%)
89k98k108k2026-04-062026-09-252026-10-29
GitHub 官方 Topics:
#ai#artificial-intelligence#attention-mechanism#deep-learning#finetuning#from-scratch#generative-ai#gpt#instruction-tuning#language-model#large-language-models#llm#machine-learning#natural-language-processing#pretraining#python#pytorch#tokenizer#transformers