L
LLMs-from-scratch
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
★101kstars
Jupyter Notebook
NOASSERTION
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Learning & Resources project leveraging artificial-intelligence and attention-mechanism, built with Jupyter Notebook, open-source
Who made it?Maintained by rasbt team, 100.9K⭐ on GitHub, #14 out of 3640 in Learning & Resources
Why does it exist?As the Learning & Resources landscape evolved, the rasbt team identified the need for better artificial-intelligence solutions. LLMs-from-scratch was created to simplify attention-mechanism workflows.
What can it do?Key use cases: deep-learning, finetuning, from-scratch
How to install with AI?Use an AI coding assistant to follow the README and automatically handle the install and environment setup.
🔗 github.com/rasbt/LLMs-from-scratch | 官网 https://amzn.to/4fqvn0D
🔗 github.com/rasbt/LLMs-from-scratch | 官网 https://amzn.to/4fqvn0D
Topics
aiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers