Andrej Karpathy 最新AI讲座（3个半小时）：Deep Dive into LLMs like ChatGPT（深入探索像ChatGPT这样的大语言模型）

【必看珍藏】2月6日，安德烈·卡帕西最新AI普及课：深入探索像ChatGPT这样的大语言模型｜Andrej Karpathy

视频国内地址：https://www.bilibili.com/video/BV16cNEeXEer/?spm_id_from=333.1007.0.0&vd_source=2305730152e6c9a557978924d0063b1a

资料链接：

• ChatGPT https://chatgpt.com/
• FineWeb (pretraining dataset): https://huggingface.co/spaces/HuggingFaceFW/blogpost-fineweb-v1
• Tiktokenizer: https://tiktokenizer.vercel.app/
• Transformer Neural Net 3D visualizer: https://bbycroft.net/llm
• llm.c Let’s Reproduce GPT-2 https://github.com/karpathy/llm.c/discussions/677
• Llama 3 paper from Meta: https://arxiv.org/abs/2407.21783（B站李沐大神进行过讲解）
• Hyperbolic, for inference of base model: https://app.hyperbolic.xyz/
• InstructGPT paper on SFT: https://arxiv.org/abs/2203.02155（B站李沐大神进行过讲解）
• HuggingFace inference playground: https://huggingface.co/spaces/huggingface/inference-playground
• DeepSeek-R1 paper: https://arxiv.org/abs/2501.12948
• TogetherAI Playground for open model inference: https://api.together.xyz/playground
• AlphaGo paper (PDF): https://discovery.ucl.ac.uk/id/eprint/10045895/1/agz_unformatted_nature.pdf
• AlphaGo Move 37 video: https://www.youtube.com/watch?v=HT-UZkiOLv8&t=0s
• LM Arena for model rankings: https://lmarena.ai/
• AI News Newsletter: https://buttondown.com/ainews
• LMStudio for local inference https://lmstudio.ai/
• The visualization UI I was using in the video: https://excalidraw.com/
• The specific file of Excalidraw we built up: https://drive.google.com/file/d/1EZh5hNDzxMMy05uLhVryk061QYQGTxiN/view（本次视频大纲）
• Discord channel for Eureka Labs and this video: https://discord.com/invite/3zy8kqD9Cp