🎣 JudeW's Knowledge Brain

Search

SearchSearch

Recent writing

  • Polymarket 的乐观预言机机制:提议、Dispute 与 DVM 仲裁

    New

  • AI 模型的内存、带宽与 Kimi K3 部署估算

    Jul 21, 2026

  • 复利下注下的凯利公式:如何推导最优下注尺度

    Jul 21, 2026

Home

❯

computer_sci

❯

llm

❯

training

❯

LLM Training - MOC

LLM Training - MOC

May 01, 2026, 1 min read

  • #MOC
  • #LLM
  • #training

Pretraining

  • Next-Token Prediction: 预训练的发动机
  • Scaling Laws: 模型、数据、算力的三角博弈
  • Training Tech Outline
  • Train LLM from scratch
  • How to make custom dataset?

Alignment

  • 从 GPT 到 ChatGPT:让模型学会「听话」的对齐之路
  • Detailed explanation of RLHF technology

Parent MOC

  • Large Language Model - MOC

Graph View

  • Pretraining
  • Alignment
  • Parent MOC

Backlinks

  • Large Language Model - MOC

Created with Quartz v4.2.3 © 2026

  • GitHub
  • Instagram
  • Strava