systemsframeworks
PyTorch
Tensors, autograd, nn.Module, DataLoader — the primary framework for deep learning research and production.
Уровни глубины
L0Intro~1ч
Has run a PyTorch tutorial; understands tensors are like NumPy arrays on GPU.
L1Basics~15ч
Builds and trains nn.Module models with DataLoader; moves tensors between CPU/GPU; uses Optimizer and loss functions.
L2Working~25ч
Writes custom datasets, custom layers, training loops with mixed precision; uses torch.compile and profiling.
L3Advanced~40ч
Implements custom CUDA kernels via torch.autograd.Function; applies DistributedDataParallel; debugs memory and gradient issues.
L4Research~80ч
Contributes to PyTorch core, custom backends, or novel training frameworks.
Ресурсы
L0 — Intro
L2 — Working