MountainAI
Войти
systemsframeworks

PyTorch

Tensors, autograd, nn.Module, DataLoader — the primary framework for deep learning research and production.

Уровни глубины

L0Intro~1ч

Has run a PyTorch tutorial; understands tensors are like NumPy arrays on GPU.

L1Basics~15ч

Builds and trains nn.Module models with DataLoader; moves tensors between CPU/GPU; uses Optimizer and loss functions.

L2Working~25ч

Writes custom datasets, custom layers, training loops with mixed precision; uses torch.compile and profiling.

L3Advanced~40ч

Implements custom CUDA kernels via torch.autograd.Function; applies DistributedDataParallel; debugs memory and gradient issues.

L4Research~80ч

Contributes to PyTorch core, custom backends, or novel training frameworks.

Ресурсы