Mathematics

Comprehensive mathematical derivation of LayerNorm forward and backward passes, including PyTorch implementation details.

Deep dive into the mathematical foundations of flash attention, from softmax fundamentals to efficient kernel implementation.

A comprehensive guide to the Fast Hadamard Transform, its mathematical foundations, and practical implementation with code examples.