roofline

Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs

CUDA编程练习项目——动手实践CUDA内核与性能优化，涵盖GEMM、FlashAttention、Tensor Cores、CUTLASS、量化、KV缓存、NCCL及性能分析。