Transformer building blocks as GPU kernels written in cuTile.jl, NVIDIA's tile-based programming model for Julia: fused multi-head attention, split-KV decoding, softmax, and layer/RMS normalization.
using Pkg
Registry.add(url="https://registry.jool.space")
Pkg.add("Tylo")