Skip to content

Commit 624a7fb

Browse files
authored
Add the cuTile compiler dependency for model preparation (#68)
Install the cuTile compiler toolchain for model preparation
2 parents c295e1f + a957885 commit 624a7fb

3 files changed

Lines changed: 95 additions & 17 deletions

File tree

‎docs/model-preparation.md‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -69,6 +69,9 @@ The JPEG decoder builds its bundled libjpeg-turbo source. Preparation requires
6969
the CUDA toolkit, including `nvcc` and CUPTI; configure `[paths] cuda` when it
7070
is not supplied by the Python environment.
7171

72+
The `prepare` extra installs `cuda-tile[tileiras]`, including the `tileiras`
73+
compiler toolchain required by cuTile kernels during model preparation.
74+
7275
The DeepSeek Rust crates share a pinned revision of
7376
[`local-inference-lab/deepseek-recipe`](https://github.com/local-inference-lab/deepseek-recipe)
7477
in `helios/Cargo.toml`. Its `flare` branch exposes normalized-message byte

‎pyproject.toml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,7 @@ prepare = [
2424
"transformers[torch,vision,chat_template] @ git+https://github.com/huggingface/transformers.git@1d9654e78a23fb167ef539cbd699dfbd3e4830cf",
2525
"flashinfer-python[b12x] @ git+https://github.com/local-inference-lab/flashinfer.git@1e7f9e3b19a9e69b81a9f758a51a19d74aed50c0",
2626
"cuda-python==13.3.1",
27+
"cuda-tile[tileiras]==1.6.0",
2728
"safetensors==0.8.0",
2829
"tokenizers==0.23.2",
2930
"huggingface-hub==1.33.0",

‎uv.lock‎

Lines changed: 91 additions & 17 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)