Skip to content

Commit ec2db3e

Browse files
Merge branch 'main' into integrate-github-io-roadmap
2 parents 0b387ef + 14c4338 commit ec2db3e

3 files changed

Lines changed: 58 additions & 12 deletions

File tree

‎.github/workflows/docs.yml‎

Lines changed: 24 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -3,12 +3,9 @@ name: Publish Docs to GitHub Pages
33
on:
44
push:
55
branches:
6-
- main
7-
paths:
8-
- 'docs/**'
9-
- 'mkdocs.yml'
10-
- 'src/**'
11-
- '.github/workflows/docs.yml'
6+
- main # publishes the in-development 'dev' docs
7+
tags:
8+
- 'v*' # release tags publish a versioned snapshot + 'latest'
129
workflow_dispatch:
1310

1411
permissions:
@@ -22,7 +19,7 @@ jobs:
2219
- name: Checkout repository
2320
uses: actions/checkout@v4
2421
with:
25-
fetch-depth: 0 # full history needed for git-committers plugin
22+
fetch-depth: 0 # full history needed for mike + git-committers plugin
2623

2724
- name: Set up Python
2825
uses: actions/setup-python@v5
@@ -33,6 +30,7 @@ jobs:
3330
- name: Install doc dependencies
3431
run: |
3532
pip install \
33+
mike \
3634
mkdocs-material \
3735
mkdocstrings[python] \
3836
mkdocs-git-revision-date-localized-plugin \
@@ -41,5 +39,22 @@ jobs:
4139
- name: Install claimed package (for mkdocstrings introspection)
4240
run: pip install -e .
4341

44-
- name: Build & deploy docs
45-
run: mkdocs gh-deploy --force --clean --verbose
42+
- name: Configure git identity for mike
43+
run: |
44+
git config user.name "github-actions[bot]"
45+
git config user.email "41898282+github-actions[bot]@users.noreply.github.com"
46+
47+
- name: Deploy versioned docs
48+
run: |
49+
set -euo pipefail
50+
# mike commits to the gh-pages branch; make sure we have it locally.
51+
git fetch origin gh-pages --depth=1 || true
52+
if [[ "${GITHUB_REF}" == refs/tags/v* ]]; then
53+
VERSION="${GITHUB_REF_NAME#v}" # v0.2.7 -> 0.2.7
54+
echo "Publishing released version ${VERSION} (alias: latest)"
55+
mike deploy --push --update-aliases "${VERSION}" latest
56+
mike set-default --push latest
57+
else
58+
echo "Publishing in-development docs as 'dev'"
59+
mike deploy --push dev
60+
fi

‎docs/index.md‎

Lines changed: 29 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,13 +10,39 @@
1010

1111
## What is CLAIMED?
1212

13-
CLAIMED has three interlocking layers:
13+
CLAIMED began life as a **library of reusable AI and data components** — ready-made,
14+
shareable building blocks for the recurring chores of machine learning: reading and
15+
writing data from COS/S3, NLP preprocessing, model training, and benchmarking. That
16+
component library is still here (`claimed.components.*`) and still the foundation
17+
everything else builds on.
18+
19+
What turned CLAIMED from a handy library into a genuinely powerful framework is the
20+
**C3 Component Compiler**. C3 takes *any* notebook, Python script, or R script and
21+
compiles it into a fully containerised, runnable, composable component — complete with
22+
a CLI, a Docker image, and KubeFlow Pipelines / CWL / Kubernetes descriptors — with
23+
zero boilerplate. Suddenly every piece of code you write becomes a first-class,
24+
reusable CLAIMED component, not just the ones someone hand-packaged in advance. C3 is
25+
the heart of the framework today.
26+
27+
From there, CLAIMED grew outward by **integrating two complementary projects** rather
28+
than reinventing them:
29+
30+
- **MLX** (`claimed.mlx`) brings **experiment and asset tracking** — full provenance
31+
for every dataset, model, and job — and powers the grid-compute backend that
32+
distributes component runs across heterogeneous clusters.
33+
- **terratorch-iterate** (the `iterate2` engine, shipped inside `claimed`) adds
34+
**hyperparameter optimisation (HPO) and neural architecture search (NAS)** on top of
35+
your components, with MLflow logging, Optuna-driven search, and Ray parallelisation.
36+
37+
Put together, CLAIMED lets you go from a single script all the way to a tracked,
38+
optimised, cluster-scale AI pipeline — without ever leaving the framework.
1439

1540
| Layer | Package / module | Purpose |
1641
|---|---|---|
17-
| **C3** – Component Compiler | `claimed.c3` | Turns notebooks, Python scripts, and R scripts into fully containerised, executable AI components |
42+
| **C3** – Component Compiler | `claimed.c3` | Turns notebooks, Python scripts, and R scripts into fully containerised, executable, composable AI components |
43+
| **Component Library** | `claimed.components.*` | The original ready-to-use components for COS/S3 I/O, benchmarking, NLP, training, and more |
1844
| **MLX** – ML eXchange backend | `claimed.mlx` | Tracks datasets, models, jobs and other assets; powers the grid-compute backend |
19-
| **Component Library** | `claimed.components.*` | Ready-to-use components for COS/S3 I/O, benchmarking, NLP, training, and more |
45+
| **iterate** – HPO / NAS | `claimed` (`iterate2`) | Hyperparameter optimisation and neural architecture search via MLflow, Optuna, and Ray |
2046

2147
---
2248

‎mkdocs.yml‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -66,6 +66,11 @@ markdown_extensions:
6666
- toc:
6767
permalink: true
6868

69+
extra:
70+
version:
71+
provider: mike
72+
default: latest
73+
6974
nav:
7075
- Home: index.md
7176
- Roadmap: roadmap.md

0 commit comments

Comments
 (0)