Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .github/workflows/deploy_docs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,12 +10,12 @@ jobs:
runs-on: ubuntu-latest
env:
docs-directory: /home/runner/work/kokkos-core-wiki/kokkos-core-wiki/docs
container:
image: python:3.10
steps:
- uses: actions/checkout@v4.2.2
- uses: actions/setup-python@v5.4.0
with:
python-version: '3.10'
- run: pip install -r build_requirements.txt
- run: apt update && apt --yes --no-install-recommends install graphviz
- name: Build documentation
working-directory: ${{ env.docs-directory }}
run: |
Expand Down
93 changes: 93 additions & 0 deletions docs/source/ProgrammingGuide/Graph.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,93 @@
16. Graphs
==========

Usage
-----

:cppkokkos:`Kokkos::Graph` is an abstraction that describes
asynchronous workloads organised as a direct acyclic graph (DAG).

Once defined, the graph can be executed many times.

:cppkokkos:`Kokkos::Graph` is specialized for some backends:

* :cppkokkos:`Cuda`
* :cppkokkos:`HIP`
* :cppkokkos:`SYCL`

On these backends, the :cppkokkos:`Kokkos::Graph` specialisations map to the native graph API, namely, the CUDA Graph API, the HIP Graph API, and the SYCL (command) Graph API, respectively.

For other backends, :cppkokkos:`Kokkos::Graph` provides a defaulted implementation.

Execution space instance versus graph
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Workloads submitted on :cppkokkos:`Kokkos` execution space instances execute *eagerly*, *i.e.*,
once the :cppkokkos:`Kokkos::parallel_` function is called, the workload is immediately launched on the device.

By contrast, the :cppkokkos:`Kokkos::Graph` abstraction follows *lazy* execution,
*i.e*, workloads added to a :cppkokkos:`Kokkos::Graph` are **not** executed *until*
the whole graph is ready and submitted.

Always in 3 phases
~~~~~~~~~~~~~~~~~~

Typically, 3 phases are needed:

1. definition
2. instantiation
3. submission

The *definition* phase consists in describing the workloads: what they do, as well as their dependencies.
In other words, this phase creates a *topological* graph of workloads.

The *instantiation* phase **locks** the topology, *i.e.*, it cannot be changed anymore.
During this phase, the graph will be checked for flaws.
The backend creates an *executable* graph.

The last phase is *submission*. It will execute the workloads, observing their dependencies.
This phase can be run multiple times.

Advantages
~~~~~~~~~~

There are many advantages. Here are a few:

* Since the workloads are described ahead of execution,
the backend driver and/or compiler can leverage optimization opportunities.
* Launch overhead is reduced, benefitting DAGs consisting of small workloads.

Examples
--------

Diamond DAG
~~~~~~~~~~~

Consider a diamond-like DAG.

.. graphviz::

digraph diamond {
A -> B;
A -> C;
B -> D;
C -> D;
}

The following snippet defines, instantiates and submits a :cppkokkos:`Kokkos::Graph`
for this DAG.

.. code-block:: c++

auto graph = Kokkos::create_graph([&](auto root) {
auto node_A = root.then_parallel_for("workload A", ...policy..., ...functor...);

auto node_B = node_A.then_parallel_for("workload B", ...policy..., ...functor...);
auto node_C = node_A.then_parallel_for("workload C", ...policy..., ...functor...);

auto node_D = Kokkos::when_all(node_B, node_C).then_parallel_for("workload D", ...policy..., ...functor...);
});

graph.instantiate();

graph.submit();
1 change: 1 addition & 0 deletions docs/source/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@
# ones.
extensions = ["myst_parser",
"sphinx.ext.autodoc",
"sphinx.ext.graphviz",
"sphinx.ext.viewcode",
"sphinx.ext.intersphinx",
"sphinx_copybutton",
Expand Down
1 change: 1 addition & 0 deletions docs/source/programmingguide.rst
Original file line number Diff line number Diff line change
Expand Up @@ -19,3 +19,4 @@ Programming Guide
./ProgrammingGuide/Interoperability
./ProgrammingGuide/Kokkos-and-Virtual-Functions
./ProgrammingGuide/SIMD
./ProgrammingGuide/Graph
Comment thread
romintomasetti marked this conversation as resolved.