[taskcluster 2026-05-20T20:01:04.515Z] Worker Type (scriptworker-1/images) settings:
[taskcluster 2026-05-20T20:01:04.515Z]   {
[taskcluster 2026-05-20T20:01:04.515Z]     "generic-worker": {
[taskcluster 2026-05-20T20:01:04.515Z]       "config": {
[taskcluster 2026-05-20T20:01:04.515Z]         "headlessTasks": true
[taskcluster 2026-05-20T20:01:04.515Z]       },
[taskcluster 2026-05-20T20:01:04.515Z]       "engine": "multiuser",
[taskcluster 2026-05-20T20:01:04.515Z]       "go-arch": "amd64",
[taskcluster 2026-05-20T20:01:04.515Z]       "go-os": "linux",
[taskcluster 2026-05-20T20:01:04.515Z]       "go-version": "go1.26.2",
[taskcluster 2026-05-20T20:01:04.515Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v99.2.1",
[taskcluster 2026-05-20T20:01:04.515Z]       "revision": "ddb9ce7efdb98ae2d0917b69778e9f3cd125e07f",
[taskcluster 2026-05-20T20:01:04.515Z]       "source": "https://github.com/taskcluster/taskcluster/commits/ddb9ce7efdb98ae2d0917b69778e9f3cd125e07f",
[taskcluster 2026-05-20T20:01:04.515Z]       "version": "99.2.1"
[taskcluster 2026-05-20T20:01:04.515Z]     },
[taskcluster 2026-05-20T20:01:04.515Z]     "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-2404-amd64-headless-googlecompute-2026-05-04",
[taskcluster 2026-05-20T20:01:04.515Z]     "instance-id": "7124031376090967116",
[taskcluster 2026-05-20T20:01:04.515Z]     "instance-type": "projects/887720501152/machineTypes/c2-standard-4",
[taskcluster 2026-05-20T20:01:04.515Z]     "local-ipv4": "10.128.2.119",
[taskcluster 2026-05-20T20:01:04.515Z]     "project-id": "fxci-production-level1-workers",
[taskcluster 2026-05-20T20:01:04.515Z]     "public-hostname": "scriptworker-1-images-dofoqelxs2ko1bwbjxjesw.c.fxci-production-level1-workers.internal",
[taskcluster 2026-05-20T20:01:04.515Z]     "public-ipv4": "136.119.115.126",
[taskcluster 2026-05-20T20:01:04.515Z]     "region": "us-central1",
[taskcluster 2026-05-20T20:01:04.515Z]     "zone": "us-central1-c"
[taskcluster 2026-05-20T20:01:04.515Z]   }
[taskcluster 2026-05-20T20:01:04.515Z] Task ID: Ws_GHCxVS9GnXhVbtV2g9w
[taskcluster 2026-05-20T20:01:04.515Z] === Task Starting ===
[taskcluster 2026-05-20T20:01:05.855Z] [mounts] No existing writable directory cache 'scriptworker-level-1-uv-v3-5ddaa3ce44d7548e0d3c-XYTQZVCaSGqB27FgDbYeHA' - creating /home/generic-worker/caches/dLhWV2LoTymkIfeKLwt8jw
[taskcluster 2026-05-20T20:01:05.855Z] [mounts] Creating directory /home/task_177930726356980/cache0
[taskcluster 2026-05-20T20:01:05.871Z] [mounts] Successfully mounted writable directory cache '/home/task_177930726356980/cache0'
[taskcluster 2026-05-20T20:01:05.871Z] [mounts] No existing writable directory cache 'scriptworker-level-1-checkouts-v3-5ddaa3ce44d7548e0d3c-XYTQZVCaSGqB27FgDbYeHA' - creating /home/generic-worker/caches/HhJOMNPcQ-2vsX4Bd26bFA
[taskcluster 2026-05-20T20:01:05.871Z] [mounts] Creating directory /home/task_177930726356980/cache1
[taskcluster 2026-05-20T20:01:05.882Z] [mounts] Successfully mounted writable directory cache '/home/task_177930726356980/cache1'
[taskcluster 2026-05-20T20:01:05.882Z] [mounts] Downloading task XYTQZVCaSGqB27FgDbYeHA artifact public/image.tar.zst to /home/generic-worker/downloads/J9czeJPSRFeY5ngxZhBFfw
[taskcluster 2026-05-20T20:01:09.346Z] [mounts] Downloaded 103318006 bytes with SHA256 31f91e90e0574ab07cf177f0a3cbefa12383dc960bd78e2a3cff1df52c8194f5 from task XYTQZVCaSGqB27FgDbYeHA artifact public/image.tar.zst to /home/generic-worker/downloads/J9czeJPSRFeY5ngxZhBFfw
[taskcluster:warn 2026-05-20T20:01:09.346Z] [mounts] Download /home/generic-worker/downloads/J9czeJPSRFeY5ngxZhBFfw of task XYTQZVCaSGqB27FgDbYeHA artifact public/image.tar.zst has SHA256 31f91e90e0574ab07cf177f0a3cbefa12383dc960bd78e2a3cff1df52c8194f5 but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2026-05-20T20:01:09.346Z] [mounts] File mount "dockerimage" handled by registered handler (cache: /home/generic-worker/downloads/J9czeJPSRFeY5ngxZhBFfw, SHA256: 31f91e90e0574ab07cf177f0a3cbefa12383dc960bd78e2a3cff1df52c8194f5)
[taskcluster 2026-05-20T20:01:09.346Z] [d2g] Loading docker image
[taskcluster 2026-05-20T20:01:13.526Z] [d2g] Loaded docker image "python3.11:latest"
[taskcluster 2026-05-20T20:01:13.527Z] Executing command 0: docker run -t --name taskcontainer_M7OiwO02Q5qPKAHaIO2Ztg --memory-swap -1 --pids-limit -1 --pull=never --log-driver=none '--add-host=localhost.localdomain:127.0.0.1' -v '/home/task_177930726356980/cache0:/builds/worker/.task-cache/uv' -v /home/task_177930726356980/cache1:/builds/worker/checkouts --add-host=taskcluster:host-gateway --env-file 'env.list' 65c7064040b0b4061c1b9abbdb7a26ffddbabd6a332ba6c0d2cf07dc9576282f /usr/local/bin/run-task --scriptworker-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- sh -lxce 'uv run tox -e py311'
[setup 2026-05-20T20:01:15.120+00:00] run-task started in /
[setup 2026-05-20T20:01:15.120+00:00] Invoked by command: --scriptworker-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- sh -lxce uv run tox -e py311
[setup 2026-05-20T20:01:15.120+00:00] Python version: 3.11.14
[setup 2026-05-20T20:01:15.120+00:00] Subprocess python version: 
cpython-3.11.14-linux-x86_64-gnu    /usr/local/bin/python3.11
cpython-3.11.14-linux-x86_64-gnu    /usr/local/bin/python3 -> python3.11
cpython-3.11.14-linux-x86_64-gnu    /usr/local/bin/python -> python3
[cache 2026-05-20T20:01:15.278+00:00] cache /builds/worker/.task-cache/uv is empty; writing requirements: gid=1000 uid=1000 version=1
[cache 2026-05-20T20:01:15.278+00:00] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2026-05-20T20:01:15.279+00:00] volume /builds/worker/.task-cache/uv is a cache
[volume 2026-05-20T20:01:15.279+00:00] volume /builds/worker/checkouts is a cache
[setup 2026-05-20T20:01:15.279+00:00] running as worker:worker
[vcs 2026-05-20T20:01:15.279+00:00] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2026-05-20T20:01:15.282+00:00] executing ['git', 'clone', 'https://github.com/mozilla-releng/scriptworker', '/builds/worker/checkouts/vcs']
[vcs 2026-05-20T20:01:15.283+00:00] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2026-05-20T20:01:16.243+00:00] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla-releng/scriptworker', 'hneiva/cot-logs']
[vcs 2026-05-20T20:01:16.476+00:00] From https://github.com/mozilla-releng/scriptworker
[vcs 2026-05-20T20:01:16.476+00:00]  * branch            hneiva/cot-logs -> FETCH_HEAD
[vcs 2026-05-20T20:01:16.486+00:00] executing ['git', 'checkout', '-f', '-B', 'hneiva/cot-logs', '3768e775dcc5861ace3b22113d4f035b0014d770']
[vcs 2026-05-20T20:01:16.558+00:00] Switched to a new branch 'hneiva/cot-logs'
[vcs 2026-05-20T20:01:16.559+00:00] cleaning git checkout...
[vcs 2026-05-20T20:01:16.559+00:00] executing ['git', 'clean', '-nxdff']
[vcs 2026-05-20T20:01:16.561+00:00] removing []
[vcs 2026-05-20T20:01:16.561+00:00] successfully cleaned git checkout!
[vcs 2026-05-20T20:01:16.562+00:00] TinderboxPrint:<a href='https://github.com/mozilla-releng/scriptworker/commit/3768e775dcc5861ace3b22113d4f035b0014d770' title='Built from scriptworker commit 3768e775dcc5861ace3b22113d4f035b0014d770'>3768e775dcc5861ace3b22113d4f035b0014d770</a>
[setup 2026-05-20T20:01:16.562+00:00] UV_CACHE_DIR is /builds/worker/.task-cache/uv
[task 2026-05-20T20:01:16.562+00:00] executing ['sh', '-lxce', 'uv run tox -e py311']
[task 2026-05-20T20:01:16.563+00:00] + id -u
[task 2026-05-20T20:01:16.564+00:00] + [ 1000 -eq 0 ]
[task 2026-05-20T20:01:16.564+00:00] + PATH=/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
[task 2026-05-20T20:01:16.564+00:00] + export PATH
[task 2026-05-20T20:01:16.564+00:00] + [ $  ]
[task 2026-05-20T20:01:16.564+00:00] + [  ]
[task 2026-05-20T20:01:16.565+00:00] + id -u
[task 2026-05-20T20:01:16.566+00:00] + [ 1000 -eq 0 ]
[task 2026-05-20T20:01:16.566+00:00] + PS1=$ 
[task 2026-05-20T20:01:16.566+00:00] + [ -d /etc/profile.d ]
[task 2026-05-20T20:01:16.566+00:00] + [ -r /etc/profile.d/*.sh ]
[task 2026-05-20T20:01:16.566+00:00] + unset i
[task 2026-05-20T20:01:16.566+00:00] + uv run tox -e py311
[task 2026-05-20T20:01:16.640+00:00] Using CPython 3.11.14 interpreter at: /usr/local/bin/python3
[task 2026-05-20T20:01:16.640+00:00] Creating virtual environment at: .venv
[task 2026-05-20T20:01:17.272+00:00]    Building scriptworker @ file:///builds/worker/checkouts/vcs
[task 2026-05-20T20:01:17.348+00:00] Downloading pygments (1.2MiB)
[task 2026-05-20T20:01:17.349+00:00] Downloading aiohttp (1.7MiB)
[task 2026-05-20T20:01:17.350+00:00] Downloading ast-serialize (1.2MiB)
[task 2026-05-20T20:01:17.351+00:00] Downloading uv (23.3MiB)
[task 2026-05-20T20:01:17.351+00:00] Downloading virtualenv (7.2MiB)
[task 2026-05-20T20:01:17.352+00:00] Downloading cryptography (4.5MiB)
[task 2026-05-20T20:01:17.352+00:00] Downloading mypy (14.2MiB)
[task 2026-05-20T20:01:17.355+00:00] Downloading ruff (10.9MiB)
[task 2026-05-20T20:01:17.770+00:00]  Downloaded ast-serialize
[task 2026-05-20T20:01:18.103+00:00]  Downloaded aiohttp
[task 2026-05-20T20:01:18.320+00:00]  Downloaded ruff
[task 2026-05-20T20:01:18.324+00:00]  Downloaded virtualenv
[task 2026-05-20T20:01:18.426+00:00]       Built scriptworker @ file:///builds/worker/checkouts/vcs
[task 2026-05-20T20:01:18.468+00:00]  Downloaded uv
[task 2026-05-20T20:01:18.483+00:00]  Downloaded cryptography
[task 2026-05-20T20:01:18.507+00:00]  Downloaded pygments
[task 2026-05-20T20:01:18.686+00:00]  Downloaded mypy
[task 2026-05-20T20:01:18.687+00:00] warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
[task 2026-05-20T20:01:18.688+00:00]          If the cache and target directories are on different filesystems, hardlinking may not be supported.
[task 2026-05-20T20:01:18.688+00:00]          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
[task 2026-05-20T20:01:18.847+00:00] Installed 100 packages in 160ms
[task 2026-05-20T20:01:19.321+00:00] py311: venv> .venv/bin/uv venv -p cpython3.11 --allow-existing '--prompt=vcs[py311]' --python-preference system /builds/worker/checkouts/vcs/.tox/py311
[task 2026-05-20T20:01:19.485+00:00] .pkg: venv> .venv/bin/uv venv -p /builds/worker/checkouts/vcs/.venv/bin/python --allow-existing '--prompt=vcs[.pkg]' --python-preference system /builds/worker/checkouts/vcs/.tox/.pkg
[task 2026-05-20T20:01:19.495+00:00] .pkg: install_requires> .venv/bin/uv pip install hatchling
[task 2026-05-20T20:01:19.776+00:00] .pkg: _optional_hooks> python /builds/worker/checkouts/vcs/.venv/lib/python3.11/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-05-20T20:01:19.809+00:00] .pkg: get_requires_for_build_editable> python /builds/worker/checkouts/vcs/.venv/lib/python3.11/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-05-20T20:01:19.905+00:00] .pkg: install_requires_for_build_editable> .venv/bin/uv pip install 'editables~=0.3'
[task 2026-05-20T20:01:20.051+00:00] .pkg: build_editable> python /builds/worker/checkouts/vcs/.venv/lib/python3.11/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-05-20T20:01:20.135+00:00] py311: install_package_deps> .venv/bin/uv pip install PyYAML 'aiohttp>=3' 'arrow>=1.0' 'cryptography>=2.6.1' dictdiffer github3.py 'immutabledict>=1.3.0' 'json-e>=2.5.0' 'jsonschema[format-nongpl]' taskcluster-taskgraph 'taskcluster>=40'
[task 2026-05-20T20:01:21.240+00:00] py311: install_package> .venv/bin/uv pip install --reinstall --no-deps scriptworker@/builds/worker/checkouts/vcs/.tox/.tmp/package/1/scriptworker-63.0.1-py3-none-any.whl
[task 2026-05-20T20:01:21.299+00:00] py311: commands[0]> coverage run --source=src/scriptworker --branch --rcfile tox.ini -m pytest tests
[task 2026-05-20T20:01:26.996+00:00] ============================= test session starts ==============================
[task 2026-05-20T20:01:26.996+00:00] platform linux -- Python 3.11.14, pytest-9.0.3, pluggy-1.6.0
[task 2026-05-20T20:01:26.996+00:00] cachedir: .tox/py311/.pytest_cache
[task 2026-05-20T20:01:26.996+00:00] Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket=<bucket_type>
[task 2026-05-20T20:01:26.996+00:00] rootdir: /builds/worker/checkouts/vcs
[task 2026-05-20T20:01:26.996+00:00] configfile: pyproject.toml (WARNING: ignoring pytest config in tox.ini!)
[task 2026-05-20T20:01:26.996+00:00] plugins: mock-3.15.1, asyncio-1.3.0, random-order-1.2.0
[task 2026-05-20T20:01:26.996+00:00] asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
[task 2026-05-20T20:01:26.996+00:00] collected 695 items
[task 2026-05-20T20:01:26.996+00:00] 
[task 2026-05-20T20:01:27.147+00:00] tests/test_artifacts.py ..........................................       [  6%]
[task 2026-05-20T20:01:27.253+00:00] tests/test_client.py .............................                       [ 10%]
[task 2026-05-20T20:01:27.362+00:00] tests/test_config.py ....................................                [ 15%]
[task 2026-05-20T20:01:27.407+00:00] tests/test_context.py .............                                      [ 17%]
[task 2026-05-20T20:01:27.467+00:00] tests/test_cot_generate.py ......                                        [ 18%]
[task 2026-05-20T20:01:27.695+00:00] tests/test_cot_verify.py ............................................... [ 24%]
[task 2026-05-20T20:01:30.965+00:00] ........................................................................ [ 35%]
[task 2026-05-20T20:01:31.935+00:00] ........................................................................ [ 45%]
[task 2026-05-20T20:01:32.062+00:00] .....................                                                    [ 48%]
[task 2026-05-20T20:01:32.078+00:00] tests/test_ed25519.py ........                                           [ 49%]
[task 2026-05-20T20:01:32.547+00:00] tests/test_github.py ................................................... [ 57%]
[task 2026-05-20T20:01:32.568+00:00] ...                                                                      [ 57%]
[task 2026-05-20T20:01:32.582+00:00] tests/test_integration.py ssssssssssss                                   [ 59%]
[task 2026-05-20T20:01:32.656+00:00] tests/test_log.py ...........                                            [ 60%]
[task 2026-05-20T20:01:32.668+00:00] tests/test_production.py sssssssssss                                     [ 62%]
[task 2026-05-20T20:01:35.305+00:00] tests/test_task.py ..................................................... [ 70%]
[task 2026-05-20T20:01:42.734+00:00] ...............................................................          [ 79%]
[task 2026-05-20T20:01:45.754+00:00] tests/test_task_process.py ....                                          [ 79%]
[task 2026-05-20T20:01:46.393+00:00] tests/test_utils.py .................................................... [ 87%]
[task 2026-05-20T20:01:46.637+00:00] ..............................................................           [ 96%]
[task 2026-05-20T20:01:49.175+00:00] tests/test_worker.py .................Task was destroyed but it is pending!
[task 2026-05-20T20:01:49.175+00:00] task: <Task cancelling name='Task-1971' coro=<noop_async() running at /builds/worker/checkouts/vcs/tests/__init__.py:121>>
[task 2026-05-20T20:01:49.175+00:00] /usr/local/lib/python3.11/asyncio/base_events.py:679: RuntimeWarning: coroutine 'noop_async' was never awaited
[task 2026-05-20T20:01:49.175+00:00]   self._ready.clear()
[task 2026-05-20T20:01:49.175+00:00] RuntimeWarning: Enable tracemalloc to get the object allocation traceback
[task 2026-05-20T20:01:49.175+00:00] Task was destroyed but it is pending!
[task 2026-05-20T20:01:49.175+00:00] task: <Task cancelling name='Task-1979' coro=<noop_async() running at /builds/worker/checkouts/vcs/tests/__init__.py:121>>
[task 2026-05-20T20:01:49.414+00:00] ..........                         [100%]
[task 2026-05-20T20:01:49.414+00:00] 
[task 2026-05-20T20:01:49.414+00:00] =============================== warnings summary ===============================
[task 2026-05-20T20:01:49.414+00:00] tests/test_worker.py::test_mocker_run_tasks_noop
[task 2026-05-20T20:01:49.414+00:00] tests/test_worker.py::test_mocker_run_tasks_caught_exception[upload_artifacts-ScriptWorkerException-5]
[task 2026-05-20T20:01:49.414+00:00] tests/test_worker.py::test_unexpected_exception_catch_and_tell_taskcluster
[task 2026-05-20T20:01:49.414+00:00] tests/test_worker.py::test_run_tasks_no_cancel
[task 2026-05-20T20:01:49.414+00:00] tests/test_worker.py::test_run_tasks_cancel_right_before_cot
[task 2026-05-20T20:01:49.414+00:00]   /usr/local/lib/python3.11/asyncio/base_events.py:679: RuntimeWarning: coroutine 'noop_async' was never awaited
[task 2026-05-20T20:01:49.414+00:00]     self._ready.clear()
[task 2026-05-20T20:01:49.414+00:00]   Enable tracemalloc to get traceback where the object was allocated.
[task 2026-05-20T20:01:49.414+00:00]   See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info.
[task 2026-05-20T20:01:49.414+00:00] 
[task 2026-05-20T20:01:49.414+00:00] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
[task 2026-05-20T20:01:49.414+00:00] ================= 672 passed, 23 skipped, 5 warnings in 26.31s =================
[task 2026-05-20T20:01:49.756+00:00] .pkg: _exit> python /builds/worker/checkouts/vcs/.venv/lib/python3.11/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-05-20T20:01:49.777+00:00]   py311: OK (30.46=setup[2.00]+cmd[28.46] seconds)
[task 2026-05-20T20:01:49.777+00:00]   congratulations :) (30.52 seconds)
[taskcluster 2026-05-20T20:01:50.275Z]                        Exit Code: 0
[taskcluster 2026-05-20T20:01:50.275Z]                        User Time: 16.795ms
[taskcluster 2026-05-20T20:01:50.275Z]                      Kernel Time: 13.196ms
[taskcluster 2026-05-20T20:01:50.275Z]                        Wall Time: 36.747744233s
[taskcluster 2026-05-20T20:01:50.275Z]  Average Available System Memory: 14.49 GiB
[taskcluster 2026-05-20T20:01:50.275Z]       Average System Memory Used: 1.13 GiB
[taskcluster 2026-05-20T20:01:50.275Z]          Peak System Memory Used: 1.33 GiB
[taskcluster 2026-05-20T20:01:50.275Z]              Total System Memory: 15.61 GiB
[taskcluster 2026-05-20T20:01:50.275Z]                           Result: SUCCEEDED
[taskcluster 2026-05-20T20:01:50.275Z] === Task Finished ===
[taskcluster 2026-05-20T20:01:50.275Z] Task Duration: 36.748278049s
[taskcluster 2026-05-20T20:01:50.322Z] [mounts] Preserving cache: Moving "/home/task_177930726356980/cache0" to "/home/generic-worker/caches/dLhWV2LoTymkIfeKLwt8jw"
[taskcluster 2026-05-20T20:01:50.322Z] [mounts] Preserving cache: Moving "/home/task_177930726356980/cache1" to "/home/generic-worker/caches/HhJOMNPcQ-2vsX4Bd26bFA"