feat(cot): Bug 2034520 improve json download and parsing error handling #791
firefoxci-taskcluster / tox-py313
succeeded
Apr 23, 2026 in 3m 8s
FirefoxCI (pull_request)
py313 tox-py313
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2026-04-23T22:09:09.277Z
Resolved: 2026-04-23T22:10:10.144Z
Task Execution Time: 1 minute, 867 milliseconds
Task Status: completed
Reason Resolved: completed
TaskId: Y_pwpsGwSIWf5EAL9VpL-Q
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
[taskcluster 2026-04-23T22:09:09.334Z] Worker Type (scriptworker-1/images) settings:
[taskcluster 2026-04-23T22:09:09.334Z] {
[taskcluster 2026-04-23T22:09:09.334Z] "generic-worker": {
[taskcluster 2026-04-23T22:09:09.334Z] "config": {
[taskcluster 2026-04-23T22:09:09.334Z] "headlessTasks": true
[taskcluster 2026-04-23T22:09:09.334Z] },
[taskcluster 2026-04-23T22:09:09.334Z] "engine": "multiuser",
[taskcluster 2026-04-23T22:09:09.334Z] "go-arch": "amd64",
[taskcluster 2026-04-23T22:09:09.334Z] "go-os": "linux",
[taskcluster 2026-04-23T22:09:09.334Z] "go-version": "go1.26.0",
[taskcluster 2026-04-23T22:09:09.334Z] "release": "https://github.com/taskcluster/taskcluster/releases/tag/v97.0.1",
[taskcluster 2026-04-23T22:09:09.334Z] "revision": "6519c127aad40a47b1412136d9a5797a76eca200",
[taskcluster 2026-04-23T22:09:09.334Z] "source": "https://github.com/taskcluster/taskcluster/commits/6519c127aad40a47b1412136d9a5797a76eca200",
[taskcluster 2026-04-23T22:09:09.334Z] "version": "97.0.1"
[taskcluster 2026-04-23T22:09:09.334Z] },
[taskcluster 2026-04-23T22:09:09.334Z] "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-2404-amd64-headless-googlecompute-2026-03-05",
[taskcluster 2026-04-23T22:09:09.334Z] "instance-id": "1633857102080845537",
[taskcluster 2026-04-23T22:09:09.334Z] "instance-type": "projects/887720501152/machineTypes/c2-standard-4",
[taskcluster 2026-04-23T22:09:09.334Z] "local-ipv4": "10.128.1.93",
[taskcluster 2026-04-23T22:09:09.334Z] "project-id": "fxci-production-level1-workers",
[taskcluster 2026-04-23T22:09:09.334Z] "public-hostname": "scriptworker-1-images-qspy6sh-qgizy1qxz0br6a.c.fxci-production-level1-workers.internal",
[taskcluster 2026-04-23T22:09:09.334Z] "public-ipv4": "34.31.249.186",
[taskcluster 2026-04-23T22:09:09.334Z] "region": "us-central1",
[taskcluster 2026-04-23T22:09:09.334Z] "zone": "us-central1-f"
[taskcluster 2026-04-23T22:09:09.334Z] }
[taskcluster 2026-04-23T22:09:09.334Z] Task ID: Y_pwpsGwSIWf5EAL9VpL-Q
[taskcluster 2026-04-23T22:09:09.334Z] === Task Starting ===
[taskcluster 2026-04-23T22:09:11.047Z] [mounts] No existing writable directory cache 'scriptworker-level-1-uv-v3-aeb56a8acbdc7df6c7d5-O6Uv8DzKScCsTVB9yK9uMg' - creating /home/generic-worker/caches/F5owZmT2QgqmwFWiSg8XkA
[taskcluster 2026-04-23T22:09:11.047Z] [mounts] Creating directory /home/task_177698214808272/cache0
[taskcluster 2026-04-23T22:09:11.065Z] [mounts] Successfully mounted writable directory cache '/home/task_177698214808272/cache0'
[taskcluster 2026-04-23T22:09:11.065Z] [mounts] No existing writable directory cache 'scriptworker-level-1-checkouts-v3-aeb56a8acbdc7df6c7d5-O6Uv8DzKScCsTVB9yK9uMg' - creating /home/generic-worker/caches/VlRyDJzrQbm5d2bnXTmDag
[taskcluster 2026-04-23T22:09:11.065Z] [mounts] Creating directory /home/task_177698214808272/cache1
[taskcluster 2026-04-23T22:09:11.082Z] [mounts] Successfully mounted writable directory cache '/home/task_177698214808272/cache1'
[taskcluster 2026-04-23T22:09:11.082Z] [mounts] Downloading task O6Uv8DzKScCsTVB9yK9uMg artifact public/image.tar.zst to /home/generic-worker/downloads/bYU3lL7_QSWuKvZnOZEjFQ
[taskcluster 2026-04-23T22:09:13.191Z] [mounts] Downloaded 98351948 bytes with SHA256 05b1e9b4f8ca05dbb661db130fb5d6887e322b34766c3b094b5afd3aeac5b12a from task O6Uv8DzKScCsTVB9yK9uMg artifact public/image.tar.zst to /home/generic-worker/downloads/bYU3lL7_QSWuKvZnOZEjFQ
[taskcluster:warn 2026-04-23T22:09:13.191Z] [mounts] Download /home/generic-worker/downloads/bYU3lL7_QSWuKvZnOZEjFQ of task O6Uv8DzKScCsTVB9yK9uMg artifact public/image.tar.zst has SHA256 05b1e9b4f8ca05dbb661db130fb5d6887e322b34766c3b094b5afd3aeac5b12a but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2026-04-23T22:09:13.191Z] [mounts] File mount "dockerimage" handled by registered handler (cache: /home/generic-worker/downloads/bYU3lL7_QSWuKvZnOZEjFQ, SHA256: 05b1e9b4f8ca05dbb661db130fb5d6887e322b34766c3b094b5afd3aeac5b12a)
[taskcluster 2026-04-23T22:09:13.191Z] [d2g] Loading docker image
[taskcluster 2026-04-23T22:09:18.062Z] [d2g] Loaded docker image "python3.13:latest"
[taskcluster 2026-04-23T22:09:18.062Z] Executing command 0: docker run -t --name taskcontainer_QwZQ6QF0TF-PMezXvpfCwA --memory-swap -1 --pids-limit -1 '--add-host=localhost.localdomain:127.0.0.1' -v '/home/task_177698214808272/cache0:/builds/worker/.task-cache/uv' -v /home/task_177698214808272/cache1:/builds/worker/checkouts --add-host=taskcluster:host-gateway --env-file 'env.list' bfd0395299d8287ec0dd7ec455578e7c4d1623e8ef6b345295363cde57ef4a8b /usr/local/bin/run-task --scriptworker-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- sh -lxce 'uv run tox -e py313'
[setup 2026-04-23T22:09:19.625+00:00] run-task started in /
[setup 2026-04-23T22:09:19.625+00:00] Invoked by command: --scriptworker-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- sh -lxce uv run tox -e py313
[setup 2026-04-23T22:09:19.625+00:00] Python version: 3.13.10
[setup 2026-04-23T22:09:19.625+00:00] Subprocess python version:
cpython-3.13.10-linux-x86_64-gnu /usr/local/bin/python3.13
cpython-3.13.10-linux-x86_64-gnu /usr/local/bin/python3 -> python3.13
cpython-3.13.10-linux-x86_64-gnu /usr/local/bin/python -> python3
[cache 2026-04-23T22:09:19.821+00:00] cache /builds/worker/.task-cache/uv is empty; writing requirements: gid=1000 uid=1000 version=1
[cache 2026-04-23T22:09:19.822+00:00] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2026-04-23T22:09:19.822+00:00] volume /builds/worker/.task-cache/uv is a cache
[volume 2026-04-23T22:09:19.822+00:00] volume /builds/worker/checkouts is a cache
[setup 2026-04-23T22:09:19.823+00:00] running as worker:worker
[vcs 2026-04-23T22:09:19.823+00:00] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2026-04-23T22:09:19.835+00:00] executing ['git', 'clone', 'https://github.com/mozilla-releng/scriptworker', '/builds/worker/checkouts/vcs']
[vcs 2026-04-23T22:09:19.837+00:00] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2026-04-23T22:09:21.279+00:00] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla-releng/scriptworker', 'hneiva/json-error']
[vcs 2026-04-23T22:09:21.482+00:00] From https://github.com/mozilla-releng/scriptworker
[vcs 2026-04-23T22:09:21.482+00:00] * branch hneiva/json-error -> FETCH_HEAD
[vcs 2026-04-23T22:09:21.495+00:00] executing ['git', 'checkout', '-f', '-B', 'hneiva/json-error', 'c5ca4ceb2f5a9dea3e789cae0e2cfc23228ae917']
[vcs 2026-04-23T22:09:21.591+00:00] Switched to a new branch 'hneiva/json-error'
[vcs 2026-04-23T22:09:21.592+00:00] cleaning git checkout...
[vcs 2026-04-23T22:09:21.592+00:00] executing ['git', 'clean', '-nxdff']
[vcs 2026-04-23T22:09:21.594+00:00] removing []
[vcs 2026-04-23T22:09:21.594+00:00] successfully cleaned git checkout!
[vcs 2026-04-23T22:09:21.595+00:00] TinderboxPrint:<a href='https://github.com/mozilla-releng/scriptworker/commit/c5ca4ceb2f5a9dea3e789cae0e2cfc23228ae917' title='Built from scriptworker commit c5ca4ceb2f5a9dea3e789cae0e2cfc23228ae917'>c5ca4ceb2f5a9dea3e789cae0e2cfc23228ae917</a>
[setup 2026-04-23T22:09:21.595+00:00] UV_CACHE_DIR is /builds/worker/.task-cache/uv
[task 2026-04-23T22:09:21.595+00:00] executing ['sh', '-lxce', 'uv run tox -e py313']
[task 2026-04-23T22:09:21.597+00:00] + id -u
[task 2026-04-23T22:09:21.598+00:00] + [ 1000 -eq 0 ]
[task 2026-04-23T22:09:21.598+00:00] + PATH=/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
[task 2026-04-23T22:09:21.598+00:00] + export PATH
[task 2026-04-23T22:09:21.598+00:00] + [ $ ]
[task 2026-04-23T22:09:21.598+00:00] + [ ]
[task 2026-04-23T22:09:21.598+00:00] + id -u
[task 2026-04-23T22:09:21.599+00:00] + [ 1000 -eq 0 ]
[task 2026-04-23T22:09:21.599+00:00] + PS1=$
[task 2026-04-23T22:09:21.599+00:00] + [ -d /etc/profile.d ]
[task 2026-04-23T22:09:21.599+00:00] + [ -r /etc/profile.d/*.sh ]
[task 2026-04-23T22:09:21.599+00:00] + unset i
[task 2026-04-23T22:09:21.599+00:00] + uv run tox -e py313
[task 2026-04-23T22:09:21.681+00:00] Using CPython 3.13.10 interpreter at: /usr/local/bin/python3
[task 2026-04-23T22:09:21.682+00:00] Creating virtual environment at: .venv
[task 2026-04-23T22:09:22.470+00:00] Building scriptworker @ file:///builds/worker/checkouts/vcs
[task 2026-04-23T22:09:22.529+00:00] Downloading virtualenv (5.6MiB)
[task 2026-04-23T22:09:22.530+00:00] Downloading uv (23.8MiB)
[task 2026-04-23T22:09:22.531+00:00] Downloading black (1.7MiB)
[task 2026-04-23T22:09:22.532+00:00] Downloading pygments (1.2MiB)
[task 2026-04-23T22:09:22.534+00:00] Downloading cryptography (4.3MiB)
[task 2026-04-23T22:09:22.535+00:00] Downloading aiohttp (1.7MiB)
[task 2026-04-23T22:09:22.537+00:00] Downloading mypy (14.0MiB)
[task 2026-04-23T22:09:23.441+00:00] Downloaded virtualenv
[task 2026-04-23T22:09:23.588+00:00] Downloaded uv
[task 2026-04-23T22:09:23.591+00:00] Downloaded aiohttp
[task 2026-04-23T22:09:23.612+00:00] Downloaded black
[task 2026-04-23T22:09:23.614+00:00] Downloaded cryptography
[task 2026-04-23T22:09:23.690+00:00] Downloaded pygments
[task 2026-04-23T22:09:23.959+00:00] Downloaded mypy
[task 2026-04-23T22:09:24.104+00:00] Built scriptworker @ file:///builds/worker/checkouts/vcs
[task 2026-04-23T22:09:24.106+00:00] warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
[task 2026-04-23T22:09:24.106+00:00] If the cache and target directories are on different filesystems, hardlinking may not be supported.
[task 2026-04-23T22:09:24.106+00:00] If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
[task 2026-04-23T22:09:24.261+00:00] Installed 108 packages in 155ms
[task 2026-04-23T22:09:24.946+00:00] py313: venv> .venv/bin/uv venv -p cpython3.13 --allow-existing '--prompt=vcs[py313]' --python-preference system /builds/worker/checkouts/vcs/.tox/py313
[task 2026-04-23T22:09:25.207+00:00] .pkg: venv> .venv/bin/uv venv -p /builds/worker/checkouts/vcs/.venv/bin/python --allow-existing '--prompt=vcs[.pkg]' --python-preference system /builds/worker/checkouts/vcs/.tox/.pkg
[task 2026-04-23T22:09:25.256+00:00] .pkg: install_requires> .venv/bin/uv pip install hatchling
[task 2026-04-23T22:09:25.569+00:00] .pkg: _optional_hooks> python /builds/worker/checkouts/vcs/.venv/lib/python3.13/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-04-23T22:09:25.608+00:00] .pkg: get_requires_for_build_editable> python /builds/worker/checkouts/vcs/.venv/lib/python3.13/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-04-23T22:09:25.721+00:00] .pkg: install_requires_for_build_editable> .venv/bin/uv pip install 'editables~=0.3'
[task 2026-04-23T22:09:25.925+00:00] .pkg: build_editable> python /builds/worker/checkouts/vcs/.venv/lib/python3.13/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-04-23T22:09:26.047+00:00] py313: install_package_deps> .venv/bin/uv pip install PyYAML 'aiohttp>=3' 'arrow>=1.0' 'cryptography>=2.6.1' dictdiffer github3.py 'immutabledict>=1.3.0' 'json-e>=2.5.0' 'jsonschema[format-nongpl]' taskcluster-taskgraph 'taskcluster>=40'
[task 2026-04-23T22:09:27.239+00:00] py313: install_package> .venv/bin/uv pip install --reinstall --no-deps scriptworker@/builds/worker/checkouts/vcs/.tox/.tmp/package/1/scriptworker-63.0.0-py3-none-any.whl
[task 2026-04-23T22:09:27.309+00:00] py313: commands[0]> coverage run --source=src/scriptworker --branch --rcfile tox.ini -m pytest tests
[task 2026-04-23T22:09:33.522+00:00] ============================= test session starts ==============================
[task 2026-04-23T22:09:33.522+00:00] platform linux -- Python 3.13.10, pytest-9.0.3, pluggy-1.6.0
[task 2026-04-23T22:09:33.522+00:00] cachedir: .tox/py313/.pytest_cache
[task 2026-04-23T22:09:33.522+00:00] Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket=<bucket_type>
[task 2026-04-23T22:09:33.522+00:00] rootdir: /builds/worker/checkouts/vcs
[task 2026-04-23T22:09:33.522+00:00] configfile: pyproject.toml (WARNING: ignoring pytest config in tox.ini!)
[task 2026-04-23T22:09:33.522+00:00] plugins: random-order-1.2.0, asyncio-1.3.0, mock-3.15.1
[task 2026-04-23T22:09:33.522+00:00] asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
[task 2026-04-23T22:09:33.522+00:00] collected 690 items
[task 2026-04-23T22:09:33.522+00:00]
[task 2026-04-23T22:09:33.688+00:00] tests/test_artifacts.py ......................................... [ 5%]
[task 2026-04-23T22:09:33.804+00:00] tests/test_client.py ............................. [ 10%]
[task 2026-04-23T22:09:33.920+00:00] tests/test_config.py .................................... [ 15%]
[task 2026-04-23T22:09:33.976+00:00] tests/test_context.py ............. [ 17%]
[task 2026-04-23T22:09:34.053+00:00] tests/test_cot_generate.py ...... [ 18%]
[task 2026-04-23T22:09:34.318+00:00] tests/test_cot_verify.py ............................................... [ 24%]
[task 2026-04-23T22:09:37.699+00:00] ........................................................................ [ 35%]
[task 2026-04-23T22:09:38.716+00:00] ........................................................................ [ 45%]
[task 2026-04-23T22:09:38.867+00:00] ..................... [ 48%]
[task 2026-04-23T22:09:38.885+00:00] tests/test_ed25519.py ........ [ 50%]
[task 2026-04-23T22:09:39.396+00:00] tests/test_github.py ................................................... [ 57%]
[task 2026-04-23T22:09:39.421+00:00] ... [ 57%]
[task 2026-04-23T22:09:39.437+00:00] tests/test_integration.py ssssssssssss [ 59%]
[task 2026-04-23T22:09:39.516+00:00] tests/test_log.py .......... [ 61%]
[task 2026-04-23T22:09:39.529+00:00] tests/test_production.py sssssssssss [ 62%]
[task 2026-04-23T22:09:42.054+00:00] tests/test_task.py ..................................................... [ 70%]
[task 2026-04-23T22:09:49.570+00:00] ............................................................... [ 79%]
[task 2026-04-23T22:09:52.592+00:00] tests/test_task_process.py .... [ 80%]
[task 2026-04-23T22:09:53.286+00:00] tests/test_utils.py .................................................... [ 87%]
[task 2026-04-23T22:10:05.533+00:00] .............................................................. [ 96%]
[task 2026-04-23T22:10:08.103+00:00] tests/test_worker.py ........................ [100%]Task was destroyed but it is pending!
[task 2026-04-23T22:10:08.103+00:00] task: <Task cancelling name='Task-1954' coro=<noop_async() running at /builds/worker/checkouts/vcs/tests/__init__.py:121>>
[task 2026-04-23T22:10:08.103+00:00] /usr/local/lib/python3.13/asyncio/base_events.py:750: RuntimeWarning: coroutine 'noop_async' was never awaited
[task 2026-04-23T22:10:08.103+00:00] self._ready.clear()
[task 2026-04-23T22:10:08.103+00:00] RuntimeWarning: Enable tracemalloc to get the object allocation traceback
[task 2026-04-23T22:10:08.104+00:00] Task was destroyed but it is pending!
[task 2026-04-23T22:10:08.104+00:00] task: <Task cancelling name='Task-1930' coro=<noop_async() running at /builds/worker/checkouts/vcs/tests/__init__.py:121>>
[task 2026-04-23T22:10:08.104+00:00] Task was destroyed but it is pending!
[task 2026-04-23T22:10:08.104+00:00] task: <Task cancelling name='Task-1946' coro=<noop_async() running at /builds/worker/checkouts/vcs/tests/__init__.py:121>>
[task 2026-04-23T22:10:08.486+00:00]
[task 2026-04-23T22:10:08.487+00:00]
[task 2026-04-23T22:10:08.487+00:00] =============================== warnings summary ===============================
[task 2026-04-23T22:10:08.487+00:00] tests/test_worker.py::test_unexpected_exception_catch_and_tell_taskcluster
[task 2026-04-23T22:10:08.487+00:00] tests/test_worker.py::test_run_tasks_cancel_cot
[task 2026-04-23T22:10:08.487+00:00] tests/test_worker.py::test_run_tasks_cancel_right_before_cot
[task 2026-04-23T22:10:08.487+00:00] /usr/local/lib/python3.13/asyncio/base_events.py:750: RuntimeWarning: coroutine 'noop_async' was never awaited
[task 2026-04-23T22:10:08.487+00:00] self._ready.clear()
[task 2026-04-23T22:10:08.487+00:00] Enable tracemalloc to get traceback where the object was allocated.
[task 2026-04-23T22:10:08.487+00:00] See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info.
[task 2026-04-23T22:10:08.487+00:00]
[task 2026-04-23T22:10:08.487+00:00] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
[task 2026-04-23T22:10:08.487+00:00] ================= 667 passed, 23 skipped, 3 warnings in 38.77s =================
[task 2026-04-23T22:10:08.994+00:00] .pkg: _exit> python /builds/worker/checkouts/vcs/.venv/lib/python3.13/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-04-23T22:10:09.032+00:00] py313: OK (44.09=setup[2.41]+cmd[41.68] seconds)
[task 2026-04-23T22:10:09.032+00:00] congratulations :) (44.17 seconds)
[taskcluster 2026-04-23T22:10:09.581Z] Exit Code: 0
[taskcluster 2026-04-23T22:10:09.581Z] User Time: 16.89ms
[taskcluster 2026-04-23T22:10:09.581Z] Kernel Time: 14.638ms
[taskcluster 2026-04-23T22:10:09.581Z] Wall Time: 51.518740344s
[taskcluster 2026-04-23T22:10:09.581Z] Average Available System Memory: 14.18 GiB
[taskcluster 2026-04-23T22:10:09.581Z] Average System Memory Used: 1.43 GiB
[taskcluster 2026-04-23T22:10:09.581Z] Peak System Memory Used: 1.65 GiB
[taskcluster 2026-04-23T22:10:09.581Z] Total System Memory: 15.61 GiB
[taskcluster 2026-04-23T22:10:09.581Z] Result: SUCCEEDED
[taskcluster 2026-04-23T22:10:09.582Z] === Task Finished ===
[taskcluster 2026-04-23T22:10:09.582Z] Task Duration: 51.519981266s
[taskcluster 2026-04-23T22:10:09.606Z] [mounts] Preserving cache: Moving "/home/task_177698214808272/cache0" to "/home/generic-worker/caches/F5owZmT2QgqmwFWiSg8XkA"
[taskcluster 2026-04-23T22:10:09.607Z] [mounts] Preserving cache: Moving "/home/task_177698214808272/cache1" to "/home/generic-worker/caches/VlRyDJzrQbm5d2bnXTmDag"
Loading