Skip to content

Fix/usersync prune config - #1

Merged
flashguerdon merged 384 commits into
developfrom
fix/usersync-prune-config
Aug 3, 2026
Merged

Fix/usersync prune config#1
flashguerdon merged 384 commits into
developfrom
fix/usersync-prune-config

Conversation

@flashguerdon

Copy link
Copy Markdown

No description provided.

pieterlukasse and others added 30 commits June 5, 2025 17:53
…udit_entry

Feat: record /admin/user endpoint calls in the logs
fix: add a note in the migrations folder alerting about the manual migration possibility
…gging" (uc-cdis#1272)

This reverts commit 4c9a0a0, reversing
changes made to 74483ce.
…enapi

Adds GA4GH post endpoint to swagger docs
Fix passport request schema in swagger docs
…nk-guid

Add unit tests for error from create blank record
* Switch Fence Service to new HELM based CI Pipeline

* Update integration_tests.yaml

* Update integration_tests.yaml

* Update integration_tests.yaml

* Update integration_tests.yaml

* Update integration_tests.yaml

* Dummy commit

* Update integration_tests.yaml

* Update integration_tests.yaml

* Update integration_tests.yaml

* Update integration_tests.yaml

---------

Co-authored-by: Hara Prasad <haraprasadj@uchicago.edu>
Avantol13 and others added 28 commits June 8, 2026 11:44
Updates fence to include the DRS endpoint for bulk presigned url generation.

Updates fence download api to support bulk presigned-url generation

adding support for vector download

fix fstring escape

add model to vec get

change route for vector download

update vector return

add vec class

add debug statement for vec

fix requests url

fix request protocol for vec signed url

adding vector upload

fix import and add logging

fix function typo

remove old code

update indexd post params

remove more old code

fix string in url

fix string escape typo

ensure md5 is not used for security

add bulk download

add bulk download

bulk download with authz role caching

add function definiton

fix class call

clean up imports

update function arguments

fix loop

actions of bulk to only support download

actions of bulk to only support download

fix escape quotes

no actions for bulk downloads

fix bulk actions

fix bulk download return

reformat bulk response

change ems service name

change service networking for embedding management service

Remove Embeddings work, add TODOs

Remove VecIndexdFIleLocation

In Progress

Finish endpoint in ga4gh.py and fill out indexd.py

fix drs input variable name

add unit tests

Fixes for Kyle

extra tests for final changes

Add gen3-code-vigil tests

address spencer's comments

audit, openapi, and some test fixes

acl no authz case for auth flow

mock index_document instead of endpoint directly

One last unit test change to get past 500 (still other errors)

move acl-only else block

add guard to bulk path, implement UserError

Add unit tests for DRS 1.5 bulk presigned url

Add docs for pytests

addressing more comments

relock poetry

Remove no longer necessary username = auth_info line

Remove BulkObjectAccessRequest and passport support from bulk /download enpdoint

separate out data models as requested by Alex

Store passport

Add __passport endpoint

Fix passport

Remove old passports when adding new passport

move ga4gh data models back into ga4gh.py to top on request from Kyle

Revert "Merge branch 'chore/add-passport-to-userinfo' into feat/add-bulk-presigned-url"

This reverts commit 4c6fde5, reversing
changes made to 96f6284.

Co-authored-by: jacob50231 <jacobdaugherty@uchicago.edu>
Co-authored-by: MichaelLukowski <mlukowski@uchicago.edu>
…ass, replace file_ids with guids, add docstrings, extract request info at blueprint route level, remove vec encoding)
…aud (uc-cdis#1356)

* validate audience = 'gen3'

* fix client_id in audience

* generate access token with additional aud

* add custom exp

* update authutils

* force adding TES aud to token from API key

* fix

* query param instead of body

* fix for old API keys and tokens

* do not force add work_order param

* comment

* clean up

* fix revoke invalid token logic

* client can revoke access token

* add token revocation and check status endpoints

* update swagger doc

* update comments

* simplify /token/blacklisted endpoint

* add log

* fix unit tests

* unit tests

* more expiration checks

* add authz check

* fix test

* latest commit of authutils branch

* fix to accept gen3-workflow s3 endpoint auth header

* handle blacklisted expired token

* fix typo

* remove custom revoke endpoint, no regular token revocation, remove scopes from aud

* validate_jwt does not check if regular token is blacklisted

* authz check

* revert 400 to 200 for genwf s3 endpoint use case

* rename work order token => task token

* update openapi doc

* fix getting auth mapping

* fix: task token can only be used for the specific task

* clean up

* Add Caching of Blakclisted tokens, other small improvements.

* Update task_tokens.md

* Remove accidental commit of release notes.md

* Update secrets baseline

* Respond to PR comments.

* Update `can_user_get_task_token` implementation based on the PR comments.

* Clarifying comments and revert `/cdis/access_token`

* Respond to PR comments

* Add FIFO cache and bring back `EXP_ERR_TOLERANCE`

* Prevent audeince mismatch error.

* Update `is_task_token` functionality to be based on `claims["context"]["task_token_type"]`

* Include api key in test_revoke tests. Rename blacklist to denylist wherever needed.

* Replace `aud="gen3"` with a constant ;  separate larger unit tests

* Provide only default scopes for task token

* Add "user" scope to task token

* Update config to have Default Task token scopes

* Update pyproject and poetry to pin authutils to >=8.0.0

---------

Co-authored-by: Sai Shanmukha <nss10@outlook.com>
feat(content): new endpoint for content retrieval PD-169
@coveralls

coveralls commented Aug 3, 2026

Copy link
Copy Markdown

Coverage Report for CI Build 30792443737

Coverage decreased (-0.7%) to 74.53%

Details

  • Coverage decreased (-0.7%) from the base build.
  • Patch coverage: No coverable lines changed in this PR.
  • 1279 coverage regressions across 47 files.

Uncovered Changes

No uncovered changes found.

Coverage Regressions

1279 previously-covered lines in 47 files lost coverage.

Top 10 Files by Coverage Loss Lines Losing Coverage Coverage
scripting/fence_create.py 167 60.41%
sync/sync_users.py 165 81.87%
blueprints/data/indexd.py 105 87.46%
resources/openid/idp_oauth2.py 101 50.0%
blueprints/admin.py 65 67.94%
utils.py 61 63.93%
resources/storage/storageclient/cleversafe.py 44 77.96%
blueprints/data/blueprint.py 40 81.17%
blueprints/link.py 40 75.13%
resources/google/utils.py 40 77.19%

Coverage Stats

Coverage Status
Relevant Lines: 11873
Covered Lines: 8849
Line Coverage: 74.53%
Coverage Strength: 0.75 hits per line

💛 - Coveralls

@flashguerdon
flashguerdon merged commit 9d911e4 into develop Aug 3, 2026
4 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.