Skip to content

feat(usecases): add cns:// source retrieval and DataNexus workflow recipes - #61

Open
dandye wants to merge 1 commit into
mainfrom
datanexus_colossus_v0001
Open

dandye wants to merge 1 commit into
mainfrom
datanexus_colossus_v0001

Conversation

@dandye

@dandye dandye commented Sep 19, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Add cns:// and /cns/... usecase source retrieval support in src/logstory/logstory.py via fileutil (_normalize_cns_path, _CnsBlob, _get_cns_blobs).
  • Support optional LOGSTORY_GFS_USER role/group impersonation (--gfs_user) for group-owned Colossus paths.
  • Update DEFAULT_BUCKET to cns:///cns/is-d/home/dandye/logstory_usecases_20260918.
  • Add Justfile recipes for publishing/listing usecases on CNS (usecase-publish-cns, usecase-publish-all-cns, usecase-list-cns) and registering dataset variants in DataNexus via mlc (datanexus-register-dryrun, datanexus-register using AUTO format and latest alias).
  • Add unit tests in tests/test_cli.py covering DEFAULT_BUCKET, cns:// URI normalization, _get_cns_blobs directory and recursive file listing, and _CnsBlob downloads.

Test Plan

  • uv run pytest -q (177 passed)
  • uv run ruff check src/ tests/
  • uv run pyink --check src/ tests/
  • Live verification with uv run logstory usecases list-available and uv run logstory usecases get NETWORK_ANALYSIS

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant