[Core][RuntimeEnv] Add archives plugin - #65830
Conversation
Signed-off-by: weiquanlee <demonzsong@gmail.com>
There was a problem hiding this comment.
Code Review
This pull request introduces the archives runtime environment feature in Ray, allowing remote archives to be downloaded and unpacked on worker nodes, with local paths exposed via the new get_archive_paths API. Feedback on the implementation highlights several critical issues: a potential crash in ArchivesPlugin.create when uri is None which would break all runtime environment setups; a FileNotFoundError risk in delete_uri if the local directory is missing; a NameError in the agent due to an undefined UriType annotation; and case-sensitivity in archive extension validation.
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.
Reviewed by Cursor Bugbot for commit 9b37c12. Configure here.
Signed-off-by: weiquanlee <demonzsong@gmail.com>

Description
This PR adds an alpha
archivesruntime environment option for making remote, non-Python resources such as models and configuration files available to Ray tasks and actors without changing the worker's current directory orPYTHONPATH.The new option accepts either a remote archive URI or a dictionary mapping names to URIs. Supported formats are
.zip,.tar.gz, and.tgz.This PR:
ArchivesPluginthat downloads, unpacks, caches, and cleans up archives on each worker node.ray.runtime_env.get_archive_paths()for retrieving local unpacked paths from workers.working_dirandarchives.Related issues
#65831
Additional information
Example: