-
Notifications
You must be signed in to change notification settings - Fork 2
Open
Labels
enhancementNew feature or requestNew feature or request
Description
As of 1.4.0, recursive-diff already supports and is tested to work when a global dask.distributed.Client is registered, and use it instead of the default threading scheduler to read and compare the data.
This is particularly useful when the data is in AWS S3 (#61) and your client is not in AWS EC2.
Enhance the CLI to allow
- connecting to an already-running remote distributed.Cluster by URL
- starting a Coiled cluster, or connect to an already-running one by name. In the first case, it's important to expose the coiled settings that allow leaving the cluster running for some time after the client disconnects, so that a user can rapidly invoke the CLI multiple times and use the already-warm cluster. This (as well as number and type of workers, region, etc. etc. etc.) is probably best served by pointing to a
coiled.yamlfile.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request