[feature] Bundler service #72
Description
Proposed Changes
Integrate a "Bundler" service that can be used to create bundles that include multiple objects.
Bundles can be used to bulk-download one or more objects packed together as archive of choice (.tar.gz, .zip etc.)
The first iteration of this service will include two additional service:
- A "BundlerService" that can be used to initialize bundles by specifying a list of object_ids, a filename and and archive_type as well as an optional expiry_date
- InternalServices that communicate with the bundler to setup bundles and invalidate then.
- The Bundler is a separate program that can access the underlying storage architecture (similar to the dataproxy) and exposes interfacing functionalities to query and pack together objects.