In our implementation today we had to build a micro service to upload / download data sets to our Cloud Object Storage Repository. In doing this we have to implement a lot of the same features that Data Catalog provides such as access control, tagging and tracking content. I would like the ability to upload/download content from a local or lab system to a user owned and connected repository. In this case our repository is Cloud Object Storage. This enables our two persona's of a Data Provider and a Data Consumer to fit very well into Catalog's use cases.
Why is it useful?
|Who would benefit from this IDEA?||There are several persona's that would benefit from this idea. The Data engineer, Content providers, the knowledge engineer & Data Scientist|
How should it work?