IBM Watson Data & AI - Structured Ideas

Welcome to the idea forum for IBM Watson Data & AI — our team welcomes any feedback, requests, and suggestions you have for improving our products! 

This forum allows us to connect your product improvement ideas with IBM product and engineering teams. 

Add the ability to add/remove OS-level libs for an entire cluster.

Currently, it is not possible to install new OS-level libraries in DSX, due to a lack of sudo permissions. Unfortunately, this prevents DSX from being a viable environment for many actual machine learning projects, such as those that require reading specialized data formats for which a specialized OS-level library is needed.

  • Mike Dusenberry
  • Aug 17 2017
  • Needs review
  • Attach files
  • Roland Weber commented
    June 12, 2018 06:08

    There are now different backends you can use. With IBM Analytics Engine, you get your own cluster and can configure it to your needs. With Environments, you get a single-machine container and no sudo access, but libraries available from conda can be installed. The original Spark as a Service cluster is shared, so users cannot be allowed to make cluster-wide changes there.