Sometimes, I only need to use a cluster for a one-off task that may run for a few days or more. I would like to be able to pause these clusters when I am not using them to suspend charges. The clusters usually have some configuration that I do manually. The current recommendation for pausing a cluster is to create a customization script so that the cluster can be destroyed and recreated when required. However, because the cluster is being used for a one-off task, it doesn't justify the effort required to create customization script.
I would like to be able to just pause my server and suspend charges when I am not using it. I appreciate that the cluster configuration and other cluster state may need to be stored somewhere while paused, such as IBM COS. I'm happy to pay for the object storage cost while paused.
Why is it useful?
|Who would benefit from this IDEA?||Any analytics engine user|
How should it work?
|Submitting Organization||F2F Sales|