Today Watson Studio supports lineage of both model and data via graphical UI. However it doesn't seem to support generating a human readable report to describe the changes (e.g. adding / removing features, model parameters). In order to better support change management of ML models and assist clients understand the change better, the following capabilities are preferrable:
1) Provide a report generation capability to describe the change details of machine learning models. E.g. PDF or Word.
2) Provide a capability for team to provide/update comments/discussions on those model changes and include these discussions in the report
We currently are trying to use wiki or other means to track changes but an automated, collocated traceability of model changes will save a lot of time.
Why is it useful?
|Who would benefit from this IDEA?|
How should it work?