IBM Cloud Databases - Structured Ideas

This Ideas portal is being closed.  Please enter new idea at http://ibm.biz/IBMAnalyticsIdeasPortal

The latest version in DSX mixes the stage progress with output

It looks like this is a new defect that was not present previously: the notebook will show the Spark task progress in text (e.g. for a statement like df.show(5)) and will mix it with the output for Scala notebooks. Here is an example:

[Stage 15:=====================================================>(196 + 3) / 199]+---------------+------------+-----+-----------------+------------------+---------+---------+----------+------------+-----------+------------+-----------+--------------+---------------+------------+----------------+
|TradingStrategy|TradingStyle|total| ...

Disabling the progress in the menu of the notebook does not help resolve the issue. The behavior stays the same.

  • Guest
  • Dec 14 2018
  • Needs review
Why is it useful?
Who would benefit from this IDEA? As data scientist, I would like to see the output without being mixed with Spark progress info.
How should it work?
Idea Priority Medium
Priority Justification
Customer Name
Submitting Organization
Submitter Tags
  • Attach files