IBM Watson Data & AI - Structured Ideas

Welcome to the idea forum for IBM Watson Data & AI — our team welcomes any feedback, requests, and suggestions you have for improving our products! 

This forum allows us to connect your product improvement ideas with IBM product and engineering teams. 

Provide a managed NiFi service for creating and running data pipelines

Nifi is a popular open source tool for building data pipelines.  It would be great if nifi was available as a managed service as part of the WDP. 

The service should ideally have source and target connectors for the following IBM Cloud services (and probably more):

  • Cloud object storage
  • Message Hub
  • IBM Analytics Engine
    • Hive
    • HBase (Phoenix)
  • DB2 Warehouse on Cloud
  • Cloudant
  • Compose Postgresql
  • Compose Mysql
  • Compose ScyllaDB
  • Compose Elasticsearch
  • Watson Knowledge Catalog
  • Watson Discovery

There should also be the ability to upload custom connectors.

See here for an old (but good) 5 minute summary video.

  • Chris Snow
  • Apr 11 2018
  • Will not implement
Role Summary
  • Attach files
  • Arancha Ocaña commented
    April 12, 2018 14:44

    Even full HDF (SAM, Storm ...)

    April 12, 2018 15:17

    Don't forget Watson Discovery connector. At the end is a repository of enriched documents.

  • Stuart Maclean commented
    April 15, 2018 20:37

    Excellent idea. 

  • Hung Le commented
    April 18, 2018 10:29

    that's something we always need.