IBM Watson Data & AI - Structured Ideas

Welcome to the idea forum for IBM Watson Data & AI — our team welcomes any feedback, requests, and suggestions you have for improving our products! 

This forum allows us to connect your product improvement ideas with IBM product and engineering teams. 

Provide a managed NiFi service for creating and running data pipelines

Nifi is a popular open source tool for building data pipelines.  It would be great if nifi was available as a managed service as part of the WDP. 

The service should ideally have source and target connectors for the following IBM Cloud services (and probably more):

  • Cloud object storage
  • Message Hub
  • IBM Analytics Engine
    • Hive
    • HBase (Phoenix)
  • DB2 Warehouse on Cloud
  • Cloudant
  • Compose Postgresql
  • Compose Mysql
  • Compose ScyllaDB
  • Compose Elasticsearch
  • Watson Knowledge Catalog
  • Watson Discovery

There should also be the ability to upload custom connectors.

See here for an old (but good) 5 minute summary video.

  • Chris Snow
  • Dec 14 2018
  • Will not implement
Role Summary
  • Attach files
  • JAUME MIRALLES SOLE commented
    December 14, 2018 17:58

    Don't forget Watson Discovery connector. At the end is a repository of enriched documents.

  • Hung Le commented
    December 14, 2018 17:58

    that's something we always need.

  • STUART MACLEAN commented
    December 14, 2018 17:58

    Excellent idea. 

  • Arancha Ocaña commented
    December 14, 2018 17:58

    Even full HDF (SAM, Storm ...)