Let's address the issue of including any Docker image while building data pipelines using Spring Cloud Data Flow, which can natively interpret only Spring Boot images.
Microsoft has transformed VSTS into Azure DevOps. See what that means for your work, what cloud support is being offered, and some sample projects to get you started.
Here is a tutorial on how to use NiFi 1.0.0's zero-master clustering that uses Zookeeper so that there is never an issue of a cluster dying because of one master node going down.