Flume, Kafka, and NiFi offer great performance, can be scaled horizontally, and have a plug-in architecture where functionality can be extended through custom components.
Learn how to install and configure a DC/OS monitoring stack with cAdvisor, InfluxDB, and Grafana to gather, export, store, and display detailed metrics.
Microservices' benefits come with added complexity among the dependencies. Fortunately, linkerd's per-request routing can help stage microservices to make sure they work.
See how to linkerd as your ingress vector ingress to a Kubernetes cluster while also handling service routing, with NGINX to help make it production-ready.
During webinar about 'Distributed Caching for you next Node.js project' I was asked if we provide examples of running Hazelcast with Compose or Swarm. Now you have it!
If event time is very relevant and latencies in the seconds range are completely unacceptable, Kafka should be your first choice. Otherwise, Spark works just fine.