Improvements were made to enable Spark to execute faster, making a lot of earlier tips obsolete. This post will first give a quick overview of what changes were made.
An introductory look into Apache Kafka and the architecture that makes it up. We'll cover topics, partitions, and what they mean for devs and data engineers.