Big Data Resources

Introduction to Message Brokers. Part 1: Apache Kafka vs. RabbitMQ

If you're looking for a message broker for your next project, read on to get an overview of to of the most popular open source solutions out there.

May 8, 2019

by Vitaliy Samofal

· 41,210 Views · 30 Likes

Kafka Producer Overview

In this post, we take a look in to producers in Apache Kafka and what they allow devs and data scientists to do.

Updated May 7, 2019

by Sylvester Daniel

· 19,685 Views · 12 Likes

Kafka Technical Overview

In this post, we take a high-level look at the architecture of Apache Kafka, the role ZooKeeper plays, and more.

Updated May 7, 2019

by Sylvester Daniel

· 35,106 Views · 51 Likes

How to Build a Data Pipeline Using Kafka, Spark, and Hive

In this post, we learn how to make a basic data pipeline using these popular Apache frameworks and the Scala language.

May 7, 2019

by Avi Garg

· 30,223 Views · 5 Likes

A Complete Tutorial on the Drools Business Rule Engine

Check out this post for a complete guide to the Drools business rule engine.

May 2, 2019

by Federico Tomassetti

· 22,919 Views · 3 Likes

Optimizing Kafka Streams Applications

Let's see how to optimize Kafka Streams applications.

May 2, 2019

by Bill Bejeck

· 19,493 Views · 5 Likes

Build and Install Hadoop on Windows With Native Binaries

Build your own Hadoop distribution in order to make it run on Windows 7 with this in-depth tutorial.

Updated May 1, 2019

by Gopal Tiwari

· 49,192 Views · 11 Likes

Assessing Cloud Backup Solutions: AWS vs. Azure vs. Google Cloud

Take a look at what each of the three leading cloud vendors has to offer for backup and data storage.

May 1, 2019

by Gilad David Maayan

CORE

· 14,190 Views · 2 Likes

Measure document similarity automatically and query them efficiently.

May 1, 2019

by Sibanjan Das

CORE

· 6,765 Views · 4 Likes

How to Protect IoT Applications With Role-Based Access Control (RBAC)

Learn more about role-based access control for IoT applications.

Updated April 29, 2019

by Mike Mackrory

· 6,983 Views · 1 Like

Kafka Internals: Consumers

In this post, we continue our look under the hood of Apache Kafka by exploring how consumers work in this platform.

April 25, 2019

by Arun Lingala

· 39,720 Views · 11 Likes

Example of ETL Application Using Apache Spark and Hive

In this article, we'll read a sample data set with Spark on HDFS (Hadoop File System), do a simple analytical operation, then write to a table that we'll make in Hive.

April 24, 2019

by Emrah Mete

· 36,583 Views · 4 Likes

Kafka Internals: Topics and Partitions

We take a look under the hood of Apache Kafka to better understand how this popular framework uses topics and partitions.

April 24, 2019

by Arun Lingala

· 32,864 Views · 13 Likes

Streaming IoT Data and MQTT Messages to Apache Kafka

Use Apache Kafka for all your IoT data streaming and MQTT message needs!

April 24, 2019

by Ian Skerrett

· 22,141 Views · 13 Likes

How to Process Nasty Fixed Width Files Using Apache Spark

Fixed width files can be a pain. Learn how to get around the issues they present using Scala and Spark.

April 19, 2019

by Subhasish Guha

· 29,566 Views · 6 Likes

Introduction to Elasticsearch and the ELK Stack, Part 1

In this post, we cover the frameworks that make up the ELK stack (Elasticsearch, Logstash, Kibana [plus Beats]) and how they all work together.

Updated April 18, 2019

by Ayush Jain

· 19,349 Views · 9 Likes

10 Best JavaScript Charting Libraries for Any Data Visualization Need

If you're interested in learning how to visualize your findings, read on for a list of great data viz libraries to help get you started.

April 18, 2019

by Ruslan Borovikov

· 39,549 Views · 15 Likes

Installing the EFK Stack With Kubernetes With GKE

In this article, we take a look at a relatively new app available in GKE's app marketplace called, rather succinctly, "Elastic GKE Logging."

April 17, 2019

by Daniel Berman

· 10,335 Views · 4 Likes

Database Migration Tools

In this post, we take a look at the three main kinds of database migration tools (on-premise, open source, and cloud-based) and the situation in which each is best.

April 16, 2019

by Garrett Alley

· 32,822 Views · 3 Likes

Lambda Architecture: How to Build a Big Data Pipeline, Part 2 [Video]

We walk you through how to provide a robust system that is fault-tolerant against hardware failures and human mistakes using the Lambda architecture approach.

April 16, 2019

by Alexsandro Souza

· 9,411 Views · 4 Likes

The Latest Big Data Topics