Big Data Resources

Custom Partitioner in Kafka: Let’s Take a Quick Tour!

In this article, we discuss how to create a custom partitioner in Apache Kafka in a few, short steps.

January 8, 2020

by Swapnil Gosavi

· 36,680 Views · 5 Likes

Custom Partitioner in Kafka Using Scala: Take Quick Tour!

In this article, we discuss when Kafka's default partitioner is not enough and how to build a custom partitioner in Kafka using Scala.

January 7, 2020

by Swapnil Gosavi

· 12,909 Views · 4 Likes

Top 8 Technology Trends for 2020 and Beyond

2020 is just around the corner with new technologies and approaches that bring us ever closer to the 4th Industrial Revolution.

January 7, 2020

by Anna Smith

· 48,055 Views · 17 Likes

Custom Field Handling in Elasticsearch: Managing Total Number of Fields Limit

In this article, we discuss how to implement custom field handling in Elastisearch in order to manage total number of fields and their limits.

December 26, 2019

by Dinesh Agrawal

· 22,294 Views · 2 Likes

MapReduce and Yarn: Hadoop Processing Unit Part 1

In this article, we begin a two-part series on basic implementation of MapReduce and Yarn in the Hadoop ecosystem.

December 26, 2019

by Dheeraj Gupta

CORE

· 99,869 Views · 5 Likes

Machine Learning and Real-Time Analytics in Apache Kafka Applications

This post explores a specific part of building an ML infrastructure: the deployment of an analytic model in a Kafka application for real-time predictions.

December 25, 2019

by Kai Wähner

CORE

· 24,014 Views · 11 Likes

Using R on Jupyter Notebook

In this article, we discuss how to install use the R programming language in Jupyter Notebook for all of your statistical analysis needs.

Updated December 23, 2019

by Jirapongse Phuriphanvichai

· 80,585 Views · 6 Likes

Implement a Counter Table in Elasticsearch

In this brief article, we discuss how to implement a counter table in Elastisearch to better understand how often features are used in our app.

Updated December 13, 2019

by Dinesh Agrawal

· 17,334 Views · 3 Likes

Hadoop Ecosystem: Hadoop Tools for Crunching Big Data

In this article, we discuss the tools and components that make up the Hadoop Ecosystem, including Hive, Spark, MapReduce, ZooKeeper, and Oozie.

December 11, 2019

by Shubham Sinha

· 28,709 Views · 7 Likes

KSQL: A SQL Streaming Engine for Apache Kafka

In this article, we discuss how to use KSQL, a SQL streaming engine for Apache Kafka, to write more scalable, elastic, and fault-tolerant code.

December 11, 2019

by Shubham Dangare

· 20,826 Views · 8 Likes

Spring Cloud Streams ETL

Check out how o use Spring Cloud Streams for real-time data processing.

December 11, 2019

by imran raza

· 12,714 Views · 4 Likes

Apache Kafka as Digital Twin in Industrial IoT (IIoT)

Learn more about the benefits of Digital Twin tech in IIoT and it's relation to Apache Kafka!

December 9, 2019

by Kai Wähner

CORE

· 24,144 Views · 17 Likes

Introduction to Event Streaming with Kafka and Kafdrop

In this article, we discuss fundamental concepts behind event streaming in Apache Kafka by diving into Kafdrop's web UI.

December 4, 2019

by Emil Koutanov

· 25,873 Views · 7 Likes

Change Data Capture (CDC) With Embedded Debezium and Spring Boot

In this article, we discuss how to perform Change Data Capture with Embedded Debezium and SpringBoot as an alternative to Kafka Connect.

December 3, 2019

by Sohan Ganapathy

· 32,944 Views · 11 Likes

How to Integrate Arduino and Google Cloud Platform

Learn more about integrating Arduino and GCP in this beginner tutorial!

December 2, 2019

by Francesco Azzola

· 37,611 Views · 5 Likes

How Will AI Impact Machine Design?

In tis article, explore some of the ways that AI will impact machine design.

December 2, 2019

by Megan Nichols

· 5,079 Views · 3 Likes

The Complete Apache Spark Collection [Tutorials and Articles]

We've compiled our best tutorials and articles on one of the most popular analytics engines for data processing, Apache Spark.

December 2, 2019

by Peter Connelly

· 57,837 Views · 27 Likes

Eye Disease Detection Using TensorFlow and Azure's CustomVision.ai

Explore an AI-based system that uses the Azure Cognitive Services CustomVision tool to predict the probability of the existence of eye diseases.

November 29, 2019

by Raghu N T

· 7,209 Views · 2 Likes

Kafka Administration and Monitoring UI Tools

In this article, we review three administrative and monitoring UI tools for Kafka, including Kafka Tool, Kafka Manager, and Kafdrop.

November 28, 2019

by Guy Shilo

· 128,858 Views · 9 Likes

How to Do a Snowflake Query Pushdown in Talend

In this article, see how Talend leverages Snowflake query pushdown via ELT.

November 27, 2019

by Rekha Sree

· 15,588 Views · 2 Likes

The Latest Big Data Topics