Big Data Resources

MongoDB and Data Streaming: Implementing a MongoDB Kafka Consumer

This article introduces Apache Kafka and then illustrates how to use MongoDB as a source and a destination for streamed data.

March 12, 2018

by Andrew Morgan

· 35,713 Views · 17 Likes

Apache Spark: 3 Reasons Why You Should Not Use RDDs

When it comes to building an enterprise-grade app in Spark, RDD isn't a good choice. Why? And if RDD is not a good choice, then what should we use?

March 8, 2018

by Himanshu Gupta

· 45,640 Views · 11 Likes

Deploying Elasticsearch 6.x on Azure With Terraform

Today, we will be looking at deploying a full Elasticsearch cluster using best practices end-to-end on Microsoft Azure.

March 6, 2018

by Itamar Syn-hershko

· 8,823 Views · 3 Likes

Spring Cloud Stream With Kafka

In this post, we take a look at how you can build a real-time streaming microservices application by using Spring Cloud Stream and Kafka.

March 6, 2018

by David Kiss

· 116,942 Views · 55 Likes

Logging With the Elastic Stack

It's imperative to have a system that can analyze large amounts of logs and present a singular view. Centralized logging provided by the Elastic Stack is a step in the right direction.

March 5, 2018

by Vaibhav Raizada

CORE

· 13,541 Views · 13 Likes

Kubernetes Monitoring: Best Practices, Methods, and Existing Solutions

Kubernetes handles containers in several computers, removing the complexity of handling distributed processing. But what's the best way to perform Kubernetes monitoring?

Updated February 23, 2018

by Daniel Berman

· 18,171 Views · 4 Likes

Simple Java Program to Append to a File in HDFS

Get the code and instructions needed to build a Java program to append to a file in HDFS, using Maven as the build tool.

February 23, 2018

by Simarpreet Kaur Monga

· 17,539 Views · 4 Likes

The Tech Files: Pushing Jupyter Notebooks to Production

Learn how one company embarked upon their data science journey to incorporate recommendation algorithms into their client-facing product.

February 21, 2018

by Teja Srivastasa

· 19,299 Views · 4 Likes

How to Be a Master in Software Development

Here are some of the subjects and general topics that you should familiarize yourself with to achieve mastery in software development.

February 20, 2018

by Alexsandro Souza

· 11,943 Views · 35 Likes

Introduction to Basic Statistics Measurements

Learn about the most common statistical methods that can help make data-driven decisions and understand the fundamental concepts of statistics in a jargon-free way.

February 16, 2018

by Sunil Kappal

· 11,797 Views · 10 Likes

Apache Spark and Apache NiFi Integration (Part 2 of 2)

Let's finish off our journey of integrating Apache Spark and Apache NiFi to cover both data ingestion and running Apache Spark jobs.

February 15, 2018

by Tim Spann

CORE

· 29,546 Views · 7 Likes

What's The Most Important Part of the Open Source Ecosystem?

The community of users and contributors who share their knowledge, experience, and insights to improve collaboration, innovation, quality, and security.

February 15, 2018

by Tom Smith

CORE

· 6,928 Views · 5 Likes

Azure SQL Database vs. Azure SQL Data Warehouse

Let's look at two seemingly similar products from Microsoft: Azure SQL Database and Azure SQL Data Warehouse. We'll see how they compare and when to use which one.

February 15, 2018

by Barry Luijbregts

· 17,280 Views · 4 Likes

Machine Learning With Decision Trees

This paper shows you how to get started with machine learning by applying decision trees using Python on an established dataset.

February 14, 2018

by Alan Brown

· 13,167 Views · 6 Likes

Develop Custom Ensemble Models Using Caret in R

Here we review some different ways to create ensemble learning models and compare the accuracy of their results, seeing how each functions better as a composite.

February 13, 2018

by Sibanjan Das

CORE

· 16,118 Views · 7 Likes

Scala vs. Python for Apache Spark

When using Apache Spark for cluster computing, you'll need to choose your language. Scala has its advantages, but see why Python is catching up fast.

February 13, 2018

by Tim Spann

CORE

· 31,577 Views · 13 Likes

A Beats Tutorial: Getting Started

Get acquainted with the E:L stack and working with the different beats: Filebeat, Packetbeat, Metricbeat, Auditbeat, Heartbeat, and Winlogbeat.

February 12, 2018

by Daniel Berman

· 14,249 Views · 6 Likes

MQTT + Apache Kafka + InfluxDB + SQL = IoT Harmony

This is a deep dive into real-time and time series IoT data using MQTT, Apache Kafka, InfluxDB, Lenses, and a handful of SQL code.

February 11, 2018

by Stefan Bocutiu

· 28,751 Views · 18 Likes

Real-World Problems Being Solved By Open Source

Learn about the real-world problems open source is tackling - pretty much everything, since 90 to 95% of all apps are built with open source software.

February 10, 2018

by Tom Smith

CORE

· 11,317 Views · 2 Likes

Java High-Level REST Client: Elasticsearch

Learn about using a Java high-level REST client with Elasticsearch to use API-specific methods that accept request objects as an argument and return response objects.

February 7, 2018

by Divya Dua

· 82,960 Views · 4 Likes

The Latest Big Data Topics