Big Data Resources

Lambda Architecture: How to Build a Big Data Pipeline, Part 2 [Video]

We walk you through how to provide a robust system that is fault-tolerant against hardware failures and human mistakes using the Lambda architecture approach.

April 16, 2019

by Alexsandro Souza

· 9,411 Views · 4 Likes

Google Colab: Create Predictive Models in No Time

In this article, we will see how we can use this amazing cloud-based platform and use a Random Forest model to predict customer churn in less than 200 lines of code.

April 12, 2019

by Sunil Kappal

· 15,121 Views · 2 Likes

Entity Framework Core 3.0 and SQL Server Performance Optimization, Part 1: Parameters Sniffing

Implement SQL Server performance optimization using the Entity Framework Core and parameter sniffing.

April 12, 2019

by Bassam Alugili

· 50,647 Views · 7 Likes

Ingesting Data From Files With Apache Spark, Part 1

In this post, a data expert teaches us how to take in large data sets using Apache Spark.

April 8, 2019

by Jean-Georges Perrin

· 15,302 Views · 7 Likes

Logging HTTP Request Metadata With Nginx, Lua, Logstash, and Elasticsearch

This post shows how to use Nginx, Lua, Logstash, and Elasticsearch to log, store, and analyze HTTP request and response metadata.

April 3, 2019

by smotti

· 20,352 Views · 3 Likes

Advanced XML Processing With Apache NiFi 1.9.1

In this post, we'll be using Apache NiFi to simply process very complex XML and RSS data files.

April 2, 2019

by Tim Spann

CORE

· 19,455 Views · 7 Likes

Spark Streaming vs. Structured Streaming

In this post, we compare these two popular open source data platforms and the scenarios where each work best.

March 29, 2019

by Anuj Saxena

· 74,667 Views · 5 Likes

Performance of Pipeline Architecture: The Impact of the Number of Workers

The number of workers in a pipe-line architecture can drastically impact performance.

March 27, 2019

by Nihla Akram

· 14,057 Views · 8 Likes

Top 5 Enterprise ETL Tools

If you're looking to adopt a new tools to help perform ETL process, check out this list of five options and see which one fits your needs.

March 25, 2019

by Vitaliy Samofal

· 39,029 Views · 10 Likes

Building Open Source Google Analytics from Scratch

Check out this article that shows you how to build your own analytics platform with AWS and Cube.js.

March 25, 2019

by Pavel Tiunov

· 16,572 Views · 8 Likes

Elasticsearch on Google Cloud Platform

Take a look at this simple and quick tutorial about downloading and connecting Elasticsearch to your GCP instance.

Updated March 20, 2019

by Sameer Chandra

· 19,393 Views · 3 Likes

How to Effectively Use ExecutorService in Kafka Consumers

Apache Kakfa is one of the most popular open source tools for working with big data and streaming data. Learn a little bit more about Kakfa with this tutorial.

March 19, 2019

by Prasanth Nair

· 43,374 Views · 9 Likes