Big Data Resources

Feeling constrained by your heap? Want to store more elements in a collection than your memory can hold? Check out this project designed to handle big collections.

February 17, 2017

by Reinout Korbee

· 23,370 Views · 6 Likes

A Look at ClickHouse: A New Open Source Columnar Database

ClickHouse is an open source columnar database that promises fast scans that can be used for real-time queries. See how it works, complete with benchmarks against Spark.

Updated February 17, 2017

by Alexander Rubin

· 17,720 Views · 1 Like

5 Data Storage Solutions for Better Log Management

Depending on how much data you have from saving time-based events, you may want to choose one storage solution over the other.

February 16, 2017

by Vladislav Chernov

· 94,316 Views · 5 Likes

Introducing the Thingsboard Open Source IoT Gateway

Thingsboard is hard at work on a new open source gateway that should allow devs from hobbyists to IIoT specialists to connect to devices regardless of protocol.

February 12, 2017

by Andrew Shvayka

· 15,983 Views · 7 Likes

CART and Random Forests for Practitioners

Both CART and Random Forests help data scientists better understand algorithms and work with dirty data. However, they still have some key differences.

February 10, 2017

by Sibanjan Das

CORE

· 15,742 Views · 4 Likes

TensorFlow on the Edge, Part 1 of 5

Running TensorFlow on the Edge is now possible, what, why and how?

February 6, 2017

by Tim Spann

CORE

· 18,845 Views · 6 Likes

How Is Facebook Deploying Big Data?

How Facebook harnessed Big Data by mastering open source tools, and in some cases developing their own.

Updated February 6, 2017

by Shravani Chakraborty

· 31,557 Views · 7 Likes

How Data Lakes Work

How data lakes can help eliminate costs and time involved in working with large amounts of data.

January 31, 2017

by Ben Sharma

· 11,652 Views · 7 Likes

Prediction Zone: Using R With Shiny

Sibanjan Das offers up a tutorial for building a web-based cluster and prediction analysis application through using R with the open source Shiny framework. Oh yeah, and he embedded the app directly into this DZone article... shine on you crazy data scientist.

January 30, 2017

by Sibanjan Das

CORE

· 19,228 Views · 9 Likes

A Framework for Chatbot Evaluation

Chatbots continue to work their way into ever-more solutions, but how should we evaluate their effectiveness? In this post we take a look at a potential framework for doing just that.

January 27, 2017

by Tony Russell-rose

· 7,634 Views

Scheduling Statistics Maintenance in Azure SQL Data Warehouse

You can leverage your Azure SQL Data Warehouse to automate some of your maintenance. Creating a Runbook will let you schedule to your hearts content.

January 23, 2017

by Grant Fritchey

· 3,975 Views · 2 Likes

Running Microservices on Top of In-Memory Data Grid: Part II

Let's look into the Apache Ignite Cluster Layer, a GitHub project that includes the basic building blocks needed to implement a proposed microservices-based architecture.

January 18, 2017

by Denis Magda

CORE

· 11,841 Views · 7 Likes

The First Steps to Analyzing Data in R

What steps should be taken when you want to analyze a data set in R? Enjoy these first steps to prepare your data for a variety of use cases.

January 17, 2017

by Sibanjan Das

CORE

· 20,466 Views · 8 Likes

The Battle of the Crawlers: Apache Nutch vs. StormCrawler

This post has everything you need to know about the efficiency of Apache Nutch and StormCrawler. Read on to find out more on the benchmark analysis and conclusion drawn from the study.

January 10, 2017

by Julien Nioche

· 22,674 Views · 2 Likes

Learning Lessons From the Zenith Space Phone: An Early Example of IoT?

A look back at the tech of the 1980s reveals an important lesson: Just because you can connect devices doesn't mean you should. That has implications for IoT.

January 10, 2017

by John Vester

CORE

· 22,752 Views · 1 Like

Validating Data in the Data Lake

How do you design your data lake architecture and what functionality do you need to validate the data in your data lake? Learn about it right now!

Updated January 9, 2017

by Tony Fisher

· 8,026 Views · 4 Likes

Build Your Own Digital Piano

If you want to jam on a piano but don't have a keyboard, don't worry, you can make one yourself. This guide uses a NodeMcu and Ubidots to bring a piano to life.

January 9, 2017

by Maria Hernandez

· 7,539 Views · 2 Likes

Kafka Avro Scala Example

Learn how to write and read messages in Avro format to/from Kafka. Read on to understand how to produce messages encoded with Avro, how to send them into Kafka, and how to consume with consumer and finally how to decode them.

January 6, 2017

by Sushil Kumar Singh

· 423,687 Views · 11 Likes

Using Kafka With JUnit

The Spring Kafka project provides a way to use Kafka in tests by providing an embedded version of Kafka that is easily set up and torn down.

January 2, 2017

by Biju Kunjummen

· 51,599 Views · 3 Likes

13 Software Failures of 2016 That Testing Could Have Prevented

As businesses continue to migrate to digital platforms, it becomes absolutely critical to conduct rigorous software testing before the launching of a product.

January 2, 2017

by Hiren Tanna

· 26,614 Views · 2 Likes

The Latest Big Data Topics