Big Data Resources

Control Humidity With a Raspberry Pi and IoT Devices

In this post we take a look at how you can control the humidity in a room using a Raspberry Pi, a switch, and a sensor with a dash of JavaScript and Python.

April 4, 2017

by Gonzalo Ayuso

· 11,915 Views · 5 Likes

Apache Spark: Setting Up a Cluster on AWS

You can augment and enhance Apache Spark clusters using Amazon EC2's computing resources. Find out how to set up clusters and run master and slave daemons on one node.

April 3, 2017

by Jay Sridhar

· 21,634 Views · 8 Likes

Encrypting and Authenticating MQTT Traffic With NGINX Plus

In addition to load balancing, NGINX Plus can help offload authentication and encryption duties, particularly along the TLS front.

April 2, 2017

by Liam Crilly

· 10,109 Views · 4 Likes

5 Data Tasks That Keep Data Engineers Awake at Night

When it comes to integrating and managing data, there are quite a few tasks that are downright tedious. Data engineering is a tough job, but somebody's gotta do it!

March 30, 2017

by Yaniv Leven

· 7,517 Views · 6 Likes

MQTT Load Balancing and Session Persistence With NGINX Plus

As the MQTT protocol grows more popular for IoT solutions, it's important to consider performance bottlenecks. That's where NGINX Plus comes in.

March 30, 2017

by Liam Crilly

· 11,753 Views · 2 Likes

Using Grafana on Top of Elasticsearch

Grafana is worth exploring because it’s extremely easy to set up and, from a mere usability perspective, Grafana has a much nicer UI and UX.

March 27, 2017

by Daniel Berman

· 31,025 Views · 6 Likes

Column Store Database Benchmarks: MariaDB ColumnStore vs. ClickHouse vs. Apache Spark

An in-depth comparison looking at the query performance of MariaDB ColumnStore, ClickHouse, and Apache Spark.

March 18, 2017

by Alexander Rubin

· 11,370 Views · 2 Likes

SQL or NoSQL, That Is The Question!

It's not about SQL vs. NoSQL, but rather when to use each option. This guide walks through the benefits of relational and non-relational databases as well as use cases.

March 16, 2017

by Alon Brody

· 15,867 Views · 21 Likes

MVC CRUD Actions Using KnockoutJS

In this post, we'll walk you through a tutorial on how to create an MVC CRUD application using KnockoutJS in conjunction with an SQL database and Visual Studio.

March 13, 2017

by Sibeesh Venu

· 22,771 Views · 10 Likes

IoT Security Woes

Securing cloud-based IoT is hard; there is a combination of local software, cloud, and hardware solutions to deal with. Let's take a look at a possible solution.

March 9, 2017

by Anatoly Lebedev

· 3,153 Views · 1 Like

Backup, Restore, and Disaster Recovery in Hadoop

Test your backup and restore procedures right after you install your cluster. Backups are a waste of time and space if they don't work and you can't get your data back!

March 3, 2017

by Tim Spann

CORE

· 28,651 Views · 5 Likes

How to Improve Hive Query Performance With Hadoop

Apache Hive is a powerful tool for analyzing data. It's very important that you know how to improve the performance of query when you are processing petabytes of data.

March 3, 2017

by Jitendra Bafna

CORE

· 84,645 Views · 9 Likes

HBase Compaction and Data Locality With Hadoop

Compaction is a process by which HBase cleans itself, and data locality is a solution to data not being available to Mapper.

March 2, 2017

by Jitendra Bafna

CORE

· 30,487 Views · 5 Likes

Data Modelling Topologies of a Graph Database

The associative data graph database model is still a heavy hitter, stacking up well against property graphs and triples/quadruples. Expect a comeback.

March 1, 2017

by Athanassios I. Hatzis, PhD

· 12,891 Views · 9 Likes

Big Data Solves Real-World Problems

Working smartly with Big Data results in improved customer and patient experiences across a variety of different industries.

February 24, 2017

by Tom Smith

CORE

· 10,627 Views · 3 Likes

Getting Started With Apache Camel and the Internet of Things

If you're planning to invest in connected devices, make sure your middleware and communications are up to snuff. In this case, we look a how to mix Camel with a Pi.

February 20, 2017

by Joseph S. Butler

· 8,819 Views · 10 Likes

A Disk-Based Collection in Java

Feeling constrained by your heap? Want to store more elements in a collection than your memory can hold? Check out this project designed to handle big collections.

February 17, 2017

by Reinout Korbee

· 23,585 Views · 6 Likes

A Look at ClickHouse: A New Open Source Columnar Database

ClickHouse is an open source columnar database that promises fast scans that can be used for real-time queries. See how it works, complete with benchmarks against Spark.

Updated February 17, 2017

by Alexander Rubin

· 18,351 Views · 1 Like

5 Data Storage Solutions for Better Log Management

Depending on how much data you have from saving time-based events, you may want to choose one storage solution over the other.

February 16, 2017

by Vladislav Chernov

· 94,903 Views · 5 Likes

Introducing the Thingsboard Open Source IoT Gateway

Thingsboard is hard at work on a new open source gateway that should allow devs from hobbyists to IIoT specialists to connect to devices regardless of protocol.

February 12, 2017

by Andrew Shvayka

· 16,128 Views · 7 Likes

The Latest Big Data Topics