Big Data Resources

Identifying Duplicate Files in AWS S3 With Apache Spark

Using Spark, you can identify duplicate files in your S3 storage by calculating checksums. It's a quick, easy way to ensure you aren't carrying extra weight.

June 12, 2017

by Nikhil Bhide

· 16,547 Views · 9 Likes

Predictive Analytics and Machine Learning Explained Through Dog Memes

The way that memes go viral is very similar to the way that Machine Learning and predictive analytics work. How in the world could this be?!

June 4, 2017

by Gur Tirosh

· 8,251 Views · 1 Like

Apache Flume: Regex Filtering

There's so much precious data out there that it can be difficult for humans to get meaning out of it sometimes. Apache Flume to the rescue!

Updated June 1, 2017

by Nikhil Bhide

· 13,478 Views · 13 Likes

Advanced Analytics in Order to Cash Process

In this article, we'll take a look at the cases where advanced analytics can be implemented in an Order to Cash (O2C) process, going over potential use cases for anomaly detection, streaming analytics, and recommendation engines.

June 1, 2017

by Sachit Das

· 14,747 Views · 6 Likes

How the Internet of Things Will Affect Database Management

The Internet of Things poses unprecedented challenges for database administrators in terms of scalability, flexibility, and connectivity.

May 31, 2017

by Darren Perucci

· 6,360 Views · 4 Likes

Apache Flume to Multiplex or Replicate Big Data

The solution from Apache Flume to address multiplexing and replicating requirements is really elegant and very easy to set up.

May 30, 2017

by Nikhil Bhide

· 10,207 Views · 5 Likes

5 Essential Components of Data Strategy

PII and personal data isn't limited to reporting and data delivery; it needs to be considered throughout the integrated data strategy.

May 30, 2017

by Tom Smith

CORE

· 5,549 Views · 4 Likes

Strengths and Weaknesses of IoT Communication Patterns

There are four main communication patterns in IoT: Telemetry, Inquiry, Command, and Notification. Learn about them and which communication protocols work best for them.

May 28, 2017

by Paolo Patierno

· 22,717 Views · 9 Likes

Using ElasticSearch for Big Data Analysis

Learn how leveraging ElasticSearch to build the data infrastructure makes it easier to linearly scale as new data nodes are added in the future.

May 28, 2017

by Rohit Akiwatkar

· 29,546 Views · 9 Likes

ElasticSearch: Advantages, Case Studies, and Stats

ElasticSearch is an open-source, broadly distributable, readily scalable, enterprise-grade search engine. Look more closely into what it is, its advantages, and stats.

May 26, 2017

by Ekaterina Novoseltseva

CORE

· 32,553 Views · 15 Likes

Database Scaling Made Simple

For every problem technology poses, it offers many possible solutions. Here's how to take much of the sting out of scaling databases.

May 24, 2017

by Darren Perucci

· 6,721 Views · 2 Likes

Using TinkerBoard With TensorFlow and Python

In this post, we use ASUS' new embedded platform for Deep Learning and IoT with TensorFlow and Python on this RPI form factor device.

May 24, 2017

by Tim Spann

CORE

· 15,271 Views · 4 Likes

Code Analyzer for Apache Spark

The new Code Analyze for Apache Spark promotes DevOps for Big Data, helping to tear down the wall between developers and operations.

May 23, 2017

by Tom Smith

CORE

· 7,443 Views · 3 Likes

The Parrot Sequoia API Is Nice and Simple for IoT

For drone developers, it's hard to beat the Parrot Sequoia API in terms of simplicity and ease of use. Check out the devices paths and see how you can get started.

May 19, 2017

by Kin Lane

· 5,600 Views · 3 Likes

Installing and Running Kafka on an AWS Instance

This tutorial will help you install and start the latest version of Kafka on the EC2 Linux instance, including starting a Zookeeper service.

Updated May 13, 2017

by Sahil Sawhney

· 41,675 Views · 4 Likes

The Top 20 Companies Enabling Predictive Maintenance

This research report serves as a 'State of Predictive Maintenance,' considering what is and isn't predictive maintenance and how organizations are pursuing the tech.

Updated May 11, 2017

by Zana Diaz

· 16,492 Views

10 Techniques to Boost Your Data Modeling

Data modeling is a crucial process in most any business. In this post, we take a look at ten techniques that can help improve your data modeling skills.

May 9, 2017

by Shelby Blitz

· 7,358 Views · 1 Like

Relevant Search Leveraging Knowledge Graphs with Neo4j: Part 2

This article continues an in-depth look at approaching the search feature using knowledge graphs and Neo4j for accurate, relevant results.

May 9, 2017

by Alessandro Negro

· 5,541 Views · 5 Likes

A Comparison of SQL and NoSQL to Simplify Your Database Decision

When you implement ETL processes, you must decide how to structure your data and what technologies to use. To make an informed decision, let’s start from the basics.

May 7, 2017

by Laura Czajkowski

· 20,474 Views · 6 Likes

IoT Testing for the BLE Protocol

Bluetooth Low Energy is a great protocol for IoT devices that rely on limited power supplies. However, testing devices at scale is a problem, but one we'll try to solve.

May 3, 2017

by Uzi Eilon

· 10,637 Views

The Latest Big Data Topics