Big Data Resources

MySQL to DynamoDB: Build a Streaming Data Pipeline on AWS Using Kafka

Use change data capture with MSK Connect to sync data between Aurora MySQL and DynamoDB.

June 29, 2022

by Abhishek Gupta

CORE

· 35,863 Views · 3 Likes

Reactive Kafka With Streaming in Spring Boot

How to integrate Spring Boot and Kafka with Streams in a reactive solution.

June 28, 2022

by Sven Loesekann

· 18,051 Views · 3 Likes

Develop With Oracle Transactional Event Queues

Develop microservices with Oracle Transactional Event Queues, which are compatible with Kafka, but much more.

June 28, 2022

by Paul Parkinson

· 9,226 Views · 3 Likes

Is DataOps the Future of the Modern Data Stack?

As data needs scale, teams need to start prioritizing reliability. Here’s why DataOps might be the answer—and how you can get started.

June 27, 2022

by Glen Willis

· 8,454 Views · 4 Likes

Data Statistics and Analysis With Java and Python

How to analyze tabular data using Java Streams and Python Pandas. As well as compare how they perform and scale for large amounts of data.

Updated June 27, 2022

by Manu Barriola

· 9,645 Views · 6 Likes

The Importance of Semantics for Data Lakehouses

Without a semantic layer, data lakes become data swamps. With semantics, users access a host of benefits from the data lake architecture.

June 27, 2022

by Jans Aasman

· 7,991 Views · 2 Likes

Getting Started With RSocket Kotlin

Set up an RSocket client and server with some help from Kotlin and Ktor.

June 25, 2022

by Dan Newton

· 7,036 Views · 1 Like

What Emerging Technologies Make Data Centers More Energy Efficient?

Emerging technologies are remarkably helpful at creating more energy-efficient data centers, which are notorious power hogs of the modern age.

June 23, 2022

by Emily Newton

· 7,329 Views · 1 Like

Streaming Solution for Better Transparency

For streaming analytics, there is a bounded timeline during which action must be taken to control process or asset parameters.

Updated June 22, 2022

by Akshat Thakar

· 4,812 Views · 1 Like

Legacy Modernization and Hybrid Cloud with Kafka in Healthcare

Legacy Modernization and Hybrid Multi-Cloud with Kafka in Healthcare, including examples: Optum / UnitedHealth Group, Centene, and Bayer.

June 22, 2022

by Kai Wähner

CORE

· 4,846 Views · 3 Likes

Classification of Neural Networks in TensorFlow

The primary aim of the TensorFlow algorithm in a neural network is to solve problems with high complexity.

June 22, 2022

by Mahesh Sharma

· 8,872 Views · 5 Likes

Data Science Project Folder Structure

One of the more annoying parts of any coding project can be setting up your environment. In this post, we look at some ways to organize your data science project.

Updated June 21, 2022

by Ajitesh Kumar

· 27,907 Views · 5 Likes

What Is Kafka? Everything You Need to Know

Kafka is often used in real-time streaming data architectures to provide real-time analytics. Learn its specific use cases and why it's exploding in popularity.

Updated June 21, 2022

by Jean-Paul Azar

· 310,533 Views · 103 Likes

Build a Data Pipeline on AWS With Kafka, Kafka Connect, and DynamoDB

This is a two-part series that provides a step-by-step walkthrough of data pipelines. In this post, learn how to integrate DynamoDB with MSK and MSK Connect.

June 21, 2022

by Abhishek Gupta

CORE

· 41,335 Views · 3 Likes

Streaming ETL with Apache Kafka in the Healthcare Industry

Streaming ETL with Apache Kafka, Connect, Streams, and ksqlDB in Healthcare, including examples: Babylon Health and Bayer.

June 18, 2022

by Kai Wähner

CORE

· 5,609 Views · 3 Likes

Five Tips to Fasten Your Skewed Joins in Apache Spark

Read this exclusive story to know five different techniques to address performance drops from Skewed Joins in various situations.

June 18, 2022

by Ajay Gupta

· 6,796 Views · 2 Likes

Change Data Capture to Accelerate Real-Time Analytics

How retailers can deploy real-time analytics for near-instant inventory/supply chain management, better customer experience, and product recommendations.

Updated June 16, 2022

by Michael Bogan

CORE

· 5,035 Views · 3 Likes

What Is Data Analytics? Understanding Data Analytics Techniques

Data analytics is a process of analyzing raw data to derive meaningful insights. Discover the peculiarities of data analytics and make smart decisions.

June 16, 2022

by Aastha Sinha

· 8,961 Views · 4 Likes