Big Data Resources

Comparing Akka Streams, Kafka Streams and Spark Streaming

We'll discuss the pros and cons of the frameworks and which to use when.

Updated May 9, 2022

by Daniel Ciocirlan

· 20,266 Views · 3 Likes

OPC-UA, MQTT, and Apache Kafka: The Trinity of Data Streaming in IoT

Learn about Apache Kafka, MQTT, and OPC-UA for data streaming in IoT and Industry 4.0, including architectures, comparisons, and examples from Audi and BMW.

May 9, 2022

by Kai Wähner

CORE

· 10,433 Views · 10 Likes

Querying Kafka Topics Using Presto

In this article, we will discuss how Presto can be used to query Kafka topics with a step-by-step process to connect Kafka and Presto together for MacOS.

May 5, 2022

by Praful Khandelwal

· 4,974 Views · 5 Likes

Best Practices in Data Discovery: Building Search for a Data Discovery Platform

Explore major components of a user-friendly UI and look into specific measures that can be employed to increase the quality of search in the Open Data Discovery Platform.

May 4, 2022

by Aleksei Koziurov

· 5,302 Views · 7 Likes

Testing Schema Registry: Spring Boot and Apache Kafka With JSON Schema

Learn how to write tests for the Schema Registry for Apache Kafka using Spring Boot, MockSchemaRegistryClient, and EmbeddedKafka with JSON Schema.

May 4, 2022

by Mukut Bhattacharjee

· 13,043 Views · 4 Likes

The Rise of Cybercrime – An Overview

The rate of cybercrimes is increasing every year, and it is expected to reach its highest next year.

May 3, 2022

by Naimisha Raj

· 6,202 Views · 3 Likes

Building an AutoML Application

Learn about AutoML applications. Plus, learn how to get rid of the pain points of developing the model and get to the core of problem-solving.

Updated April 28, 2022

by Neeraj Agarwal

· 2,793 Views · 2 Likes

Spinning Your Workflows With Cadence

Open-source Cadence was developed by Uber and based on the AWS SWF (Simple Workflow Service). It's designed to be highly fault-tolerant and scalable.

April 28, 2022

by Paul Brebner

· 5,473 Views · 4 Likes

Compare Benefits of CPUs, GPUs, and FPGAs for Different oneAPI Compute Workloads

In this article, compare the architectural differences between CPUs, GPUs, and FPGAs, examine library support differences, and more.

April 26, 2022

by Chryste Sullivan

· 4,303 Views · 3 Likes

Software AI Accelerators: AI Performance Boost for Free

What is a “software AI accelerator” and how does it compare to a hardware AI accelerator?

April 26, 2022

by Chryste Sullivan

· 4,908 Views · 2 Likes

A Quickstart Guide to Apache Kafka

This guide is a quick walkthrough of installing Apache Kafka on your machine as well as sending and receiving messages.

Updated April 26, 2022

by Prashant Verma

· 5,359 Views · 6 Likes

GNN Demo Using PyTorch Lightning and PyTorch Geometric

A Graph Neural Networks (GNN) benchmark demonstration using PyTorch Lightning and PyTorch Geometric.

April 26, 2022

by Kevin Vu

· 3,770 Views · 2 Likes

6 Tips For Securing IoT Devices

With more devices entering our homes and workplaces, implementing and updating security measures should be a top priority for the coming years in IoT.

April 25, 2022

by Carsten Rhod Gregersen

· 10,119 Views · 4 Likes

The Ultimate Guide to Data Collection in Data Science

Data collection is assembling data while measuring and analyzing different types of information with the help of specific proven techniques.

April 22, 2022

by Evgenia Kuzmenko

· 6,667 Views · 2 Likes

How Does Kafka Perform When You Need Low Latency?

In this article, we take a look at various benchmarks testing higher throughputs with end-to-end latencies between 2.5 and 30 milliseconds.

April 22, 2022

by Peter Lawrey

· 4,058 Views · 8 Likes

Pioneering Education, BioTech, and Blockchain [Podcast]

A DZone Zone Leader interviews several startups to see how their developers are shaping the future across several industries.

Updated April 22, 2022

by Chris Ward

CORE

· 6,150 Views · 4 Likes

Publish Keycloak Events to Kafka With a Custom SPI

Learn how to write a Keycloak custom extension and publish events to Apache Kafka. Use the consumer application to analyze the service account usage.

April 22, 2022

by Abhishek Koserwal

· 8,324 Views · 8 Likes

How To Integrate Event Streaming Into Your Applications

Read here to get started with Fauna's event streaming that simplifies listening for real-time changes in your database at document and collection levels.

April 22, 2022

by Shadid Haque

· 3,970 Views · 3 Likes

Engineering Metrics Benchmarks: What Makes Elite Teams?

LinearB has analyzed 1,971 teams to enable developers to see how they compare to other big teams in the industry. Find out what they've learned

April 21, 2022

by Necco Ceresani

· 3,335 Views · 4 Likes

What Is a Data Reliability Engineer, and Do You Really Need One?

As data teams continue to specialize, a new role has emerged: the data reliability engineer. But what is it, and does your team even need one?

April 21, 2022

by Glen Willis

· 3,735 Views · 3 Likes

The Latest Big Data Topics