Big Data Resources

How To Design Reliable IIoT Architecture

Refining your IIoT design is a key part of building strong cybersecurity resilience in the network architecture. Here's how to add security to every layer.

May 18, 2023

by Emily Newton

· 3,528 Views · 2 Likes

Why `fsync()`: Losing Unsynced Data on a Single Node Leads to Global Data Loss

Regardless of the replication mechanism, you must fsync() your data to prevent global data loss in non-Byzantine protocols.

May 18, 2023

by Denis Rystsov

· 2,472 Views · 1 Like

Setting up Apache Pinot on Kubernetes in Under 15 Minutes

Learn how to install Pinot Control Plane on Kubernetes, configure your first Pinot cluster, and dive into the control plane features.

May 16, 2023

by AdheipSingh Sadhrao

· 5,492 Views · 2 Likes

Improve Your Data Solution Efficiency With Stream Processing

Today's data solutions—handling myriad data sources and massive data volume—are expensive. Stream processing reduces costs and brings real-time scalability.

May 16, 2023

by Alvin Lee

CORE

· 1,920 Views · 1 Like

Explainable AI: Making the Black Box Transparent

Explainable AI (XAI) has been gaining popularity among tech enthusiasts, data scientists, and software engineers in a world where AI is becoming more prevalent.

May 16, 2023

by Yifei Wang

CORE

· 46,433 Views · 6 Likes

Sixty ChatGPT Prompts for Scrum Masters and Product Owners

A prompt engineering guide covering the basics, services to enhance your prompts, and how to use ChatGPT to generate prompts. (Yub, that works, too.)

May 15, 2023

by Stefan Wolpers

CORE

· 3,550 Views · 1 Like

GPT3.5-Turbo Versus GPT4

We tested GPT3.5-turbo against GPT4 in our website chatbot, and here are the results. TL-DR? GPT4 is better but not worth it.

May 15, 2023

by Thomas Hansen

CORE

· 2,315 Views · 3 Likes

Global Supply Chain With Kafka and IoT

Transforming global supply chain with data streaming and IoT for end-to-end visibility and decision-making in real-time at BMW, Bosch, and Walmart.

May 12, 2023

by Kai Wähner

CORE

· 6,241 Views · 2 Likes

Enriching Kafka Applications With Contextual Data

Kafka is great for event streaming architectures, continuous data integration (ETL), and messaging systems of record (database). Learn how to enhance your Kafka applications.

May 12, 2023

by Fawaz Ghali, PhD

CORE

· 6,677 Views · 4 Likes

Non-Volatile Memory

In this article, we will explore the various forms of NVM, their advantages, limitations, and their potential applications.

May 11, 2023

by Aditya Bhuyan

· 3,004 Views · 2 Likes

A Deep Dive Into the Differences Between Kafka and Pulsar

Compare Apache Kafka and Pulsar, highlighting unique features and core distinctions. It aims to provide insight into mechanisms and inform decision-making.

May 11, 2023

by Teng Fu

· 8,036 Views · 8 Likes

Harnessing the Power of MQTT for the Future of IoT

As the use of MQTT in IoT is growing tremendously, we can anticipate seven developing trends in MQTT technology.

May 11, 2023

by Umar Nabi

· 5,197 Views · 2 Likes

Have ChatGPT Scrape Your Website

A lot of people want to have ChatGPT scrape their website. In this article, I will explain how our ChatGPT website scraper works.

May 10, 2023

by Thomas Hansen

CORE

· 2,941 Views · 3 Likes

Developing Metadata-Driven Data Engineering Pipelines Using Apache Spark and Python Dictionary

This article will discuss metadata-driven programming techniques to make our PySpark code more flexible, maintainable, and reusable.

May 10, 2023

by Amlan Patnaik

· 4,452 Views · 4 Likes

Top Data Science Courses to Consider

In this article, we will read about the top 7 Data Science Certification Courses along with their price, mode of education course curriculum, and other basic stuff.

May 9, 2023

by Sarang S Babu

· 2,147 Views · 1 Like

Ways To Stop and Resume Your Kafka Producer/Consumer at Run-Time

In this blog, the reader will learn how to stop and resume a Kafka client or producer at runtime using two distinct methods.

May 9, 2023

by Ashok Gudise

· 5,176 Views · 1 Like

Understanding Kafka and Event-Driven Architecture [Video Tutorials]

Explore Kafka and Event Driven Architecture, covering key concepts such as consumer groups, topic partitions, replication, and cluster workings.

May 9, 2023

by Ram N

· 3,311 Views · 2 Likes

How To Boost AI Model Training With a Distributed Storage System

Learn why distributed storage is important in the AI field and how JuiceFS, an open-source, high-performance distributed file system, can help boost model training.

May 8, 2023

by Changjian Gao

· 3,435 Views · 2 Likes

Preventing Data Loss With Kafka Listeners in Spring Boot

In this article, we'll look at how to build Kafka listeners with Spring Boot and how to use Kafka's acknowledgment mechanisms.

May 8, 2023

by Viacheslav Shago

· 20,382 Views · 5 Likes

Mastering Data Integration for Seamless Cloud Migration Approaches Benefits and Challenges

This article delves into various data integration methodologies for cloud migration and scrutinizes the merits and demerits of each approach.

May 8, 2023

by srinivas Venkata

· 4,053 Views · 1 Like

The Latest Big Data Topics