Big Data Resources

Evolution of Data Partitioning: Traditional vs. Modern Data Lakes

In this blog, we will be comparing data partitioning schemes in older data lakes to modern data lakes like Apache Iceberg.

October 5, 2023

by Karthik Penikalapati

· 3,883 Views · 6 Likes

Apache Kafka as Mission Critical Data Fabric for GenAI

Apache Kafka as real-time machine learning infrastructure for GenAI, chatbots, and large language models in mission-critical deployments.

October 5, 2023

by Kai Wähner

CORE

· 2,517 Views · 3 Likes

Adapting API Strategies to Dynamic AI Trend

AI is getting a lot of attention these days. This article explores what the AI trend means for those of us developing products using APIs.

October 5, 2023

by Bobur Umurzokov

· 3,270 Views · 4 Likes

Time-Series Forecasting With Recurrent Neural Networks

This article comprehensively guides time-series forecasting using Recurrent Neural Networks (RNNs) as well as the associated different aspects.

October 4, 2023

by Deepanshu Lulla

· 4,635 Views · 2 Likes

The Dark Side of Artificial Intelligence

This article explores the question: Should we be afraid of AI, or are the warnings from well-known personalities rather unfounded?

October 4, 2023

by Elmar Dott

CORE

· 1,969 Views · 3 Likes

Replicate Postgres Data to Kafka

This tutorial will teach you how to easily migrate data from a Postgres database to Apache Kafka using Airbyte open-source.

October 4, 2023

by John Lafleur

· 2,976 Views · 1 Like

Real-Time Analytics: All Data, Any Data, Any Scale, at Any Time

All data, any data, any scale, at any time: Learn why data pipelines need to embrace real-time data streams to harness the value of data as it is created.

October 3, 2023

by Tim Spann

CORE

· 6,720 Views · 6 Likes

The Evolution of Data Pipelines: ETL, ELT, and the Rise of Reverse ETL

Explore how the evolution of data pipelines in recent years requires the adaptation of organizations, teams, and engineers to use full potential of technology.

October 2, 2023

by Miguel Garcia

CORE

· 6,386 Views · 8 Likes

Unlocking Data Insights and Architecture: Data Warehouses, Lakes, and Lakehouses

Explore data management strategies and how they map to various selection criteria such as cost, data volume, data integration, and security and compliance.

October 2, 2023

by Ted Gooch

· 4,330 Views · 2 Likes

How to Debug an Unresponsive Elasticsearch Cluster

Master debug an unresponsive Elasticsearch cluster with our simple tutorial guide. Try this efficient solution for buggy or unstable Elasticsearch setups.

October 1, 2023

by Derric Gilling

CORE

· 6,029 Views · 3 Likes

Revolutionizing IoT With Digital Temperature Sensors

The impact of digital sensors on IoT development and provide insights for developers looking to integrate temperature monitoring into their projects.

September 29, 2023

by cecilia cheruto

· 3,783 Views · 1 Like

iQ Interactive: Cool Things for Developers on Couchbase Capella iQ

iQ is an AI-powered coding assistant that helps Couchbase developers learn, code, and debug faster and better. Read more!

September 29, 2023

by Keshav Murthy

CORE

· 2,427 Views · 2 Likes

The Stairway to Apache Kafka® Tiered Storage

Tiered Storage, a feature of Apache Kafka 3.6 which allows the offloading of data to object storage in the cloud, is a prime example of the power of open source.

September 28, 2023

by Matthew de Detrich

· 4,570 Views · 5 Likes

The API-Centric Revolution: Decoding Data Integration in the Age of Microservices and Cloud Computing

APIs are overtaking traditional ETL methods in data integration. Adopting an API-first model is now a strategic necessity for businesses.

September 27, 2023

by Andrea Arnold

· 3,337 Views · 3 Likes

Five Tools for Data Scientists to 10X their Productivity

AI tools can help data scientists maximize their productivity by automating mundane and recurring tasks. Find out more about how!

September 27, 2023

by Mirza Arique Alam

· 2,563 Views · 1 Like

The Future of Search: How ChatGPT, Voice Search, and Image Search Are Revolutionizing the Digital Landscape

Search Revolution: Chat GPT, Voice, and Image technologies are transforming how we search online, making it more natural, efficient, and inclusive.

September 26, 2023

by Manas Sadangi

CORE

· 2,345 Views · 1 Like

Generative AI: A New Tool in the Developer Toolbox

A new Couchbase capability called Capella iQ enables developers to write SQL++ and application-level code more quickly by delivering recommended sample code...

September 26, 2023

by Keshav Murthy

CORE

· 4,498 Views · 3 Likes

Modbus Protocol: The Grandfather of IoT Communication

The Modbus protocol is simple and robust, making it a popular choice for industrial control systems.

September 26, 2023

by Weihong Zhang

· 3,500 Views · 2 Likes

An Approach to Process Skewed Dataset in High Volume Distributed Data Processing

This article explains an approach to processing skewed datasets by identifying the skewed portion of the dataset and solving it using an efficient and optimal approach.

September 25, 2023

by Sumit Sanwal

· 2,443 Views · 1 Like

Causes and Remedies of Poison Pill in Apache Kafka

A poison pill is a message deliberately sent to a Kafka topic, designed to consistently fail when consumed, regardless of the number of consumption attempts.

September 25, 2023

by Gautam Goswami

CORE

· 4,784 Views · 3 Likes

The Latest Big Data Topics