×
kafka

DLF + DDI Best Practices for One-Stop Data Lake Formation and Analysis

This article aims to give readers a deeper understanding of Alibaba Cloud Data Lake Formation (DLF) and Databricks DataInsight (DDI).

Use Flink Hudi to Build a Streaming Data Lake

This article introduces the optimization and evolution of Flink Hudi's original mini-batch-based incremental computing model through stream computing.

Alibaba Cloud BigData Pipeline 구축하기

이 블로그는 빅데이터 플랫폼 도입을 고려 중이고, 어떤 조합으로 시스템을 구축할지 고민이신 분들을 위해 알리바바가 제공하는 모든 서비스들을 나열해 놓고, 각 서비스들의 적용 가능한 시나리오와 서비스 도입 시 고려해야 할 점등을 설명합니다.

Redis Data Synchronization with RDS MySQL Using Canal & Kafka

This tutorial shows you how to synchronize Redis data with ApsaraDB RDS for MySQL using Canal and Kafka.

Knative: Serverless Practices in AI Event-Driven Scenarios

This article describes how to use Knative to implement practices with event-driven framework for users in different scenarios.

Application of Delta Lake in Soul

This article explains the background of Delta Lake along with practices, problems, and solutions.

Flink + Iceberg: How to Construct a Whole-scenario Real-time Data Warehouse

In this article, the author explains building a real-time data warehouse using Apache Flink and Apache Iceberg.

Introduction to SQL in Flink 1.11

This article introduces the major changes and new features of Flink 1.11

Flink 1.11: An Engine with Unified SQL Support for Batch and Streaming Data

This article introduces the enhanced capabilities of Flink 1.11 to support SQL to process batch and streaming data

Building a Cloud-Native Feed Streaming System with Apache Kafka and Spark on Alibaba Cloud – Part A: Service Setup

In this 3-part blog series, we'll show you how to build a simple, intelligent, cloud-native feed streaming system with Apache Kafka and Spark on Alibaba Cloud.

Building a Cloud-Native Feed Streaming System with Apache Kafka and Spark on Alibaba Cloud – Part B: Streaming Processing

In this 3-part blog series, we'll show you how to build a simple, intelligent, cloud-native feed streaming system with Apache Kafka and Spark on Alibaba Cloud.

Basic Concepts and Architecture of a Recommender System

In this article, Alibaba technical expert Aohai introduces the basic concepts and architecture of an enterprise-level recommender system.

Flink Is Attempting to Build a Data Warehouse Simply by Using a Set of SQL Statements

A discussion of how unifying batch and real-time processing in data warehouses can promote integrated computing.

How Log Service Has Evolved into a Data Pipeline Over the Past 5 Years

This article looks at the development of Alibaba Cloud Log Service as a data pipeline over the past five years.

How Flink's Application Powers Up eBay's Monitoring System

This post describes the status quo of Flink's application in the monitoring system, focusing on its impacts on eBay's monitoring system, Sherlock.IO.

Flink 1.9: Using SQL Statements to Read Data from Kafka and Write to MySQL

This article includes the code that I demonstrated in my speech, entitled Flink SQL 1.9.0 Technologies and Best Practices, which sparked a lot of interest from the audience.

Using Flink Connectors Correctly

This article describes Flink connectors focusing on the basic working mechanism and usage of Kafka connectors commonly used in production.

Learning Kafka from Scratch: A Guide to Kafka (Continued)

In this article, part two of two parts, an Alibaba engineer shares everything he knows about Kafka.

Learning Kafka from Scratch: A Guide to Kafka

In this article, part one of two parts, an Alibaba engineer shares everything he knows about Kafka.

Kafka vs. Apache RocketMQ™- Multiple Topic Stress Test Results

The focus of this post is on Kafka and Apache RocketMQ™, since they both are high-performance applications.