×
Stream Computing

Streaming Data Warehouse Storage: Requirements and Architecture

This article discusses the requirements and architecture of streaming data warehouse storage.

Databricks Data Insight Open Course - How to Use Delta Lake to Build a Batch-Stream Unified Data Warehouse

This article discusses using Delta Lake to build a batch-stream unified data warehouse and putting it into practice.

An In-Depth Analysis of Flink Fine-Grained Resource Management

This article thoroughly discusses Flink fine-grained management applicable scenarios.

Deconstructing Stream Storage - Pravega and Flink Build an End-to-End Big Data Pipeline

This article discusses stream storage and Pravega's performance architecture.

New Generation Stream Computing and Fault Tolerance of Flink - Periodic Summary and Prospect

This article focuses on the high availability of Flink to discuss the core issues and technical selection of the new generation stream computing of Flink.

Data Lake Exploration – Delta Lake

This article explores Delta Lake and discusses the implementation of two solutions related to traditional data warehouses based on Hive tables.

RocketMQ Streams: Lightweight Real-Time Computing Engine in a Messaging System

This article introduces RocketMQ Streams and discusses several design ideas and best practices to help you with mplementing this technology with your architecture.

Improving speed and stability of checkpointing with generic log-based incremental checkpoints

In this article, we discuss several ways to improve the speed and stability of checkpointing with generic log-based incremental checkpoints.

Principle Analysis of Apache Flink CDC Batch and Stream Integration

This article focuses on the processing logic of Flink CDC.

Flink CDC Series – Part 5: Implement Real-Time Writing of MySQL Data to Apache Doris

Part 5 of this 5-part series explains how to use Flink CDC and Doris Flink Connector to monitor data from MySQL databases and store data in the tables in real-time.

Flink CDC Series – Part 4: Real-Time Extraction of Oracle Data, Demining, and Tuning Practices

Part 4 of this 5-part series shares the details of the Flink CDC version 2.1 trial process, including troubleshooting experiences and internal execution principles.

Flink CDC Series – Part 3: Synchronize MySQL Database and Table Shard to Build an Iceberg Real-Time Database

Part 3 of this 5-part series shows how to use Flink CDC to build a real-time database and handle database and table shard merge synchronization.

Flink CDC Series – Part 2: Flink MongoDB CDC Production Practices in XTransfer

Part 2 of this 5-part series explains how to realize Flink MongoDB CDC Connector through MongoDB Change Streams features based on Flink CDC.

Flink CDC Series – Part 1: How Flink CDC Simplifies Real-Time Data Ingestion

Part 1 of this 5-part series explains how to use Flink CDC to simplify the entry of real-time data into the database.

Exploration of Advanced Functions in Pravega Flink Connector Table API

This article is compiled from the topic "Exploration of Advanced Functions in Pravega Flink Connector Table API," shared by Zhou Yumin in Flink Forward Asia 2021.

More Than Computing: A New Era Led by the Warehouse Architecture of Apache Flink

Mowen discusses the future of Apache Flink regarding its core capabilities of stream computing and improving the processing standards of the entire industry.

OpenYurt Teamed with eKuiper to Solve the Processing Problems of Edge Streaming Data in IoT Scenarios

This article discusses the new partnership between OpenYurt and eKuiper.

Flink Remote Shuffle Open-Source: Shuffle Service for Cloud-Native and Unified Batch and Stream Processing

This article introduces the research and development background and the design and use of Flink Remote Shuffle.

Streaming ETL for MySQL and Postgres with Flink CDC

This tutorial explains how to quickly build streaming ETL for MySQL and Postgres with Flink CDC.

Flink Practices in iQiyi's Advertising Business

This article explains thoroughly how iQiyi (a Chinese online video platform) utilizes Apache Flink.