×

Apache Flink Community China

5247 Reputation

Apache Flink Community China

Follow
Activities(50) Posts(104) Series(4) Areas of Expertise Following Followers

Apache Flink Community China Posted blog

Improving speed and stability of checkpointing with generic log-based incremental checkpoints

In this article, we discuss several ways to improve the speed and stability of checkpointing with generic log-based incremental checkpoints.

Apache Flink Community China Posted blog

Adaptive Batch Scheduler Automatically Decide Parallelism of Flink Batch Jobs

We introduce Apache Flink's adaptive batch scheduler and detail how it can automatically decide parallelism of Flink batch jobs.

Apache Flink Community China Posted blog

Principle Analysis of Apache Flink CDC Batch and Stream Integration

This article focuses on the processing logic of Flink CDC.

Apache Flink Community China Posted blog

Flink CDC Series – Part 5: Implement Real-Time Writing of MySQL Data to Apache Doris

Part 5 of this 5-part series explains how to use Flink CDC and Doris Flink Connector to monitor data from MySQL databases and store data in the tables in real-time.

Apache Flink Community China Posted blog

Flink CDC Series – Part 4: Real-Time Extraction of Oracle Data, Demining, and Tuning Practices

Part 4 of this 5-part series shares the details of the Flink CDC version 2.1 trial process, including troubleshooting experiences and internal execution principles.

Apache Flink Community China Posted blog

Flink CDC Series – Part 3: Synchronize MySQL Database and Table Shard to Build an Iceberg Real-Time Database

Part 3 of this 5-part series shows how to use Flink CDC to build a real-time database and handle database and table shard merge synchronization.

Apache Flink Community China Posted blog

Flink CDC Series – Part 2: Flink MongoDB CDC Production Practices in XTransfer

Part 2 of this 5-part series explains how to realize Flink MongoDB CDC Connector through MongoDB Change Streams features based on Flink CDC.

Apache Flink Community China Posted blog

Flink CDC Series – Part 1: How Flink CDC Simplifies Real-Time Data Ingestion

Part 1 of this 5-part series explains how to use Flink CDC to simplify the entry of real-time data into the database.

Apache Flink Community China Posted blog

Exploration of Advanced Functions in Pravega Flink Connector Table API

This article is compiled from the topic "Exploration of Advanced Functions in Pravega Flink Connector Table API," shared by Zhou Yumin in Flink Forward Asia 2021.

Apache Flink Community China Posted blog

Packaging Issues in Datastream Development

This article mainly explains which dependencies need to be introduced and which need to be packaged into the job JAR during the job development.

Apache Flink Community China Posted blog

More Than Computing: A New Era Led by the Warehouse Architecture of Apache Flink

Mowen discusses the future of Apache Flink regarding its core capabilities of stream computing and improving the processing standards of the entire industry.

Apache Flink Community China Posted blog

Application of Alink and Tensorflow on Flink in JD

This article is compiled from the presentation of JD search and recommendation algorithm engineers Zhang Ying and Liu Lu at Flink Forward Asia 2021.

Apache Flink Community China Posted blog

Flink Remote Shuffle Open-Source: Shuffle Service for Cloud-Native and Unified Batch and Stream Processing

This article introduces the research and development background and the design and use of Flink Remote Shuffle.

Apache Flink Community China Posted blog

Streaming ETL for MySQL and Postgres with Flink CDC

This tutorial explains how to quickly build streaming ETL for MySQL and Postgres with Flink CDC.

Apache Flink Community China Posted blog

How We Improved Scheduler Performance for Large-Scale Jobs

This article discusses scheduler performance improvements for large-scale jobs in Flink 1.13 and 1.14.

Apache Flink Community China Posted blog

Flink Practices in iQiyi's Advertising Business

This article explains thoroughly how iQiyi (a Chinese online video platform) utilizes Apache Flink.

Apache Flink Community China Posted blog

A Demo of the Scenario Solution Based on Realtime Compute for Apache Flink

The article mainly introduces two applications of real-time big data based on Flink.

Apache Flink Community China Posted blog

Sort-Based Blocking Shuffle Implementation in Flink – Part 2

Part 2 of this 2-part series will give you insight into some core design considerations and implementation details of the sort-based blocking shuffle in Flink.

Apache Flink Community China Posted blog

Sort-Based Blocking Shuffle Implementation in Flink – Part 1

Part 1 of this 2-part series will introduce the sort-based blocking shuffle, present benchmark results, and provide guidelines on how to use this new feature.

Apache Flink Community China Posted blog

Kwai Builds Real-Time Data Warehouse Scenario-Based Practice on Flink

This article introduces the real-time data warehouse architecture built by Kwai based on Flink and offers solutions to some difficult problems.

Latest Comments