×
flink

Flink ML API: The Algorithmic Interface and Iterative Engine Designed for Real-Time Machine Learning

This article explains Flink ML API, its construction, and its use cases.

Flink CDC + OceanBase Data Integration Solution: Full Incremental Integration

This article introduces OceanBase and explains the application scenarios of Flink CDC and OceanBase.

Use Flink Hudi to Build a Streaming Data Lake Platform

This article discusses the basics of Apache Hudi, Flink Hudi integration, and use cases.

An In-Depth Analysis of Flink Fine-Grained Resource Management

This article thoroughly discusses Flink fine-grained management applicable scenarios.

Deconstructing Stream Storage - Pravega and Flink Build an End-to-End Big Data Pipeline

This article discusses stream storage and Pravega's performance architecture.

New Generation Stream Computing and Fault Tolerance of Flink - Periodic Summary and Prospect

This article focuses on the high availability of Flink to discuss the core issues and technical selection of the new generation stream computing of Flink.

Flink State - Backend Improvements and Evolution in 2021

This article discusses updates and future outlooks from the Flink Forward Asia 2021 Core Technology Session.

Improving speed and stability of checkpointing with generic log-based incremental checkpoints

In this article, we discuss several ways to improve the speed and stability of checkpointing with generic log-based incremental checkpoints.

Adaptive Batch Scheduler Automatically Decide Parallelism of Flink Batch Jobs

We introduce Apache Flink's adaptive batch scheduler and detail how it can automatically decide parallelism of Flink batch jobs.

Packaging Issues in Datastream Development

This article mainly explains which dependencies need to be introduced and which need to be packaged into the job JAR during the job development.

More Than Computing: A New Era Led by the Warehouse Architecture of Apache Flink

Mowen discusses the future of Apache Flink regarding its core capabilities of stream computing and improving the processing standards of the entire industry.

Application of Alink and Tensorflow on Flink in JD

This article is compiled from the presentation of JD search and recommendation algorithm engineers Zhang Ying and Liu Lu at Flink Forward Asia 2021.

How to Build a Cloud-Native Open-Source Big Data Platform | Best Practices of InMobi

This article shares the best practices of InMobi based on the open-source big data service of Alibaba Cloud.

Flink Remote Shuffle Open-Source: Shuffle Service for Cloud-Native and Unified Batch and Stream Processing

This article introduces the research and development background and the design and use of Flink Remote Shuffle.

Streaming ETL for MySQL and Postgres with Flink CDC

This tutorial explains how to quickly build streaming ETL for MySQL and Postgres with Flink CDC.

The Open-Source Real-Time Data Warehouse Solution Based on EMR OLAP - ClickHouse Transaction Implementation

This article describes the solution of an open-source real-time data warehouse based on EMR OLAP.

How We Improved Scheduler Performance for Large-Scale Jobs

This article discusses scheduler performance improvements for large-scale jobs in Flink 1.13 and 1.14.

Flink Practices in iQiyi's Advertising Business

This article explains thoroughly how iQiyi (a Chinese online video platform) utilizes Apache Flink.

Sort-Based Blocking Shuffle Implementation in Flink – Part 2

Part 2 of this 2-part series will give you insight into some core design considerations and implementation details of the sort-based blocking shuffle in Flink.

Sort-Based Blocking Shuffle Implementation in Flink – Part 1

Part 1 of this 2-part series will introduce the sort-based blocking shuffle, present benchmark results, and provide guidelines on how to use this new feature.