https://nanta-data.dev/en/tags/streaming/Recent content in Streaming on nanta - Data EngineeringHugo -- gohugo.ioen© 2026 nantaTue, 03 Mar 2026 00:00:00 +0000https://nanta-data.dev/en/posts/flink-in-place-scaling/Tue, 03 Mar 2026 00:00:00 +0000https://nanta-data.dev/en/posts/flink-in-place-scaling/Our recommendation system’s Flink application required sub-1-minute latency, which prevented us from using autoscaling or spot instances. Autoscaling or spot reclamation triggered full Flink restarts that took 2-3 minutes. Using Flink 1.18’s adaptive scheduler and K8s Operator 1.8, we enabled in-place scaling — reducing consumer lag peaks to 1/5 and lag duration from 5-7 minutes to 2-3 minutes during scale events.