PinnedHow Intuit Debug Consumer Lags in Apache BeamAt Intuit, we have been using Apache Beam with FlinkRunner as a real time data processing pipelines platform for our data pipelines…Apr 8, 20211Apr 8, 20211
A Few Tips On Remote Debugging Golang Applications Running in an M1 Docker ContainerI recently picked up Go programming. One technique that I always find helpful in development is the ability to remote debug a program…May 1, 2023May 1, 2023
Supplementary Notes to Deploy Argo-Events in Managed Namespace Scope— coauthored with Prema KuppuswamyFeb 8, 2023Feb 8, 2023
Published inApache Beam State ProcessingMicroscopic Look at the States Inside Apache Beam Stateful Pipeline (Part two of three)— coauthored with Prema Kuppuswamy and harish nagu sanaJan 27, 2023Jan 27, 2023
How To Obtain Kafka Consumer Lags in Pyspark Structured Streaming (Part 2)In this article, I will describe another alternative to obtaining consumer lag based on spark checkpoint file. As I did in my previous…Jul 8, 2022Jul 8, 2022
How To Obtain Kafka Consumer Lags in Pyspark Structured Streaming (Part 1)Pyspark is a common BigData computational engine used by data scientists. Intuit Stream Processing Platform (SPP) provides a common…Apr 2, 20223Apr 2, 20223
