Latest Updates

Documenting code, one commit at a time.

Implementing Rate Limiting for AutoSync Jobs

Introduction

Our application relies on the AutoSyncGeneratePostJob to synchronize data. Recently, we encountered issues with exceeding the rate limits imposed by Azure, leading to job failures and data inconsistencies. To address this, we implemented rate-limiting middleware specifically for this job.

The Problem

The AutoSyncGeneratePostJob frequently triggered requests to Azure services.

Read more

Enhancing Data Retrieval Robustness in Data Processing Services

Introduction

This article outlines an approach to enhance the resilience of data processing components when interacting with database tables, specifically addressing scenarios where tables might be temporarily unavailable or not yet provisioned in certain environments.

The Challenge

In dynamic environments, data processing tasks sometimes encounter situations where expected database

Read more