Improving a website's visibility to search engines often involves a combination of structured data implementation and proper handling of robots.txt. This post details how structured data was added to a landing page and blog posts, and how a dynamic robots.txt file generation was replaced with a static one for better performance.

Implementing JSON-LD Structured Data

Structured data helps

Introduction

Our application relies on the AutoSyncGeneratePostJob to synchronize data. Recently, we encountered issues with exceeding the rate limits imposed by Azure, leading to job failures and data inconsistencies. To address this, we implemented rate-limiting middleware specifically for this job.

The Problem

The AutoSyncGeneratePostJob frequently triggered requests to Azure services.