Enterprise Integration

Distributed systems, idempotency, outbox pattern, observability across services — what fails in production and how to fix it.

8 articles

April 21, 2026

7 min read

ETL with 50+ sources: automating schema drift and quality gates

Magistra DWH integrates data from 50+ sources — pharmacies, e-shop, HR, external APIs. Schema changes without warning, data quality varies. Contract testing, quality gates and observability pipeline as code.

Read article

April 10, 2026

8 min read

Enterprise integration: 5 things that break in production

Every integration looks fine until the producer has a bad day. Five failure modes we see repeatedly in enterprise systems — and the unglamorous fixes that prevent each one.

Read article

April 6, 2026

8 min read

Microsoft Fabric one year into enterprise: what works, what doesn't

A year with Microsoft Fabric on the Magistra DWH project for 200+ pharmacies. Where Fabric genuinely adds value over Databricks/Snowflake, where we complain, and whether you would start today.

Read article

July 15, 2025

7 min read

Ingesting millions of photos from IoT devices on Azure: from camera to cloud

For Fotopast.cloud we process photos from thousands of camera traps. The pipeline that scales: Event Grid triggers, blob storage tiering, deduplication, and cost optimization for bulk uploads.

Read article

May 19, 2025

7 min read

Processing GB/s of network traffic in .NET: a zero-drop architecture

For Netigo we process IPFIX/NetFlow flows at GB/s volumes. The key is buffering, backpressure and horizontal scaling — no sync processing. What has to be right so the system doesn't start shedding data under load.

Read article

April 14, 2025

7 min read

TimescaleDB vs. InfluxDB vs. ClickHouse: picking a database for time-series data

For the Netigo NetFlow ingestion pipeline we had to pick a database that could process GB/s of network data in real time. A concrete comparison of the three candidates on performance, query language, operations and TCO.

Read article

May 20, 2023

6 min read

Deadline-bound batch computation: how to guarantee it finishes on time

Monthly commissions for JUST must finish by the 5th of the following month. Payroll, month-end closes, invoicing cycles — same pattern. How to design a batch pipeline that doesn't miss deadlines even when input data doesn't grow linearly.

Read article

February 15, 2023

7 min read

MLM commission calculations: how to model them so they survive an audit

For JUST we replaced a legacy system with complex commissions. Recalculation history, versioned rules, reconstructing a computation years later — here's how to approach it so it survives the first auditor.

Read article