Monitoring Public Transportation with the Kafka Ecosystem – a demo project part of the Udacity “Data Streaming” Nanodegree. It contains data streaming workflows using Kafka Producers and Consumers, JSON and Avro serialization, Kafka Connect (JDBC), REST Proxy, Robinhood Faust, and KSQL. …
Category: Distributed Systems
Migrating Your Reporting Queries From a “General Purpose” DB to a Data Warehouse – Performance Overview. The article focuses on MongoDB and ClickHouse, but most takeaways apply to other “traditional” DBs and “data warehouse” solutions. …
Exploring Causal Consistency in MongoDB – the article goes through the concepts of Lamport (Logical) Clocks, Operation Time, Cluster Time, and Causally Consistent Sessions that lead to solving the “Read Your Write” consistency violation. …
A code example of how to break the Read You Write consistency in Mongo. Followed by a review of “majority” reads and writes. This will move the discussion towards Causally Consistent Sessions that I’ll cover next. …
When is Eventual Consistency not sufficient in a Distributed System? This article explores Causal Consistency Guarantees and describes the most popular ones – Read Your Write, Monotonic Reads, Monotonic Writes, Writes Follow Reads. …
MongoDB Change Data Capture via Debezium Kafka Connector with a .NET 5 Client …