An article about integration tests for your Kafka workflow. Using C# and the “Testcontainers” framework, we first run Kafka in Docker, call an API that will push a message to Kafka, consume the produced Kafka message ensuring it’s correct, and finally drop the created containers. …
Author: Vasil Kosturski
A blog post where we use Wireshark to trace the Kafka networking protocol. The client is a simple C# app interacting with a multi-broker Kafka cluster. …
In this article, I’ll introduce Kafka listeners, the client-broker “handshake” and pub/sub interactions. …
In this article, we’ll continue where we left off and see how to properly handle the networking issues we had last time. Concretely, we need to find a way to host our Fargate Task in a private subnet (so it’s not reachable publicly) but also allow for outbound internet traffic through a static public IP address. We will whitelist this IP in Atlas, making the Mongo cluster accessible from the running container. …
In this couple of articles, I’ll demonstrate how you can deploy a sample .NET console app to AWS and run it periodically as a Fargate task. That’s a common use case for any kind of background service you need to run on some predefined time intervals. …
In this article, I’ll present a demo project for classifying the sentiment of posts from the Stocktwits social media. The community on Stocktwits is full of investors, traders, and entrepreneurs. Each message posted is called a Twit. This is similar to Twitter’s version of a post, called a Tweet. Using Pytorch, we’ll build a model around these twits that generate a sentiment score. …
In this article, I’ll present the UI part of the Social Media demo project we started exploring last time. In the previous post, you dug into the GraphQL API and how to send queries via the Apollo Playground. Now it’s time to bring it all together and see how the React front-end integrates with the API using Apollo Client. …
It can’t go unnoticed that GraphQL is being adopted by plenty of reputable companies like Facebook, Shopify, Twitter, and many more. For quite some time, I hadn’t had the chance to explore it and understand what it brings to the table. Still, probably like many of you, I’ve read some isolated references here and there, gaining intuition about what kind of API design pain points GraphQL is meant to solve. So I decided to spend some time learning GraphQL, its …
Running NodeJS Microservices in Kubernetes using AWS EKS & Travis CI, Part 3 – a demo project part of the Udacity “Cloud Developer” Nanodegree. In this post, you will see how to deploy the sample system to Kubernetes using AWS EKS. …
Running NodeJS Microservices in Kubernetes using AWS EKS & Travis CI, Part 2 – a demo project part of the Udacity “Cloud Developer” Nanodegree. In this post, you will see how to set up Continuous Integration with Travis CI. …