January 4, 2021
Kafka – Watch out, another broker coming up!
4 months before the incident - cluster away So, one day you decide to switch from Kafka standalone to cluster mode in order to achieve high availability. (more…)
October 6, 2020
File Download with Error Handling
Designing an API that serves files to be downloaded is not easy. In a way, it is an exception to the standard way of designing APIs. Nowadays most APIs produce XML or JSON, and that is not the case with download, which produces the format of the file being downloaded.…
September 9, 2020
Multi-user remote HDFS access using WebHDFS and Kerberos
As part of our data processing pipeline, we use Hadoop to execute different tasks with HDFS being the primary data storage system. Let's say we have a cluster, and multiple users do their work on the Hadoop cluster, all users will have the same privilege and everyone can access everyone’s…
July 7, 2020
Deployment of a NIST data mirror on OpenShift
The need for dependency checks while building software is crucial. Dependency vulnerabilities can be quite dangerous and can lead to vulnerabilities in the final product. In addition to that, every penetration test will definitely check for dependency vulnerabilities. (more…)
June 24, 2020
5G, changing everything we know about mobile networks
It’s been nearly a decade since 5G was first introduced and slowly but surely it is taking on its true form. But even now, when carriers in some countries are just starting to roll it out, there is a lot of confusion about what 5G is and what it brings…
January 7, 2020
Realtime updates with Hasura GraphQL Engine
What is a realtime update? When data gets updated in the source (database, service) and that change gets instantly propagated to the other side (browser, app, or any other client), that is considered a realtime update. (more…)
October 22, 2019
Elasticsearch and near realtime analytics
Recently, we got a request to create an analytics dashboard for the application's data we have. The data was stored within PostgreSQL and our initial idea was to build queries that would drive these dashboards. (more…)
June 6, 2019
Blackbox export of application metrics in Kubernetes using Grok Exporter and Prometheus
Intro In order to gain a better understanding of how our applications behave in realtime (more…)
April 4, 2019
Making peace with frontend development: The first steps
I come from a computer science background. The classes I enjoyed the most in college revolved around programming in (more…)