In this blog post, I am going to desribe how we can calculate sepsis onset time using sepsis-3 criteria for the MIMIC-III patient data. Reading the relevant tables Sepsis-3 Criteria Operationalization in code Identifying the onset of suspected infection Time of drawing of the first culture Time of...

   I remember the days of reading API documentation, and figuring things out and experiencing a joy having done so. The experience was enriching and that’s really what enabled me keep doing it, because of a sense of joy I derive from it. I remember the days, when that was just how things happened. Now...

   I recently downloaded MIMIC-CXR-JPG, from Google cloud storage. The reason I had to eventually use Google cloud storage download was because of the suggestion that was offered for working around the bandwidth constrained physionet.org servers. These are some notes that might help someone else....

   In this post, we are going to discuss an implementation detail about how we can use a custom HTTP client to use the Go GitHub SDK and the https: pkg.go.dev golang.org x oauth2 package. Introduction Using a custom HTTP client with golang.org x oauth2 Using the custom HTTP client with Go Github SDK...

   In this post, I am going to share what I have learned about writing HTTP client middleware in Go. Let’s get started HTTP client and Transport Writing your own RoundTripper implementation Returning static responses Summary HTTP client and Transport Go’s http.Client defines a default value for the...

   I delivered a talk at the recently concluded Kiwi PyCon XI. Checkout some photos of the event from Kristina DC Hoeppner here. I attended it virtually as I was unable to travel due to last minute interruptions from a certain virus. The organizers were of course very well prepared for that. Massive...

   I delivered a talk at the recently concluded PyCon US 2022 conference. Amazing conference, great work by the organizers and everybody involved. This was my third time at PyCon US and my first time participating in the post conference sprints. I contributed to the Pyodide project during the sprints,...

   At PyCon US 2022, Anaconda announced PyScript: Python in the Browser. So far my understanding is that it builds on Pyodide and makes it magically easy to bridge the world of the Browser - the Document Object Model (DOM) and Python. It’s so magical that you can simply copy scripts that you were...

   I saw a computer for the first time at school when I was 10 years old ( 1995 96). I failed horribly in the first few years to actually get programming. Then i had this teacher with whom i took group classes, who taught me computer programming, properly. GW Basic, then some Java, some C and C . I...

   I have finally gotten around to reading (listening) The Code Breaker: Jennifer Doudna, Gene Editing, and the Future of the Human Race by Walter Isaacson. And in one of the first chapters, the writer talks about Jennifer Doundna’s thoughts (I think) on how often it’s the practical application of...

   Update: Please note that my usage of Call by reference is not correct here as pointed out by a Reddit community member here. Read it as Call by passing pointer values . While trying to understand this a bit more, I came across a few more links to the topic. You can find them here in my reply. I...

   While working on the solutions to exercises for my soon to be published book Practical Go, I needed to implement a way to implement an option in my command line application which could be specified multiple times. The result would be that all the values specified would form a list of the values. To...

   While working on the solutions to exercises for my soon to be published book Practical Go, I wanted to write a test function which would simulate a user not providing an interactive input when one was asked for. However, I noticed that the test function would not wait for me to provide the input...

   I always get confused between serialization and deserialization . Perhaps, that is because I am trying to memorize what they are, and then trying to recall from memory. Of course, it’s sufficient to remember only one of them correctly. So, here’s my trick that I am going to use from now on. It is...

   One word that has always baffled me in the context of software computing is transparency . This change is completely transparent to the application - or some version of it is often used to tell consumers of an application library that a certain change won’t be noticeable by the consumer at all. If...

   I delivered a talk at the recently concluded PyCon Australia conference. Amazing conference, great work by the organizers and everybody involved. Fantastic experience My talk My talk was in the DevOops track titled Planning for Failure using Chaos Engineering . Since I joined Atlassian, I have come...

   In Go, there are a couple of ways to return values from a function. Non-named return values Until today, I had been exclusively using the following style of what i am going to refer to as Non-named return values : func myFunc() (int, error) return 1, errors.New("An error") You declare in...

   The Go module path enforces certain restrictions as expected on what constitutes a valid path. Try running go mod init https: foo.bar baz for example. Now, what if you as a Go programmer needed to run this check yourself? That’s where the golang.org x mod package comes in. It has a number of...

   Using a file for persistent storage (and not a database - datastore object store) sounds like an academic exercise. For me, it brings back memories of writing a structure in C (programming language) to a file to simulate a student record database. However, there may be situations where you may just...

   Demo - Embedding a template Demo - Serving files from a directory Learn more The most exciting feature for me in the Go 1.16 release is the new embed package which allows you to embed a file contents as part of the Go application binary. This ability so far was most easily available via using...

   In my latest article for the folks at learnk8s, I write about establishing authentication between services deployed in Kubernetes. Specifically, we discuss how you can use the Kubernetes primitives - Service accounts with a new feature - Service Account Token Volume Projection to setup...

   My two recent articles, Validating Kubernetes YAML for best practice and policies and Enforcing policies and governance for Kubernetes workloads looks at the topic of enforcing policies for your Kubernetes workloads. Check them out and let me know if you have any comments.

   Introduction Gatekeeper allows a Kubernetes administrator to implement policies for ensuring compliance and best practices in their cluster. It makes use of Open Policy Agent (OPA) and is a validating admission controller. The policies are written in the Rego language. Gatekeeper embraces...

   Introduction In this post, I will share some of my learnings and explorations on plugins in Golang. We will write a driver program which will load two plugins and execute a certain function which are present in both of them. The driver program will feed an integer into the first plugin, which will...

   Welcome to this new blog post Introduction Enforcing policies Using kustomize to manage policies Rolling the policy changes out Multiple matching policies Conclusion Introduction Pod security policies are cluster level resources. The Google cloud docs has some basic human friendly docs. A psp is a...

   Metadata I have posted this article on dev.to where I welcome comments and discussions. Introduction Log forwarding is an essential ingredient of a production logging pipeline in any organization. As an application author, you don’t want to be bothered with the responsibility of ensuring the...

   This blog is managed as a git repository and I use Hugo as the framework for managing it. I am using the Hugo classic theme which I have tweaked slightly and store it along with the blog source. I wanted to modify the sorting of the blog post titles on the index page so that the most recently...

   Introduction In this post, I will describe my experiments with using Cloud Custodian to perform various tasks usually falling into the bucket of compliance and sometimes convention. I encourage you to take a look at some of the example policies. Some of the areas I will cover are resource tagging...

   A reader of my book Doing Math with Python wrote to me a few weeks back about a strange problem they were having. They were trying to create an animated projectile motion from the code listing in the book. However, they were not seeing the expected results. Worse, there were no errors. They figured...

   Introduction There are two broad discussion points in this post: Managing the lifecycle of Kubernetes YAML manifests Static guarantees best practices enforcements around Kubernetes YAML files before they are applied to a cluster Prior art and background Please read this article to get a more...

   Please note this document is currently in progress. You may read this other post instead which illustrates what I wanted to discuss in this post with an implementation in Go. Introduction In a service oriented architecture, more popular these days as a microservice oriented architecture it’s...

   Since around 1.5 years ago, I have been working in roles which has required to automate various things usually classified as infrastructure and operations work. Sometimes they have involved working with cloud infrastructure and at other times they have involved interacting with databases and other...

   Introduction The docker workflow plugin enables leveraging Docker containers for CI CD workflows in Jenkins. There are two broad patterns one would generally use containers in their CI CD environment. The first would be as side car containers - these are containers which run alongside your tests...

   Monday was just beginning to roll on as Monday does, I had managed to work out the VPN issues and had just started to do some planned work. Then, slack tells me that new deployment had just been pushed out successfully, but the service was actually down. Now, we had HTTP healthchecks which was...

   Introduction When implementing a solution for allowing users other than the cluster creator to access the cluster resources we are faced with two fairly old generic problems - authentication and authorization. There are various ways one can solve these problems. I will discuss one such solution in...

   Repeating the same argument to Printf If we wanted to repeat the same argument to a call to fmt.Printf(), we can make use of indexed arguments. That is, instead of writing fmt.Printf("%s %s", "Hello", "Hello"), we can write fmt.Printf("%[1]s %[1]s",...

   Introduction This in-progress page lists some of my findings while working with Kubernetes. EKS cluster setup You may also find this guide from spacelift.io useful. This section will have findings that are relevant when working with an AWS EKS cluster. Terraform configuration for master This is...

   Introduction I wanted a Nginx configuration which would satisfy the following requirements: Any example.com requests should be redirected to www.example.com The above should happen for http and https http: example.com should redirect directly to https: www.example.com Solution We will need four...

   Welcome to this new blog post Introduction Setting up DIY bash completion Data provided to completion handlers Single <TAB> and double <TAB><TAB> Getting good old BASH completion back Magic of bash-completion package compgen built-in command Learning more Bash completion for...

   Some notes on PostgreSQL which you may find useful. Thanks to all those numerous StackOverflow answers that helped me do my job at hand. Schemas and Database The database is the highest level of organization. A database can have one or more schemas. The public schema is present by default and all...

   I was debugging a issue where we were getting truncated logs in ElasticSearch in the context of a setup as follows: Application Logs -> Fluentd (logging) -> Nginx -> ElasticSearch The original problem turned out to be on the application side, but my first point of investigation was what...

   I wanted to setup Nginx logging so that it would perform GeoIP lookup on the IPv4 address in the X-Forwarded-For header. Here’s how I went about doing it on CentOS 7. This nginx module integrates Maxmind GeoIP2 database with the RPMs being available by getpagespeed.com. Once I had installed the...

   In this post, we will see how we can use Golang to generate Terraform configuration from a TOML specification. That is, given a TOML file, like: subnet name "SubnetA" rules [ rule no 101, egress false, protocol "tcp", rule action "allow", cidr block "127.0.0.1 32",...

   docker logs by default shows the container’s stdout and stderr logs. However, what I discovered was that the stderr logs from the container are output to the host system’s stderr as well. I was expecting everything from the container to be on the host’s stdout. Let’s see a demo. Consider the...

   I love working in software. Mostly things work as expected, but at times no. I changed A, how can Z be affected - after all they are all miles apart. Right? Wrong. Z can be affected. Today’s story is the latest - totally unexpected, but not surprising. Background We run ASP.NET compilation on our...

   Recently, I wrote two articles about using traefik as a reverse proxy. The first article discussed deploying a ASP.NET framework application and the second discussed deploying ASP.NET core applications. In both cases, I demonstrated the following: Docker native integration In-built support for...

   Windows docker images can be bulky and on a server that you are deploying your application as docker images, the free disk space becomes a metric to watch out for. The following script will setup a Scheduled tasks to be run at a 7.0 PM UTC which will prune all unused images: # Scheduled tasks if (...

   TLDR; If you are having trouble with docker build and ephemeral port ranges, we can use iptables to solve the issue: sudo iptables -t nat -I POSTROUTING -p tcp -m tcp --sport 32768:61000 -j MASQUERADE --to-ports 49152-61000 I have written previously about how things get interesting with ephemeral...

   When we create an AWS Code Deploy deployment group via Terraform or CloudFormation and integrate with an Auto Scaling Group, it also by default creates an initial lifecycle hook which ensuresthat a new code deployment gets triggered when a scale-out event occurs. It is all very magical and it is...

   Much has been written (and asked) on the topic of hard links and soft links (a.k.a symbolic links) on Linux. I have read a few of those more than once. However, I end up getting confused between the two, specifically the differences between the two. So, here’s my post on the topic with the hope...