sreeraj.dev

Programming

Django, Java, Python, Kafka, and software engineering patterns.

13 posts

Converting a multipage pdf to tiff

Converting a multipage pdf to tiff

Converting a multipage pdf to tiff

· 2 min read · python
Flashing an ESP8266-01

Flashing an ESP8266-01

Flashing a ESP8266? Follow this guide written by a beginner for beginners.

· 2 min read · arduino
UUID vs Serials

UUID vs Serials

Benchmarking UUID and Serial Values in Postgres and Python.

· 2 min read · postgres
Adding Basic Authentication via NGINX in Kubernetes

Adding Basic Authentication via NGINX in Kubernetes

Basic Auth via NGINX in kubernetes

· 1 min read · aws
Django Kafka Integration

Django Kafka Integration

Django Kafka Integration using Faust.

· 2 min read · django
Routing stuff using traefik/nginx

Routing stuff using traefik/nginx

Using traefik/nginx as a Reverse Proxy.

· 5 min read · devops
Setting up OpenTelemetry in Django gUnicorn ASGI

Setting up OpenTelemetry in Django gUnicorn ASGI

Setup OpenTelemetry for Django running on gUnicorn ASGI.

· 3 min read · devops
Reducing our Deployment times by 87%

Reducing our Deployment times by 87%

Leveraging github actions by using state to determine whether to build a dockerimage or not.

· 2 min read · devops
Moving from AWS Loadbalancers to Nginx

Moving from AWS Loadbalancers to Nginx

We run a k8s cluster for our healthcare EMR application. At the time, we only had one public facing service, so we used a Kubernetes Service of Type LoadBalancer. resource "kubernetes_service" "django" { metadata { name = "django" namespace = kubernetes_namespace.app_namespace.metadata[0].name annotations = tomap( { "service.beta.kubernetes.io/aws-load-balancer-ssl-cert" = var.django_acm_arn, "service.beta.kubernetes.io/aws-load-balancer-ssl-por

· 2 min read · devops
Django Bulk Save - 2 Fast 2 Big

Django Bulk Save - 2 Fast 2 Big

Continuing from Django Bulk Save, I wanted to test how would the copy_from function perform when I scale to over a million records. The copy_from scales incredibly well, it took 4 seconds to write 1.6 million rows. The rest of the article strays away from the actual topic. I decided to play around with different CSV libraries and figure out what would be the most efficient library to use when you have a file this large. You'd probably never encounter a scenario where you'd have to parse a mil

· 2 min read · tech
Streaming through millions of records trying to match an encrypted field : Java

Streaming through millions of records trying to match an encrypted field : Java

A year ago I was working on a really tiny part of a large non-consumer facing product (idk what's the correct term). I can't divulge much, I have done a lot of illegal things like calling a politician an idiot on social media, so I don't want to add more to the list. Imagine you ran an ice cream subscription service, and you had a lot of people on the payroll tasked with managing renewals for subscribers. Let's call them agents. You had an online portal for customers to manage/renew their subsc

· 3 min read · tech
Connecting Django to RDS via pgbouncer using IAM auth

Connecting Django to RDS via pgbouncer using IAM auth

Setting up the infra We primarily use a django backend with RDS postgres in a kubernetes cluster for production environments. We were trying to setup an environment which would be HIPAA compliant and secure as well, as well as keep complexity to a minimum in the backend layer.  We decided to go with IAM authentication to connect to RDS for the django application. The tricky part was to figure out how we would add pgbouncer between RDS and django to manage connection pooling issues. We setup a

· 3 min read · devops
Django Bulk Save

Django Bulk Save

Using bulk_create? You could switch to copy_from if your usecase fits.

· 2 min read · django