How to Achieve Resource-Level Isolation in Kubernetes Using a Multi-Environment Node Pool Strategy

Introduction Running multiple production environments in a single Kubernetes cluster creates a critical challenge: ensuring resource-level isolation for high-priority customers and critical workloads. When three broad production environments share one EKS or GKE cluster, a resource-intensive deployment in one environment can impact performance and availability for others. This scenario is

VM Snapshots in Civo: Why They Matter, How They Work, and How to Use Them via CLI

Why VM Snapshots Are Important In real-world cloud environments, virtual machines are constantly changing. Engineers upgrade packages, deploy new application versions, modify configurations, and test infrastructure changes. These activities introduce risk. A single mistake such as a failed OS upgrade, misconfigured service, or accidental file deletion—can lead to downtime

Cross-Cloud Integration Made Easy: Building an AWS–Civo StrongSwan VPN for Private, Secure Connectivity

Connecting workloads across clouds has become a common requirement for teams that rely on hybrid environments. Organizations migrating to Civo Cloud—or expanding into it—often need a stable way to reach private AWS resources without exposing anything publicly. But this is where challenges appear quickly. Most teams discover that

How to Securely Expose Your Applications Using Cloudflare Tunnel (Step-by-Step Guide)

Introduction You've built a media server, a monitoring dashboard, or a personal application running on your home network. Now you want to access it from anywhere, but opening ports on your router feels risky, and managing SSL certificates is a hassle. What if you could expose your applications

How to Create an Internal Load Balancer in Civo Kubernetes (Step-by-Step Guide)

Civo Kubernetes clusters do not have a private only load balancer. So if you have a need to create a load balancer that is accessible only in the private network then you can use a custom firewall rule. By default, Civo creates load balancers with both public and private IP

EKS IRSA vs EKS Pod Identity (2025): Which Is Better for Secure AWS Access?

Introduction Every Kubernetes workload on Amazon EKS eventually needs to talk to AWS services—pulling files from S3, fetching secrets from Secrets Manager, publishing to SNS, or writing to DynamoDB. The question is not if your pods need access, but how to grant that access without hardcoding long-lived keys or

K3s vs Kubernetes (K8s): Key Differences, Use Cases, and Performance Comparison

Kubernetes (K8s) has become the standard for container orchestration, but K3s offers an attractive lightweight option. Think of standard Kubernetes as a full commercial kitchen equipped for a five-star restaurant – powerful, but requiring significant space and staff. K3s is more like a well-equipped food truck: compact, efficient, and ready to

Why Your GCP Service Account Alone Can’t Decrypt with CMEK (and How It Differs from AWS)

Introduction: When I first moved from AWS to GCP, I expected things to work the same. In AWS, if my IAM role has kms:Encrypt and kms:Decrypt, I can upload and download S3 objects encrypted with KMS (SSE-KMS). So when I set up my GKE cluster in GCP, I

Fixing 504 Errors in GKE load balancer: How BackendConfig Solved Our 30-Second Timeout Problem

Introduction We first noticed this problem during normal API calls. Everything worked fine at first for all API calls, but when we ran the application for some time we realised that all our API requests that needed more than 30 seconds to process were failing with 503 and 504 Gateway

Enterprise AWS Backup Implementation: Compliance Policies, Monitoring, and Data Protection

Introduction Enterprise data protection requirements have become increasingly complex, with regulations like GDPR, HIPAA, SOX, and industry-specific standards mandating specific backup retention periods and recovery capabilities. Managing daily, weekly, and monthly backups across multiple databases, storage systems, and applications manually becomes an operational nightmare that introduces compliance risks and potential

Docker Image Re-tagging Limitations: AWS ECR Solutions & Alternatives (2025)

Introduction Docker CLI is the standard tool for container image management, but it has one major limitation when it comes to re-tagging images in remote registries. It requires you to pull an image locally before you can create a new tag for it. This is fine for small images, but

How Choosing the Right AWS Instances Can Cut Your Cloud Bill in Half: The Graviton Advantage

Introduction Your AWS compute costs could drop by 50% with a single architectural decision. Organizations running thousands of instances face mounting pressure to optimize cloud spending while maintaining performance. The choice between traditional x86 processors and AWS Graviton ARM-based instances represents one of the most impactful cost optimization opportunities available

How to avoid Race Conditions and Deadlocks in Django (Step-by-Step Guide).

Introduction Race conditions and deadlocks are silent killers in Django applications that can cause data corruption, inconsistent states, and mysterious bugs that are hard to reproduce. When multiple processes or threads access the same database records simultaneously, you're walking on thin ice. This guide shows you how to

Automating Jira and Confluence Search from Slack using n8n

At KubeNine, documentation is an important part of our work; it helps team members to learn from others’ experiences to avoid repeating the same mistakes. We maintain detailed documentation for almost every project, hosted in Confluence and Jira. But finding what we need during a Slack conversation or a huddle

Google Cloud Storage and the Problem with Zero-Byte Folders

Overview On Google Cloud, we were creating a basic event-driven pipeline. The plan was to have a Cloud Function call our backend API whenever a file was uploaded to a GCS bucket. However, an odd thing began to happen: even when no actual file was uploaded, our backend was being

Stop debating Alpine vs Ubuntu and start measuring: here's why your network calls are 20% faster on Alpine.

Introduction If you've worked with Docker containers for any length of time, you've likely noticed that some operations perform differently across base images. One such observation that I noticed a few weeks back is the performance difference in curl requests between Alpine and Ubuntu Docker images.

How to integrate Algolia Search into your Django App

Introduction Django’s ORM is very powerful, and PostgreSQL offers decent full-text search—but when you need real-time, typo-tolerant, and lightning-fast search across thousands of records, traditional methods fall short. This blog explores how to integrate Algolia into your Django project to unlock seamless search capabilities that feel instant and

Stop Wasting Money: Cut Your AWS EC2 Costs by 50% with Automated Scheduling

Introduction You can save cost by turning off non-production ec2 instances when they are not needed. Automating start and stop actions using AWS Lambda and CloudWatch can save costs significantly. Instead of scripting this from scratch, Terraform modules can help implement the solution quickly and cleanly. In this guide, we’

Supercharge Terraform with Cursor and MCP Server

AI doesn’t make writing terraform code that easy. You’ll agree with me if you’ve tried tried writing a complex terraform code involving multiple modules and resources. Models like Sonet 4 do generate great code but at the end they leave some bugs in it that take your

How to Resolve Django Migration Sequence Conflicts in Team Development

Introduction Django migrations are essential for database schema management, but they can become problematic when multiple engineers work on the same application simultaneously. One common issue is migration sequence conflicts — when two engineers create migrations with the same sequence number, causing Django to throw exceptions during deployment. This guide shows

How to Merge Kubeconfig Files - Simplified

Introduction Managing multiple Kubernetes clusters means dealing with multiple kubeconfig files. Each cluster generates its own configuration file containing authentication details, server endpoints, and context information. As your infrastructure grows, manually switching between different kubeconfig files becomes tedious and error-prone. Merging kubeconfig files into a single configuration allows you to

Saving Cost with EC2 Strategy but More Operational Overhead? What is Better: ECS Fargate vs ECS EC2?

When deploying container workloads on AWS, Amazon ECS offers two primary execution models: ECS with EC2 and ECS with Fargate, each with its own cost, control, and operational implications. EC2, especially when paired with Spot Instances, can substantially reduce spend, but demands infrastructure management. Fargate simplifies operations by abstracting compute

Rapid UI Prototyping with Python Streamlit: Audio Transcription, End-to-End

Introduction Podcasts, video calls, and voice calls produces hours of speech every day. Turning that speech into text is now routine for meetings, customer-support calls, and more. A simple audio to text tool can help us capture conversations on meetings, phone or our smart watch - once recorded we can

Securely Accessing AWS Resources from GitHub Actions using OpenID Connect (OIDC)

Introduction Hardcoding AWS credentials into CI/CD pipelines is one of the most common mistakes teams make—and one of the easiest to avoid. In this blog, you’ll learn how to connect GitHub Actions with AWS using OpenID Connect (OIDC), a method that skips access keys entirely. Instead of

Add Blazing Fast Search to Your Django Site with Algolia

Introduction Most web applications struggle with search functionality as they scale. Users expect instant, accurate results with typo tolerance and intelligent filtering capabilities that traditional database queries simply cannot deliver efficiently. Building these features from scratch requires significant development resources and ongoing infrastructure management. Even with proper indexing, SQL queries

How a Simple Open Source Tool Drastically Improved Our Time to Ship GitHub Actions

Introduction Every DevOps team knows the frustration: you push a change to your GitHub Actions workflow, then wait several minutes for the pipeline to execute, fail, and force another round of commits. And then it goes on in a loop. At KubeNine, we encountered this same delay while iterating on

Simplifying AWS CloudTrail Log Analysis using NLP

Introduction Cloud security auditing is critical but often tedious and time-consuming. AWS CloudTrail logs every API call and user activity, offering a detailed audit trail. But combing through these logs manually or writing complex CloudWatch Insights queries is a painful and error-prone task. We at KubeNine have built an AI-powered

Why We Chose Vaultwarden for Password Management — And Why It Might Work for You

Introduction When we started looking for password managers for our DevOps team, Bitwarden Cloud was a natural first stop. It’s trusted, secure, and user-friendly — but it came with limitations that didn’t sit well with our priorities as a self-hosting, cost-conscious DevOps consultancy. * We don’t do black boxes:

How This AWS Architecture Keeps Notifying You Until You Fix It - Repeated Alarm

By default, Amazon CloudWatch Alarms send a notification only when the alarm changes state — for example, from OK to ALARM. If the alarm remains in the ALARM state, no additional messages are sent. This can be a problem in production environments or for support teams who rely on timely updates

Ship Logs from EKS to Cloudwatch using Fluent-Bit

Introduction When running workloads on Kubernetes, collecting logs from your applications and system components is a basic necessity. In this guide, we’ll show how to use Fluent Bit to gather logs from different sources in a Kubernetes cluster and send them to Amazon CloudWatch Logs. Fluent Bit is a

Automate GCP Billing Notifications using Airflow

Introduction Staying on top of your cloud spendings saves you from disasters. For startups and fast-moving teams, not knowing what you're spending until it’s too late can blow up budgets and cause panic. We have been situations where we created services and let them running for days

A simple framework to help you Rightsize your cloud resources!

Introduction I’ve learnt a few things about autoscaling and rightsizing that tend to work well in most scenarios. No guarantee they’ll fit your use case exactly, but they can serve as helpful references to get started. I’ve been in situations where I downsized resources for a customer

Let Your Kubernetes Workloads Sleep: Using Snorlax to Cut Non-Prod Cluster Costs

Non-production workloads running on Kubernetes need not be up 24/7. In order to cut cost we can easily shut down a lot of them during non-work hours or on weekends. This small change can add to significant cost saving in large environments. Snorlax helps you do exactly that. By

Why HTTPS Matters and How to Enable It Using Certbot

Introduction Securing your website is no longer optional, it’s a fundamental requirement. If your site is still operating over HTTP, it’s time to make the switch to HTTPS. This not only ensures data transmitted between your users and server is encrypted and secure, but also strengthens user trust,

Stop Overpaying for AWS CloudWatch: Metric Optimization Tips

Introduction AWS Cloudwatch is the default monitoring service on AWS. When you’re using AWS, Cloudwatch is part of the package - you’ll automatically get default metrics when you asked for them or not. Things are good as long as you’re using these default metrics, but when you

Wait4X: The Elegant Service Readiness Notifier for DevOps

Introduction In modern container-based architectures, one challenge is ensuring that services are ready before their dependencies attempt to use them. Wait4X is a handy CLI tool which solves this problem with a simple notification system. What Makes Wait4X Special? Unlike complex monitoring tools, Wait4X does one thing extremely well -

Building Autonomous AI Teams with CAMEL-AI

Introduction AI has transformed from a buzzword into an essential toolkit. AI capabilities continue to expand at a mind-boggling pace. While AI Agents are great, do you know what's even better? AI Workforces. What if you could simply create multiple agents with different roles and responsibilities? These agents

6 Things You’re Probably Doing Wrong in Prometheus Monitoring

Prometheus is an incredibly powerful tool for monitoring your systems. Its flexible data model and expressive query language, PromQL, make it one of the most popular choices in the observability world. But — that flexibility comes at a cost. When you're just starting out with Prometheus, it's

Python’s Biggest Bottleneck Just Got Optional: Meet the GIL-Free Era!

Are you experiencing performance bottlenecks in your Python applications? Have you wondered why your multi-threaded Python code doesn't fully utilize all CPU cores? The answer lies in Python's Global Interpreter Lock (GIL). For years, this mechanism has been a significant limitation for CPU-bound tasks in Python,

How to Use ECS Exec to Access Fargate Containers with Terraform

Introduction Is it even possible to exec into a running container in ECS? It definitely is - but it’s not straightforward to setup. ECS Exec lets you connect to your containers on demand using the AWS CLI, giving you a way to inspect, debug, and fix issues inside your

Test your LLM applications right!

What’s the biggest challenge when building applications, whether they’re web-based, native, LLM-powered, or anything else? Testing! Every time you make a change, you need to ensure the application still functions smoothly and that your new features haven’t broken any part of the flow. To simplify this, we

Using port-forward too often? KubeVPN Can help!

Introduction If you’ve worked with building or deploying anything on Kubernetes then you must have had the need to connect to a service running on a remote kubernetes cluster from your local system. This is often needed for debugging and testing. kubectl port-forward is the standard method used to

Automating Cloudflare DNS Management with Terraform

Why use terraform for managing DNS records? If you're responsible for managing DNS records on Cloudflare across multiple domains, you know how repetetive it can be to keep updating DNS records all the time. You log into the Cloudflare dashboard, go to the DNS settings, and manually change

Supercharging AI IDEs with Model Context Protocol (MCP)

The past few months have been crazy. We see new AI innovations coming in every day. The amount of transformation is going to change the way we are used to doing things for the better. At KubeNine, we have been constantly adapting to the change - trying to keep up

Why Google CloudRun is not an alternative for Amazon ECS!

Introduction ECS is a popular container orchestration service provided by AWS. You can run any application on ECS as long as you can containerise it. HTTP based applications or applications that consume messages from a queue - any use case - it just works, with no drama. When evaluating a

VPC in AWS and GCP: How are they fundamentally different?

Introduction Google Cloud Platform (GCP) and Amazon Web Services (AWS) both offer VPCs, but they handle network scope, connectivity, and scaling in different ways. It’s important to know these differences when you’re building apps on these platforms. You might have heard often - “I know AWS - I

Build a Simple S3 Storage Browser in React

It’s almost impossible to build a meaningful web application without object storage these days. Often in our apps we require access to files on s3 bucket. Working with AWS S3 often requires building interfaces to provide secure and accessible ways for interacting with stored files. However, creating such interfaces

How We Leveraged Pydantic and Llama index for Data Extraction from unstructured files

Introduction Extracting information from PDF files is a common use case. Often we want to extract structured data from PDF files such as resumes, invoices, or reports. Extracting relevant information while maintaining a consistent structure is crucial for automation and further analysis. By leveraging LLMs and Pydantic, developers can transform

Django Lifecycle Hooks: A better alternative to signals

As developers, we often encounter scenarios where certain actions need to be performed whenever something happens to our models. Whether it’s adding new data, updating existing records, or deleting something from the database. For years, Django signals have been the go-to solution for handling these kinds of requirements. They’

All you need to know about Cloudflare tunnel

Introduction Imagine this: You're working on a cool new website or app on your computer, and you can’t wait to show it to a client or get some feedback from a team member. But here's the catch—you don’t want the hassle of setting

QB9: Your global bookmark on the internet

Ever been stuck searching for the right document or webpage, wasting time and energy clicking through tabs and folders? Picture this: you’re checking into a hotel, and the receptionist asks for your ID. It’s stored in your Google Drive, but after a frustrating few minutes of digging through

All you need to know about the Bottlerocket Operating System

Introduction Bottlerocket OS has been promoted by AWS for a while now. In fact it is the recommended default OS for EKS worker nodes. They also use the same OS for ECS as well. Although by design bottlerocket seems extremely promising but we are yet to see any official benchmark

Reduce Cost and Improve Security with Amazon VPC Endpoints

What If I Told You That You Could Reduce Your AWS Costs by Up to 90%? No, you’re not wrong—that’s entirely possible. For example, when working with S3 buckets, you can cut costs by as much as 90%. So, you might be wondering: what’s the secret

How to run Streamlit reliably in production using supervisor!

Streamlit is widely used by Python developers for rapid prototyping as well as running real production applications. Have you ever faced a situation where your Streamlit application suddenly stops working? Whether due to crashes or server issues. Most developers run streamlit using tmux or nohup - which work - but

Adding Authentication to Any App in Minutes using OAuth2 Proxy!

Introduction Imagine this—you've built an amazing application, but there's one problem: it doesn’t support authentication out of the box. Now you need to secure it without rewriting code or building a custom auth system. That’s where OAuth2-Proxy can help. It’s a straightforward

Jenkins or GitHub Actions? Deciding the Right CI/CD Tool for Your Workflow

Introduction Continuous Integration and Delivery is a key part of any software application. Be it a mobile app, a backend app or a website - everything requires CI/CD to make things easier for everyone. From testing and building code to deploying it across environments, CI/CD tools help simplify

Breaking free from Servers: Serverless RDBMS without the headaches

Introduction Sometimes, you might set up an RDS instance that gets queried only a few times a day. For example, QA instances used by testing teams during office hours often stay idle for the rest of the day, yet you still have to pay for the entire instance. This can

EKS Auto Mode launched recently - is it worth the hype?

Introduction Running Kubernetes in production can be hard. Even with the managed options Kubernetes isn’t a bed of roses. AWS recently launched EKS Auto Mode which aims to offload some pain. While the features offered by the auto mode can be useful, almost all of them were already used

How we use Airflow to optimize our DevOps workflow.

Introduction Apache Airflow is a powerful tool for automating workflows and managing complex processes effectively. In DevOps, tasks like token validation, Kubernetes configuration management, and updating secrets are often repetitive and time-consuming. With Airflow, we replaced manual work with automated workflows, saving time and reducing errors. We used chatgpt to

AWS KMS MasterClass - Secure AWS services using AWS KMS

In a world where data breaches and unauthorized access are just a news headline away, encryption isn't optional—it's a must-have. But here's the thing: encryption is only as good as the keys securing it. Imagine locking your most valuable belongings in a high-tech

Accelerate Django Development with Cookiecutter

As a Django developer, you’ve received a PRD to start building a brand-new product from scratch. Your first task? Project initialization and a deployment checklist. Sounds familiar, right? It's the same routine of configurations you’ve handled in your recent projects, just with a few tweaks for

Set Up EC2 Memory Monitoring with Amazon CloudWatch Agent and Terraform

Introduction Amazon EC2 is a widely used service for running applications in the cloud. Keeping track of its performance is important to make sure your applications run without issues. EC2 provides metrics like CPU usage and network activity by default. However, memory usage is not included, and this can be

Simplifying Secret Management in Kubernetes with AWS and External Secrets Operator

Managing sensitive information, like passwords and API keys, in Kubernetes can be challenging. You want to keep your secrets secure while still making them available to your applications. In this guide, we'll walk you through how to connect AWS Secrets Manager with your Kubernetes cluster using the External

Beyond the Basics: Tools That Make Kubernetes Management Effortless

Kubernetes is a powerful platform for container orchestration, but managing it effectively requires the right set of tools. These tools help to simplify tasks such as deploying applications, managing permissions, scaling services, and ensuring security. Let’s explore ten essential tools that can greatly simplify Kubernetes management. 1. Stern Stern

Loki vs. Elasticsearch: Choosing the Right Logging System for You

Logging systems are vital tools that help us understand what's happening inside our applications. They record events, errors, and other important information, making it easier to troubleshoot problems, monitor performance, and keep things running smoothly. In this post, we'll compare two popular logging systems: Grafana Loki

Integrating Slack Notifications into ArgoCD for Better Workflow

ArgoCD is a powerful tool for managing Kubernetes applications through GitOps principles, ensuring that your deployments are consistent and reliable. Slack, on the other hand, is a widely-used communication platform that enhances team collaboration. By integrating Slack with ArgoCD, you can receive real-time notifications about your deployment statuses directly in

Simplify Database Migrations and Management using Python with SQLAlchemy and Alembic

Consider a scenario where you’re building a user management system for a web application. Initially, you might only need to store simple details like names and emails. But as your application expands, so does your database’s complexity. You might want to add features such as user preferences, roles,

Build secure Internal applications: How to Integrate OAuth2 in Your Streamlit Apps

Streamlit makes it super easy to build apps superfast. But what if you want to add a simple login system that works with your company’s existing SSO, like Microsoft or Google? You can still build awesome internal tools fast while making sure only the right people have access. With

Streamlit in Production: How to Stream Logs to AWS CloudWatch

If you’re running a streamlit application in production, you might want to ship logs generated by it to cloudwatch. If you’re using ECS then it might be simple but if your have deployed your app on an EC2 instance or Kubernetes then it might not be that straightforward.

Streamlit Authentication Made Simple: Step-by-Step Guide

Streamlit can help us quickly build a fully functional web application. It’s really effective in prototyping as well as building full fledged internal apps. Recently we had a use case where we had a requirement of adding basic authentication in front of the streamlit app to prevent unauthorized access

Reduce docker image size from 1GB to 150mb | Method to optimize docker images

Docker makes it easy to package software, but if you're not careful, your images can get bloated. Big images mean slower downloads, delayed deployments, and longer startup times—nobody wants that. The main problem? We often add stuff we don't need: source code, build tools, and

The art of zero-downtime in kubernetes : Deployment Strategies

Introduction Imagine you're running a popular online service, and suddenly, during an update, your application goes down. Users can't access your service, and with each passing minute, you're losing revenue and customer trust. This scenario is every developer's nightmare. Downtime not only

How to Install Loki using helm!

In the previous blog, we covered everything about Loki, from its components to its architecture, explaining how it works and how it efficiently compresses logs. If you have not read the blog check it out here: https://www.kubeblogs.com/all-you-need-to-know-about-loki/ Now that you have a solid understanding of Loki’

All you need to know About Loki!

At KubeNine, we ensure that our customers log well and log right! Logs are crucial because they keep track of everything your applications do, from errors and warnings to user activities and system events. However, managing all these logs can take up a lot of resources and make it hard

Manage your kubernetes secrets securely, directly from the web browser!

Managing secrets in Kubernetes can be a real headache. If you've ever struggled with keeping environment variables secure and up-to-date across multiple clusters, I totally get it. Many of us have faced the hassle of manual secret management, and it's time we found a better way.

Why AWS should pre-install the EBS driver on EKS!

Introduction: I have been using EKS for over 3 years now and I have never understood why AWS decided not to have the EBS storage driver pre-installed on a new cluser. Storage is like oxygen - I never understood why something as basic as that shouldn’t be available pre-installed.

The Only Blog You’ll Ever Need to Master Kubernetes Health Checks

Introduction Kubernetes is one of the most powerful tools for orchestrating containerized applications. When it comes to healthchecks Kubernetes offers multiple options. Its very important to understand these healthcecks so that you can deploy a resilient and highly available application. Kubernetes healthchecks can be confusing. For most beginners, all the

How nginx-image-resizer Simplifies Image Handling for Your Web Apps

Images are a crucial part of any website. They make content more engaging and visually appealing. But if these images aren’t served fast, they can slow down your site and frustrate users. Imagine visiting a site where images take forever to load or don't display correctly on

How to Enhance Cloud Security Audits with Prowler: Step-by-Step Guide

Introduction I bumped across Prowler (https://github.com/prowler-cloud/prowler) when my team was looking for a tool using which we could write custom checks to ensure security of our account. Prowler is an open-source security tool designed to help you assess, audit, and improve the security of your AWS,

Use your own NAT Server to SAVE UPTO 40$ / MONTH

Introduction Setting up a Virtual Private Cloud (VPC) in AWS can be challenging, especially when you have services in both public and private subnets. Recently, I worked on a project that required exactly this. We had a mix of services, some accessible from the internet and others tucked away in

Use AWS Config to enforce compliance policies

What is AWS Config? Did you know you can track every change in your AWS account, enforce compliance, and spot issues before they become problems. AWS Config gives you the power to monitor and manage your resources, ensuring they’re secure and compliant. AWS Config helps you keep an eye

How does SAML Authentication Work?

Recently, I joined KubeNine as a DevOps engineer. As part of the onboarding process, I received a work email and access to a company dashboard that provides links to all the tools I need. This dashboard is crucial because it connects me to the various services we use, such as

Why should you consider running your own in-house RPC Node?

As the blockchain ecosystem continues to change with every passing day, the need for a simple and reliable infrastructure becomes more crucial. One way to achieve this is by running your own in-house RPC (Remote Procedure Call) node. Having your own RPC node ensures that you have faster access to

Self-Hosted GitHub Actions Runner on Kubernetes Using Helmfile

Introduction When it comes to automating your CI/CD pipelines, GitHub Actions is a great tool. But what if you want more control over your environment? That's where a self-hosted GitHub Actions runner comes in. Self-hosted github actions runner allows you to run the builds inside your infrastructure,

Ensuring Zero Downtime: A Guide to Pod Termination in Kubernetes

Introduction Just as Kubernetes smoothly handles pod creation, it also manages pod termination to achieve zero downtime. Consider an application running with 20 pods during peak times but scaling down to 2 pods during low traffic periods due to the minimum replica count being set to 2. While it might

AWS Instance Metadata Service v2 can cause outages. Make sure you are safe!

Introduction Recently AWS switched to IMDSv2 as the default for EC2 instances (Amazon EC2 Instance Metadata Service IMDSv2 by default | Amazon Web Services) . This change, which was meant to improve security, ended up causing quite a bit of trouble for a lot of AWS Clients who had been using old

Apache Airflow Use Cases for DevOps Engineers

Introduction Apache Airflow is a powerful orchestration tool primarily used by data engineers. However, its capabilities can significantly benefit DevOps engineers as well. By using Airflow, DevOps engineers can automate complex workflows and automate various infrastructure use cases. Airflow as a platform is useful for developing, scheduling and monitoring batch-oriented

Configure Azure AD OAuth2 authentication for Grafana using Helmfile

Introduction Azure AD OAuth2 authentication allows Grafana to use Azure Active Directory (Azure AD) as an identity provider. This means users can log in to Grafana using their Azure AD credentials. The authentication process involves several steps to ensure secure access. How it works: 1. User Requests Access: When a

How to setup an NGINX Ingress with cert-manager using Helmfile

In this blog, we will explain how to set up your NGINX Ingress with a TLS/SSL certificate using Helmfile. The traditional methods, involve multiple steps and manual configurations, can be time-consuming and error-prone. for this demo, we are using the domains grafana-ai.takemetoprod.com and Nginx as load balancers.

Explore all the new features in Kubernetes 1.30

Kubernetes 1.30, nicknamed "Uwubernetes," marks the first release of 2024. This release brings 45 enhancements, including 10 new or improved Alpha features, 18 Beta features enabled by default, and 17 features graduating to Stable. The name "Uwubernetes" combines Kubernetes with "Uwu," an emoticon

How You can Automate PostgreSQL Backups to S3 Using Apache Airflow!

Introduction Managing database backups manually can be time-consuming and prone to errors. As a DevOps Engineer you're often tasked with managing multiple databases.Organizations need a reliable and automated method to regularly back up their databases securely. Apache Airflow offers a solution to this problem by providing a

Resize Images at Scale without breaking a sweat!

Introduction Handling images at scale can be challenging — especially when you need to serve them in different resolutions and formats. Traditional methods often involve batch processing to asynchronously process and store the images, which is time-consuming and inefficient. But there’s a better way, which saves a lot of time

Simplify Your Deployments with Keel.sh: Why GitOps Might Not Be the Best Fit

Introduction While GitOps has gained popularity for managing infrastructure and applications, Keel.sh offers a simpler and more streamlined alternative for your deployment processes. This article explores the benefits of Keel.sh and why GitOps might not always be the best fit for your needs. Understanding Keel.sh What is

Why Use Amazon RDS Instead of a Database on EC2?

You’ve decided to move your applications from on-premises to AWS and are looking at the cloud services that best meet your needs. When moving an application with a relational database like Oracle, MySQL, or SQL Server to the cloud, you'll face the choice between Amazon RDS and

Point-In-Time Recovery (PITR) in Modern Relational Databases

Introduction Have you ever accidentally deleted important data from your database? Or made changes that you wish you could undo? Point-In-Time Recovery (PITR) can save the day! This feature in the modern-day DBMS system lets you restore your database to any point in time within a certain period. Let'

Global VPC - how is it different from AWS

Introduction Virtual networking stack offered by GCP is fundamentally different from AWS. While AWS got stuck with their initial design, GCP got time to learn from their mistakes and build a well thought VPC system that supports interconnectivity across regions by default. In this blog we're going to

Pod Disruption Budgets: Why They Matter and How to Use Them to Avoid Downtime

Kubernetes pods are the smallest units you can deploy on the Kubernetes platform. Each pod represents a single running process and operates from a node or worker machine within Kubernetes, which can be either virtual or physical. Sometimes, Kubernetes pods might get disrupted, either voluntarily or involuntarily. This is more

Pydantic: Fast and Pythonic Data Validation for Your Python Applications

In any application, ensuring that the data you’re working with is valid and well-formed is a critical part of ensuring that the application runs smoothly and reliably. In Python, there are many libraries available for data validation, but one that stands out for its ease of use, performance, and

A Deep Dive into Iptables: From Zero to Hero in One Blog Series

What is iptables? Iptables is a command-line utility for configuring the firewall rules of the kernel’s netfilter framework. It allows system administrators to filter and manipulate incoming, outgoing, and forwarded network packets based on various criteria such as IP addresses, ports, protocols, and packet states. Iptables explained to a

Simplifying Garbage Collection: Python’s Winning Strategy Against Java

Introduction The way Python handles garbage collection is miles apart from how Java does it. The approach taken by each of these languages impacts the performance and ease of use in multiple ways. In the world of programming, memory management is a critical aspect that can significantly impact the performance