Published inDevOps Engineer, Software Architect and Software Developering·4 days agoMember-onlyEnable the Virtual GPU device plugin in AWS EKS and create test training with PyTorchWe all know GPU nodes on AWS can cost a high amount of dollars, so when we speak AWS EKS why not add this GPU node directly into your cluster and slice the GPU into smaller pieces so more people can use the same GPU or send pieces of training…Mlops3 min readMlops3 min read
Published inDevOps Engineer, Software Architect and Software Developering·Nov 16Save easily 200$ a month using Rclone vs AWS DataSync for scheduling data sync, build your own data transfer Docker image using RcloneBack in time, I created some FTP and SFTP sync services written in Python, long before my pieces of knowledge hit Rclone, because the price for data sync services is normally expensive why I don’t know eg. AWS DataSync costs around 200$ a month, to take data from a source…Rclone3 min readRclone3 min read
Published inDevOps Engineer, Software Architect and Software Developering·Nov 15Monolith vs MicroservicesThis battle has been on for years if you ask some dinosaur developers they will say Microservices is a buzzword and costs too much developing time, the architecture will be too complex to work and how need scaling when we can add more CPU and memory to the server and…Microservices3 min readMicroservices3 min read
Published inDevOps Engineer, Software Architect and Software Developering·Nov 15The story of why do I replace Flask with FastAPI for microservices?All stories start someplace, in this place it starts back in time when I was not better than a developer in PHP and jQuery before Node got hot! I have spent much time in general over the past 10 years writing and deploying microservices, in the beginning, I deployed microservices…Fastapi2 min readFastapi2 min read
Published inDevOps Engineer, Software Architect and Software Developering·Nov 1Member-onlyReduce your cost by increasing the maximum pods on the AWS EKS cluster up to 110 pods on m7i.large instancesI will start to make a small Kubernetes cost update, I have found the limit of pods on eg. m7i.large is 29, and that's why a previous article recommended a 2xlarge instance to have CPU and memory to spin up 56 pods on an EC2 instance, but then I found…Kubernetes3 min readKubernetes3 min read
Published inDevOps Engineer, Software Architect and Software Developering·Oct 2Member-onlyDeploy FluxCD with Helm and Manifest inside your AWS CDK — Infrastructure as CodeOne of my learning using Flux is that when you manage more than one Kubernetes cluster and are using FluxCD and install it from the Flux CLI and not from Helm, it makes it very hard to see the difference between your Kubernetes clusters, and when everything is automatically deployed…AWS3 min readAWS3 min read
Published inDevOps Engineer, Software Architect and Software Developering·Sep 18Member-onlyUse a single load balancer for multi sub-domains in AWS EKS (Kubernetes) ingress rule and reduce the costOne of the most frustrating problems using AWS EKS and the AWS Load Balancer controller is the cost of a Load Balancer when using Ingress for a domain and sub-domains. What I will explain here is a way around that problem and save you $20+ for each Ingress you are…AWS3 min readAWS3 min read
Published inDevOps Engineer, Software Architect and Software Developering·Sep 6Member-onlyHow to secure your Kubernetes cluster traffic and network with Cilium on AWS EKS help from AWS CDK — Infrastructure as CodeWhat you need is a running cluster on AWS EKS with min. 2 nodes inside a single node group, It should be running Kubernetes v1.27, I will use Cilium v1.14.1 …Kubernetes2 min readKubernetes2 min read
Published inDevOps Engineer, Software Architect and Software Developering·Sep 4Member-onlyDeploy MetaFlow to AWS with Terraform — Infrastructure as CodeBased on my previous MetaFlow articles, I think it will be helpful for you to deploy it on AWS to get up and running locally and use MetaFlow. First, be sure you use Terraform 1.5.6 or newer, it's what I used to deploy in this article, then have a domain…Terraform2 min readTerraform2 min read
Published inDevOps Engineer, Software Architect and Software Developering·Aug 30Member-onlyDifference between Sidecar Service Mesh or Sidecarless Service Mesh in KubernetesIf you using Istio or Linkerd as your Sidecar proxy as your Service Mesh inside your Kubernetes cluster you think why not keep what working as it always does, It is normal to think that, and the benefit of using a Service Mesh with eBPF there gives you a Sidecarless…Service Mesh4 min readService Mesh4 min read
