INFLATION! How does an employee gauge their worth? how does an individual negotiate a salary? The federal reserve has calculated that this year’s inflation is 7.5% 8.5%, does this mean that an 8.5% raise is a 0% raise? Should wages be compared with Gold? cryptocurrency? or my personal unit of […]
Elastic Kubernetes service (EKS) is an AWS service that provides users with a fully-managed Kubernetes control plane. microservices and containerized applications are becoming ubiquitous tools that most cloud engineers look towards for development and deployment. Kubernetes allow organizations the option of deploying portable and cloud-agnostic architectures. One of the major […]
Driveworks is Nvidias software devleopment platform for autonomous vehicles. Driveworks is designed to work with the Nvidia AGX platform. the one unique problem I have seen with Autonomous vehicles is the balance between data ingestion and inference. Equipment attached to fleet vehicles can come from multiple different types of manufacturers […]
When deploying to EKS did you know that each EC2 instance has a habit of taking way too many IP addresses? take this P2.Xlarge, this instance alone was responsible for reducing my available IP address pool by 10 IPs! Because of this issue, there is a long complex and ardous […]
Kustomize This section reviews a tool called Kustomize that allows easy modifications to configurations, this section can be skipped. Kustomize is a program that will be utilized to modify kubeflow’s installation and can be used to configure certain parameters surrounding Authentication and Authorization. Kustomize utilizes a manifest file that is provided by […]
Recently, I was exploring how to access remote file structures using Vscode. I was informed by a colleague of a tool that will allow a programmer to edit files on a remote terminal using the VScode GUI interface. I have provided a writeup on how to install this program on […]
Recently I was tasked to build a system that would automatically deploy pipelines using Kubeflow and Pachyderm. This system needed data versioning to make sure that results were reproducible in the future. Data versioning, or DVC can be summed up in these diagrams Data Versioning Control (DVC) has many features. […]
In a recent project I was given the chance to design a robust and scalable pipeline for Drug labeling. In current pharmaceutical practice, the drug labeling process of taking technical documents and distilling them down to human readable labels to attach to medication is a tedious and time consuming process. […]
I was recently tasked with installing a batch scheduler to a an HPC cluster for a genomics research lab. The program that needed to be installed was called “Son of Grid Engine” HPC systems usually will need some sort of orchestration program to distribute tasks within a shared pool of […]
Last month I have completed the majority of the Complete SQL boot camp. I wanted to learn the details about the SQL language to expand my ability to perform manual ETL functions in python. In my past posts I explained how I was able to run simple ETL scripts using […]