Recently I was tasked to build a system that would automatically deploy pipelines using Kubeflow and Pachyderm. This system needed data versioning to make sure that results were reproducible in the future. Data versioning, or DVC can be summed up in these diagrams Data Versioning Control (DVC) has many features. […]
In a recent project I was given the chance to design a robust and scalable pipeline for Drug labeling. In current pharmaceutical practice, the drug labeling process of taking technical documents and distilling them down to human readable labels to attach to medication is a tedious and time consuming process. […]
The amount of data that is generated and recorded in the world has been growing exponentially in the past 10 years and will continue to grow in the coming future. In 2010 the amount of data in the world was estimated to be 2 Zettabytes, and by May 2020 this […]
I was tasked to build a sample inferencing machine model that would be able to process a sample array of inputs and infer based upon these inputs the identity of a sample given. To begin I wanted to attempt to start this model from scratch on a T2 Micro AMI […]