I was recently tasked with installing a batch scheduler to a an HPC cluster for a genomics research lab. The program that needed to be installed was called “Son of Grid Engine” HPC systems usually will need some sort of orchestration program to distribute tasks within a shared pool of […]
Last month I have completed the majority of the Complete SQL boot camp. I wanted to learn the details about the SQL language to expand my ability to perform manual ETL functions in python. In my past posts I explained how I was able to run simple ETL scripts using […]
The amount of data that is generated and recorded in the world has been growing exponentially in the past 10 years and will continue to grow in the coming future. In 2010 the amount of data in the world was estimated to be 2 Zettabytes, and by May 2020 this […]
I was tasked to build a sample inferencing machine model that would be able to process a sample array of inputs and infer based upon these inputs the identity of a sample given. To begin I wanted to attempt to start this model from scratch on a T2 Micro AMI […]
I was recently given a data Challenge to complete, I was tasked to use python to install and configure multiple databases and perform an ETL pipeline between both. To Begin I launched T.2 Micro Linux AMI Instance and installed Mysql along with MongoDB, the CLI commands can be seen below […]
After finishing the Moodle site for my non-profit, I wanted to take a look at the WordPress site https://www.phillymosque.com. I read online that WordPress’s most recent update broke jQuery thus preventing me from editing or adding posts. I will need to update the old theme we have to a newer […]
Due to a request from my non-profit organization I revisited the Moodle issue. I was able to have the ec2 instance connect to the proper data folders in the EFS system. I have a clarification about the permissions required from my previous post. It is important that permissions be copied […]
I understand that abstracting action through a CLI can be daunting for some but nothing can match the efficiency and granular control of CLI commands. In my previous attempts to migrate my database, I was having difficulty using MySQL workbench. After some time pondering the issue, I concluded that the […]
Today I completed my exploration into making my architecture more stateless. I have a WordPress page that I have decided to use as a sample and experimented with different AWS solutions that allow this website to be launched independent of a local database or local file storage. Through MySQL workbench […]
Today I explored aurora serverless, I am currently working on migrating a website database to more available architecture. I started off by creating a serverless database and attempting to connect using a local MySQL program. After multiple attempts I realized that it was not working. I troubleshooted this issue over […]