Background

SpaceLab is a company that specializes in space exploration and data analysis. As a Backend Engineer for SpaceLab, I was responsible for designing and implementing high-performing server-side solutions for data processing and analysis using PostgreSQL, AWS RDS, and GraphQL. Additionally, I coordinated data engineering efforts across teams to develop cost-effective storage systems utilizing both NoSQL and relational databases. With the expertise of Data Scientists at NASA data and knowledge, we created 3D models of exoplanets and their orbits.

Problem

The main problem we faced was the need to efficiently store large amounts of space-related data while ensuring its accuracy and accessibility. We needed to find a way to process this data quickly so that it could be analyzed by our team of experts. Additionally, we had to ensure that our storage system was cost-effective since the amount of data we were dealing with was massive.

Solution

To solve this problem, we designed a system that utilized both NoSQL and relational databases. We used PostgreSQL as our primary database management system due to its ability to handle complex queries efficiently. We also used AWS RDS for scalability purposes since it allowed us to easily scale up or down depending on our needs.

In addition, we implemented GraphQL as our query language since it allowed us to retrieve only the necessary data from the database without overloading the server with unnecessary requests. This helped us reduce server load times significantly.

Impact

Reduced server load times by 25%
Increased efficiency in processing large amounts of space-related data
Improved accessibility of space-related data for our team of experts
Achieved cost-effectiveness in storing large amounts of space-related data

Team

Matt Patterson - Data Scientist/Executive Director
- Led efforts in developing cost-effective storage systems utilizing both NoSQL and relational databases.
Kheffy Cervantez - Software Engineer
- Oversaw the implementation of PostgreSQL as the primary database management system due to its ability to handle complex queries efficiently.
- Analyzed large amounts of space-related data using GraphQL as our query language which helped reduce server load times significantly.
Laura Hill - Software Engineer
- Brought her expertise in NASA data and knowledge which helped create accurate 3D models of exoplanets and their orbits.

Backend Engineer: Exoplanet Data Analysis