Purpose of the Role
We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Aside from strong programming skills, we are looking for a true back-end and data engineer with a strong understanding of databases and infrastructure requirements.
Duties and Responsibilities
- Build and maintain data pipelines using Python, handle huge amounts of data in different storage tools
- Process massive amounts of data in short bursts and find solutions to time-sensitive problems that can arise
- Troubleshoot data quality issues and perform the necessary fixes/backfills
- Enhance the codebase to fix bugs, add and document features
- Participate and collaborate in daily scrum meetings, sprint planning, reviews, and retrospective meetings
Required Experience & Knowledge
- Strong experience working with Python in big data environments
- Hands-on experience using Terraform
- Good knowledge of SQL, along with experience performing queries, infrastructure knowledge
- Deep experience with GCP tools and experience choosing the proper tool for storage
- Experience creating infrastructures that must handle big-data throughputs, scale and be time and cost efficient
Skills and Attributes
- Good written and verbal communication skills
- Self-motivated, curious person with good time management skills
- Ability to learn technical concepts and communicate with multiple functional groups
- Team up with the professionals in multicultural virtual work environment
- Strong troubleshooting skills and high attention to detail
Required Education & Qualifications
- Advanced level of both spoken and written English language
- Bachelor’s or Master’s degree in Computer Science or relevant experience
- Any relevant certificate would be considered a plus
