Senior Data Engineer – Query Optimization

BlueSky Ventures

Contract · Flexible hours

About the role

BlueSky Ventures seeks a senior Data Engineer to design and implement a high‑performance data pipeline for a new analytics platform. The project focuses on ingesting, transforming, and loading large‑scale transactional data into a unified warehouse.

Key responsibilities

• Architect end‑to‑end ETL processes using Python and Airflow.
• Build and optimize data models in PostgreSQL and MySQL.
• Implement data quality checks and monitoring.
• Integrate AWS services such as S3, Redshift, and Lambda.
• Collaborate with data scientists to ensure schema compatibility.
• Document pipeline design and maintain technical specifications.

Must-have skills

• Advanced Python programming for data processing.
• Deep experience with PostgreSQL and MySQL databases.
• Proficiency in AWS data services (S3, Redshift, Lambda).
• Strong understanding of ETL design patterns and data warehousing.
• Ability to write efficient SQL queries and optimize performance.

Nice to have

• Familiarity with containerization (Docker) for deployment.
• Experience with streaming platforms like Kinesis.