Senior Data Engineer Needed for ETL Workflow Build Sprint

Vertex Analytics

Contract · Remote · Flexible hours

About the role

Vertex Analytics is building a next‑gen data validation platform called "PulseGuard" to safeguard product launches. As a Senior Data Engineer you will lead a test‑automation uplift, creating pipelines that automatically verify data quality and reduce regression risk before release.

Key responsibilities

• Design and implement end‑to‑end ETL tests in Python using pytest and Great Expectations for the PulseGuard module.
• Build CI/CD integration on AWS CodePipeline to trigger data regression suites on every code merge.
• Develop reusable data mock generators in PostgreSQL and MySQL to simulate production workloads.
• Collaborate with QA and product owners to define regression acceptance criteria and success metrics.
• Document test frameworks, create dashboards in CloudWatch for real‑time failure alerts.
• Deliver a proof‑of‑concept test suite within the first 4 weeks and iterate based on stakeholder feedback.

Must-have skills

• Advanced Python programming for data pipelines and test automation.
• Strong experience with PostgreSQL and MySQL schema design.
• Proficiency in AWS services (S3, Lambda, CodePipeline, CloudWatch).
• Hands‑on knowledge of data testing frameworks such as Great Expectations or dbt tests.
• Ability to write clean, modular code and maintain version control in Git.

Nice to have

• Familiarity with container orchestration (Docker, Kubernetes) for test environments.
• Experience with data lineage tools like Apache Atlas.