Senior CI/CD Pipeline Engineer – Infrastructure Setup

Northbay Systems

Freelance · Remote · Flexible hours

About the role

We are building a robust data pipeline and analytics platform to empower operations teams with real‑time insights. The CI/CD Pipeline Engineer will design, implement, and maintain automated delivery pipelines that support data ingestion, transformation, and reporting workloads.

Key responsibilities

• Architect end‑to‑end CI/CD workflows for data pipelines on AWS.
• Containerize ETL components using Docker and orchestrate with Kubernetes.
• Integrate automated testing, linting, and security scans into pipelines.
• Monitor pipeline health, troubleshoot failures, and continuously improve performance.
• Collaborate with data engineers and analysts to align deployment processes with analytics requirements.

Must-have skills

• 5+ years building CI/CD systems for data‑intensive applications.
• Deep expertise in Docker, Kubernetes, and AWS services (ECS, CodePipeline, S3, Lambda).
• Strong scripting skills (Python, Bash) for pipeline automation.
• Proven experience with version control, IaC, and monitoring tools.

Nice to have

• Experience with Apache Airflow or similar workflow managers.
• Knowledge of data lake architectures and analytics tooling.
• Familiarity with security best practices in CI/CD pipelines.