Senior Data Engineer for Analytics Feed Build Workstream

Harbor Softworks

Contract · Remote · Flexible hours

About the role

Harbor Softworks is driving a security hardening initiative for its suite of cloud‑hosted applications. As a Senior Data Engineer you will lead the redesign of data pipelines to embed encryption, access controls, and audit logging while ensuring high‑performance analytics. The work focuses on the new "Sentinel Sync" module that consolidates logs and metrics across AWS services.

Key responsibilities

• Architect and implement end‑to‑end data pipelines in Python using Apache Airflow to ingest security logs from S3, CloudTrail, and GuardDuty.
• Design encrypted data stores in PostgreSQL and MySQL, applying column‑level encryption and IAM‑based access policies.
• Build automated data quality checks and anomaly detection jobs that trigger alerts in Slack and PagerDuty.
• Collaborate with the Cloud Security team to integrate AWS KMS key rotation and secret management into ETL workflows.
• Deliver a proof‑of‑concept dashboard in Amazon QuickSight showcasing compliance metrics within 4 weeks.
• Document pipeline architecture, security controls, and hand‑off procedures for future maintenance.

Must-have skills

• Strong Python programming for data engineering.
• Deep experience with PostgreSQL and MySQL schema design and security features.
• Proficiency in AWS services (S3, KMS, IAM, CloudTrail, GuardDuty, QuickSight).
• Hands‑on with Airflow or similar orchestration tools.
• Understanding of data encryption, masking, and audit logging.

Nice to have

• Familiarity with Terraform for infrastructure as code.
• Experience building real‑time streaming pipelines with Kafka or Kinesis.