Lead Big Data Architect for Analytics Feed Build

CloudWave Digital

Contract · Flexible hours

About the role

CloudWave Digital is building a high‑performance mobile backend to support its upcoming app store launch. As a Big Data Architect you will design the data platform that powers the Nimbus Sync module, ensuring seamless alignment between mobile ingestion pipelines and backend analytics. This role focuses on scaling data flows, optimizing storage, and delivering real‑time insights for the new app ecosystem.

Key responsibilities

• Architect end‑to‑end data pipelines using Apache Spark and Kafka to ingest mobile event streams for the Nimbus Sync module.
• Design and implement a columnar data lake on Amazon S3 with partitioning strategies that support low‑latency mobile queries.
• Create Terraform scripts to provision AWS Redshift clusters and configure security groups for mobile‑backend communication.
• Establish CI/CD workflows with Docker and GitLab CI to automate schema migrations and data validation tests.
• Define data governance policies, including data masking and audit logging, to meet compliance for app store data.
• Collaborate with mobile engineers to benchmark ingestion latency and iterate on performance tuning milestones.

Must-have skills

• Deep expertise in designing scalable big‑data architectures on AWS.
• Proficiency with Spark, Kafka, and Redshift for real‑time processing.
• Strong Python programming for ETL orchestration and data modeling.
• Experience with Terraform or CloudFormation for infrastructure as code.
• Solid understanding of data security, encryption, and compliance frameworks.

Nice to have

• Knowledge of mobile analytics platforms such as Firebase or Mixpanel.
• Familiarity with Kubernetes for container orchestration.