Lead Big Data Architect Needed for Analytics Feed Build

Summit Digital

Contract · Remote · Flexible hours

About the role

Summit Digital is launching a greenfield SaaS platform called AuroraStream, a real‑time analytics hub for remote teams. As the Big Data Architect you will define the data foundation, ensuring scalability, security, and low‑latency insights for this new product.

Key responsibilities

• Design and implement the end‑to‑end data lake on AWS S3 with partitioning strategies for multi‑tenant isolation.
• Architect a streaming pipeline using Apache Kafka and Flink to ingest telemetry from over 10,000 concurrent users.
• Create a reusable Terraform module library for data infrastructure provisioning and CI/CD integration.
• Lead the selection and tuning of a columnar store (Amazon Redshift) for analytical workloads, optimizing query performance for dashboards.
• Establish data governance policies, encryption at rest, and role‑based access controls across all layers.
• Mentor a small team of data engineers, reviewing code, and setting standards for Docker‑based development environments.

Must-have skills

• Deep expertise in designing cloud‑native data architectures on AWS.
• Proficiency with Kafka, Flink, and Spark for real‑time processing.
• Strong SQL and data modeling skills, especially with PostgreSQL and Redshift.
• Extensive experience containerizing data services with Docker and orchestrating via Kubernetes.
• Python programming for ETL, automation, and custom data pipelines.

Nice to have

• Familiarity with dbt for transformation management.
• Experience building data catalogs using AWS Glue or Apache Atlas.