Lead Big Data Architect Needed for ETL Workflow Build

AlphaEdge Tech

Contract · Flexible hours

About the role

We are seeking a seasoned Big Data Architect to design and implement a scalable data platform that supports advanced analytics across the organization. The role focuses on building end‑to‑end pipelines, optimizing storage, and ensuring high performance for massive data sets.

Key responsibilities

• Design and architect a modern data lake and warehouse on cloud infrastructure.
• Develop robust ETL/ELT pipelines using Python and orchestration tools.
• Implement data modeling standards and enforce best practices for data quality.
• Collaborate with data scientists and engineers to enable self‑service analytics.
• Optimize query performance and cost efficiency on AWS services.
• Provide technical guidance and documentation for ongoing maintenance.

Must-have skills

• Extensive experience with big data technologies (e.g., Spark, Hadoop).
• Proficiency in Python for data processing and automation.
• Deep knowledge of AWS services such as S3, Redshift, and EMR.
• Strong SQL expertise, particularly PostgreSQL.
• Containerization using Docker and orchestration concepts.

Nice to have

• Familiarity with streaming platforms like Kafka.
• Experience with infrastructure as code (Terraform, CloudFormation).