Lead Big Data Architect Needed for Reporting Dashboard

DataPro Services

Contract · Flexible hours

About the role

DataPro Services is seeking a seasoned Big Data Architect to lead the design and implementation of a scalable data platform for a high‑growth analytics initiative. The role focuses on building end‑to‑end pipelines, optimizing storage, and ensuring robust data governance across cloud environments.

Key responsibilities

• Architect and implement a modern data lake and warehouse on AWS.
• Design data ingestion pipelines using streaming and batch processing.
• Define data models, partitioning strategies, and indexing for performance.
• Establish best practices for data security, compliance, and lifecycle management.
• Collaborate with data scientists and engineers to translate business requirements into technical solutions.
• Mentor junior team members and conduct code reviews.

Must-have skills

• Extensive experience with Hadoop, Spark, and Kafka.
• Deep knowledge of AWS services (S3, Redshift, EMR, Glue).
• Proficiency in Python for data processing and orchestration.
• Strong SQL expertise, particularly PostgreSQL.
• Containerization using Docker and orchestration concepts.

Nice to have

• Familiarity with Terraform or CloudFormation.
• Experience with real‑time analytics dashboards.