Lead Data Engineer
GTS .We are seeking an experienced Lead Data Engineer to design, build, and optimize large-scale data solutions. This role involves working with modern cloud and big data technologies to enable data-driven decision-making, while leading initiatives that ensure scalability, reliability, and efficiency.
Key Responsibilities
Lead the design and deployment of scalable data processing solutions on AWS using Java and Spark.
Architect and implement big data pipelines with Apache Spark on AWS EMR.
Develop and deploy serverless applications using AWS Lambda and integrate with other AWS services.
Manage containerized applications with Amazon EKS for microservices orchestration.
Design and implement workflow orchestration with Apache Airflow for complex data pipelines.
Collaborate with cross-functional teams to ensure data solutions meet business needs.
Mentor junior engineers and drive best practices in data engineering.
8–12 years of experience in data engineering with leadership responsibilities.
Strong expertise in AWS (EMR, Lambda, EKS) and big data technologies (Java, Spark).
Hands-on experience with Apache Airflow for workflow orchestration.
Strong problem-solving and architectural design skills.
Excellent communication and leadership abilities.
Ability to thrive in hybrid working environments.