We are seeking an experienced and highly skilled Senior Data Engineer to join our dynamic team. In this role, you will lead the design, development, and optimization of scalable, reliable, and secure data pipelines and infrastructure. With a deep understanding of data systems and a proven track record in the field, you will collaborate with cross-functional teams to drive innovation and support the organization’s data-driven initiatives.
Data Pipeline Leadership: Design, develop, and maintain highly scalable, reliable, and secure data pipelines and ETL processes.
Cloud Infrastructure Expertise: Architect and implement advanced cloud-based data infrastructure to meet organizational goals.
Collaboration: Collaborate with product teams, software engineers, and stakeholders to define data requirements and deliver robust solutions.
Data Optimization: Optimize data storage solutions, including data lakes, data warehouses, and databases, ensuring high performance and scalability.
Automation and Orchestration: Lead the automation and orchestration of data ingestion, transformation, and processing workflows.
Monitoring and Troubleshooting: Proactively monitor, troubleshoot, and resolve complex issues in production data pipelines and systems, ensuring maximum uptime and efficiency.
Mentorship: Provide technical guidance and mentorship to junior team members to foster professional growth and enhance team performance.
Minimum of 10 years of professional experience in data engineering or a related field.
Proven expertise in designing and maintaining data pipelines and ETL processes at scale.
Advanced knowledge of cloud platforms (e.g., AWS, Azure, GCP) and their data-related services.
Deep experience with data storage technologies, including data lakes, data warehouses, and relational databases.
Proficiency in data processing frameworks (e.g., Apache Spark, Hadoop) and orchestration tools (e.g., Apache Airflow, Prefect).
Strong programming skills in languages such as Python, Scala, or Java.
Advanced proficiency in SQL and database performance optimization.
Familiarity with monitoring and troubleshooting tools for large-scale data systems.
Exceptional problem-solving skills with a keen attention to detail.
Outstanding communication and leadership skills with a collaborative mindset.
Hands-on experience with real-time data streaming frameworks (e.g., Kafka, Kinesis).
Comprehensive knowledge of data governance, compliance, and security best practices.
Familiarity with machine learning workflows and integration.
Prior experience in mentoring and leading technical teams.