Senior Data Engineer
Indium
Full-time
On-site
Bangalore North, Karnataka, India
Senior Jobs
<\/p>
Job Description:
<\/div>
<\/div>
We are looking for a highly skilled Senior Data Engineer to design, build, and optimize large -scale data pipelines and distributed data processing systems. The ideal candidate should have strong hands -on experience across Python, Spark, SQL, and modern data engineering frameworks, along with the ability to work in a fast -paced, collaborative environment.
<\/div>
<\/div>
<\/p>
<\/p>
Key Responsibilities:
<\/div>
<\/div>
â Design, develop, and maintain scalable and reliable ETL/ELT data pipelines.
<\/div>
<\/div>
â Work with large datasets using Python, Spark, SQL, and distributed data systems.
<\/div>
<\/div>
â Build and optimize workflows leveraging Hadoop ecosystems and big data frameworks.
<\/div>
<\/div>
â Implement data quality checks, validation frameworks, and performance tuning.
<\/div>
<\/div>
â Integrate data from multiple sources and ensure efficient data flow across systems.
<\/div>
<\/div>
â Collaborate with Product, Analytics, and Engineering teams to understand data needs.
<\/div>
<\/div>
â Work with Airflow (preferred) for workflow orchestration and scheduling.
<\/div>
<\/div>
â Deploy and maintain data solutions on any cloud platform (AWS/GCP/Azure preferred).
<\/div>
<\/div>
â Troubleshoot pipeline issues, perform root -cause analysis, and improve reliability.
<\/div>
<\/div>
â Ensure adherence to data governance, security, and best engineering practices.
<\/div>
<\/div>
<\/p>
<\/p>
Required Skills:
<\/div>
<\/div>
â Strong expertise in Python, Spark, SQL
<\/div>
<\/div>
â Experience with Hadoop or other distributed processing systems
<\/div>
<\/div>
â Hands -on experience with any cloud platform (preferred)
<\/div>
<\/div>
â Familiarity with Airflow or similar orchestration tools
<\/div>
<\/div>
â Solid understanding of data warehousing, ETL concepts, and data modeling
<\/div>
<\/div>
â Excellent problem -solving, debugging, and optimization skills
<\/div>
<\/div><\/span>
<\/div>
<\/p>
<\/div><\/span>