Role Name: Data Engineer
Engagement Type: Contractual
Project Duration: 6+ Month Extendable
Location: Pune
Shift Timing: General Shift
Job Overview:
The Data Engineer will be responsible for building and maintaining scalable and robust data pipelines that transform raw data into usable formats for analytics and business decision-making.
Key Responsibilities:
- Data Pipeline Development: Design, Construct, and maintain scalable ETL pipelines using tools like Azure Data Factory.
- Stakeholder Collaboration: Work closely with technical teams and business stakeholders to understand data requirements.
- Data Analysis & Modeling: Analyze data patterns, apply data modeling best practices (including Star, Schema), and ensure quality metadata management.
- Delivery & Innovation: Follow industry best practices in delivery and identify areas for innovation and improvement.
- Problem Solving: Address issues in data flow, integration, and performance.
Required Technical Skills:
- Azure Technologies:
- Azure Data Factory
- Azure Storage Accounts
- ETL Development: End-to-end data transformation processes.
- SQL Expertise:
- SQL performance tuning
- Query optimization
- Indexing
- Data warehousing with SQL
- Data Modeling:
- Star Schema design
- Conceptual and logical data models
- Metadata Management and unit testing practices for quality assurance.
Experience Required:
- Relevant 5+ years of hands-on experience in Data Engineering projects.