DescriptionThis role is for one of the Weekday's clients
Salary range: Rs 1600000 - Rs 2000000 (ie INR 16-20 LPA)
Min Experience: 3 years
Location: Bangalore
JobType: full-time
We are seeking an experienced and results-driven Data Engineer to join our dynamic team. This role is ideal for professionals with 3–5 years of experience in data engineering, particularly within the manufacturing, logistics, and transportation domains. The ideal candidate will bring strong expertise in building and optimizing data pipelines, enabling analytics solutions, and leveraging modern data architectures to drive business insights. A background in consulting will be considered an added advantage, given the need to collaborate with diverse stakeholders and deliver scalable data-driven solutions.
RequirementsKey Responsibilities
- Data Pipeline Development: Design, build, and maintain robust ETL/ELT processes to ingest, transform, and integrate data from multiple sources into the enterprise data platform.
- Data Architecture: Implement solutions based on Medallion Architecture, ensuring scalability, security, and performance across data layers (bronze, silver, gold).
- Cloud Enablement: Utilize the AWS stack (e.g., S3, Glue, Lambda, Redshift, EMR) to manage data workflows, optimize performance, and deliver cost-efficient solutions.
- Data Modeling: Develop logical and physical data models that support analytics, reporting, and operational use cases.
- Programming & Frameworks: Leverage Python and PySpark for data processing, transformation, and automation.
- Database Management: Work with both SQL (MySQL) and NoSQL databases, ensuring efficient querying, indexing, and storage design.
- Analytics & Reporting Support: Partner with business analysts and data visualization specialists to deliver insights using Power BI and other BI tools.
- Quality & Governance: Implement data validation, monitoring, and governance practices to ensure data reliability, compliance, and accuracy.
- Collaboration: Engage with business stakeholders, consultants, and cross-functional teams to translate business requirements into technical data solutions.
Required Skills & Qualifications
- Experience: 3–5 years of proven expertise in data engineering, preferably within manufacturing, logistics, or transportation processes.
- Strong proficiency in the AWS ecosystem (S3, Glue, Redshift, EMR, Lambda, IAM).
- Hands-on experience with Python and PySpark for data engineering tasks.
- Solid understanding of SQL (MySQL) and NoSQL databases for diverse data workloads.
- Demonstrated ability in data modeling (conceptual, logical, and physical) to support both transactional and analytical use cases.
- Experience implementing Medallion Architecture or similar layered data frameworks.
- Proficiency with Power BI for data visualization and analytics enablement.
- Strong understanding of data quality, data governance, and security practices.
- Prior consulting experience or client-facing roles is a strong plus.
- Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field (Master’s preferred).
Preferred Attributes
- Strong analytical and problem-solving skills, with the ability to think strategically and deliver practical solutions.
- Excellent communication skills, capable of interacting with technical and non-technical stakeholders alike.
- A proactive mindset with the ability to thrive in fast-paced environments and manage multiple priorities.
- Industry exposure in manufacturing, supply chain optimization, transportation planning, or logistics analytics projects.