Data Engineer
AviinTech Business Solutions
Full-time
On-site
Mumbai, Maharashtra, India
Data Engineer
Overview
The Data Engineer plays a critical role in the organization by designing and constructing robust systems for collecting, storing, and analyzing data. With the excellence in building data pipelines and optimizing performance, Data Engineers ensure that data is accessible, reliable, and actionable for decision-making processes. They work closely with data scientists, analysts, and other stakeholders to enhance the data infrastructure and guide strategic business intelligence initiatives. This position requires strong technical expertise and a problem-solving mindset to address various data-related challenges. In an age where data-driven decisions are key to business success, the Data Engineer significantly contributes to maintaining the integrity and quality of data while enabling data accessibility across the organization. This role is essential in ensuring that the organization can leverage data effectively to drive performance and innovation.
Key Responsibilities
- Perform business/data analysis to investigate into various business problems and propose the solution working closely with clients and team
- Design, implement, test and maintain ETL components for multiple applications – technology choice could vary depending on the types of components and team’s strategy
· Performance and scalability optimization to support large scale deployments
· Define new features in conjunction with product management, and provide specifications
· Ensure quality and completeness of the final product through unit testing, documentation and maintenance as appropriate.
Technical Skills
- Database: 4 years of experience in Database development (SQL/Data Modelling/Stored Procedures/Index/Performance Tuning e.g. Query Plan analysis). Teradata experience preferred.
- ETL Programming: 2-4 years of experience (Informatica - good to have)
- UNIX experience: Basic understanding of UNIX and shell commands is required, scripting (e.g. Python/Shell/Perl) experience preferred
- Job scheduler tools: Auto Sys experience preferred
- Experience with Java/Scala/Python and Spark Framework preferred
- Snowflake/Databricks exposure preferred
- Exposure to BFSI and finance industry preferred