We are seeking a Senior Data Engineer who has solid experience in Snowflake, Microsoft Azure Data Factory, Data Brick and Kafka.
Requirements
Qualifications
BS in Computer Science or Related
5+ years of data engineering experience
Good understanding of modern data platforms including data lakes and data warehouse, with good knowledge of the underlying architecture, preferably in Snowflake.
Proven experience in assembling large, complex sets of data that meets non-functional and functional business requirements.
Experience in identifying, designing, and implementing integration, modelling, and orchestration of complex Finance data and at the same time look for process improvements, optimize data delivery and automate manual processes.
Working experience of scripting, data science and analytics (SQL, Python, PowerShell, JavaScript)
Working experience of performance tuning and optimization, bottleneck problems analysis, and technical troubleshooting in a, sometimes, ambiguous environment.
Working experience of working with cloud-based systems (Azure experience preferred)
Desired Qualifications:
Experience working with cloud-based systems - Azure & Snowflake data warehouses.
Expertise in designing data table structures, reports, and queries.
Working knowledge of CI/CD
Working knowledge of building data integrity checks as part of delivery of applications
Experience working with Kafka technologies.
Technical expertise to build code that is performant as well as secure.
Technical depth and vision to perform POCs and evaluate different technologies.
Experience with Real Time Analytics and Real Time Messaging
Working experience with Microservices is desirable.
Design, implement and monitor 'best practices' for Dev framework.
Experience working with large volume data; retail experience strongly desired.
MS Degree in Computer Science or related technical degree completed.
Possesses an entrepreneurial spirit and continuously innovates to achieve great results.
Communicates with honesty & kindness and creates the space for others to do the same.
Fosters connection by putting people first and building trusting relationships.
Integrates fun and joy as a way of being and working, aka doesnt take themselves too seriously.
Preferred Tools: Snowflake, Microsoft Azure Data Factory, Kafka, Oracle Exadata, Power BI, SSAS, Oracle Data Integrator