Azure Data Engineer_Varsha_4 to 8 Years
Coders Brain Technology
Full-time
On-site
Gurgaon, Haryana, India
Azure Data Engineer
4 to 8 Years
Job Location: Gurgaon (Work from Office)
Role:
- Deep development background that must include 4+ years of experience in Spark with Scala and Python
- Design and implement performant data ingestion dataflows from multiple sources using Azure Databricks.
- Assist with and execute programming, modelling, and data integration, supporting task automation and DevOps practices
- Unit test to ensure the required performance through large-scale testing.
- To provide job mentoring
Skills:
- PySpark/Scala programming language and development on Azure Databricks using PySpark/Scala.
- End-to-end pipeline development on Azure Data Factory.
- Code versioning tools such as Git
- Must have worked with Continuous Integration and deployment tools (CI/CD)
- Knowledge of Azure services such as Azure Storage, Azure Data Lake, Azure SQL Data Warehouse, NoSQL DB like MongoDB or Cosmos, Azure event hubs
- Jenkins builds and releases pipelines (Good to have)
- Data Warehouse, Data lake, Business Intelligence concepts
- Intermediate SQL expertise.
- Strong understanding of troubleshooting issues.
Qualifications
- Bachelors/ Masters degree or equivalent work experience