Flintex Consulting logo

Data engineer (Azure)

Flintex Consulting
Full-time
On-site
Singapore, Singapore, Singapore
Data engineer (Azure) – Synapse and Pyspark, Python,  Datawarehouse and Power BI , Azure Devops
<\/span><\/span> <\/div>

<\/span><\/span> <\/div>

<\/u><\/b><\/span><\/span> <\/div>
Skills & Experience<\/u><\/b><\/span>
<\/span><\/span> <\/div>
• Bachelor’s Degree in Computer Science or Engineering with 3\-5 years of experience in Azure Data engineering, Python, Pyspark or Big Data development<\/span>
<\/span><\/span> <\/div>
• Sound Knowledge of Azure Synapse analytics for pipelines, orchestration, set up<\/span>
<\/span><\/span> <\/div>
• 1\-2  experience in Visualization design and development with Power BI. Knowledge on row\-level security, access control<\/span>
<\/span><\/span> <\/div>
• Sound experience in SQL, Datawarehouse, data marts, data ingestion with Pyspark and Python<\/span>
<\/span><\/span> <\/div>
• Expertise in developing and maintaining ETL processing pipelines in cloud\-based platforms such as AWS, Azure, etc. (Azure Synapse or data factory preferred)<\/span>
<\/span><\/span> <\/div>
• Team player with good interpersonal, communication, and problem\-solving skills.<\/span>
<\/span><\/span> <\/div>

<\/span><\/span> <\/div>

<\/span><\/span> <\/div>
Job Scope<\/u><\/b><\/span>
<\/span><\/span> <\/div>
• Design, review and development of Pyspark scripts. Testing, troubleshooting of data pipelines, orchestration<\/span>
<\/span><\/span> <\/div>
• Designing and developing reports and dashboards in Power BI, setting up access control with row\-level security, DAX query experience<\/span>
<\/span><\/span> <\/div>
• Establishing connections to source data systems, including company internal systems e.g. SAP, Historians, Data Lake, etc. as well as external systems such as Web APIs, etc<\/span>
<\/span><\/span> <\/div>
• Managing the collected data in appropriate storage\/data\-base solutions e.g. file systems, SQL servers, Big Data platforms such as Hadoop, HANA, etc. as required by the specific project requirements<\/span>
<\/span><\/span> <\/div>
• Design, development of data marts and relevant data pipelines using pyspark, data copy activities for batch ingestion<\/span>
<\/span><\/span> <\/div>
• Deployment of pipeline artifacts from one environment to the other using Azure Devops<\/span>
<\/span><\/span> <\/div>
• Performing data integration e.g. using database table joins, or other mechanisms at an appropriate level as required by the analysis requirements of the project.<\/span>
<\/span><\/span> <\/div>

<\/span><\/span> <\/div>
Good to have<\/u><\/b><\/span>
<\/span><\/span> <\/div>
• Data catalog with Purview  enabling effective metadata management, lineage tracking, and data discovery<\/span>
<\/span><\/span> <\/div>
• Candidates should demonstrate the ability to leverage Purview to ensure data governance, compliance, and efficient data exploration within Azure environments.<\/span>
<\/span><\/span> <\/div>

<\/span><\/span> <\/div>
Others<\/u><\/b><\/span>
<\/span><\/span> <\/div>
• Able to work independently on assignment according to agreed schedule without much supervision<\/span>
<\/span><\/span> <\/div>
• Own assignment and take initiative to resolve issues hinder completion of assignment Proactively reach out for help\/guidance whenever required.<\/span><\/span>
<\/div><\/span>
<\/body> <\/html>"}}],"isMobile":false,"iframe":"true","jobType":"Full time","applyName":"Apply Now","zsoid":"651761644","FontFamily":"Arial, Helvetica, sans\-serif","jobOtherDetails":[{"fieldLabel":"Work Experience","uitype":2,"value":"1\-3 years"},{"fieldLabel":"Industry","uitype":2,"value":"Technology"},{"fieldLabel":"Salary","uitype":1,"value":"SGD 7000 \- SGD 9000"},{"fieldLabel":"City","uitype":1,"value":"Singapore"},{"fieldLabel":"State\/Province","uitype":1,"value":"Central Singapore"},{"fieldLabel":"Zip\/Postal Code","uitype":1,"value":"079903"}],"headerName":"Data engineer (Azure)","widgetId":"418400000000381837","isJobBoard":"false","userId":"418400000000179003","attachArr":[],"customTemplate":"5","isCandidateLoginEnabled":false,"jobId":"418400000043689495","FontSize":"13","googleIndexUrl":"https:\/\/flintex.zohorecruit.com\/recruit\/ViewJob.na?digest=PmtGoOx0iV9gs6xXwgvAe@SACpBrjxUNRUekCg0YePU\-&embedsource=Google","location":"Singapore","embedsource":"CareerSite","indeedCallBackUrl":"https:\/\/recruit.zoho.com\/recruit\/JBApplyAuth.do","logoId":"3xpxkf7cb8cd512f54263a74d5094e14b9c51"}