9

Data Engineer – Databricks (Performance & Security)

99x Europe
Full-time
Remote

This is a remote position.<\/p>

We are looking for a Data Engineer focused on Databricks platform excellence —
<\/div>
mastering features, security, performance optimization, and operational best practices.
<\/div>
You will play a key role in improving how we leverage Databricks across our data platform,
<\/div>
ensuring scalable, secure, and efficient workloads.
<\/div>
Work can be done remotely and the communication with the team is in Portuguese and English.
<\/div>

<\/div>
Key Responsibilities
<\/div>
• Optimize Databricks performance across jobs, clusters, and data workloads.
<\/div>
• Implement and maintain governance, security, and permissions via Unity Catalog and
<\/div>
Terraform.
<\/div>
• Contribute to Databricks feature enablement — Delta Live Tables, Databricks Asset
<\/div>
Bundles (DABs), and cost efficiency improvements.
<\/div>
• Monitor cluster and job performance using Grafana and internal observability tools.
<\/div>
• Support data engineers in troubleshooting and fine\-tuning jobs and SQL queries.
<\/div>
• Explore and progressively implement streaming features (Structured Streaming,
<\/div>
Autoloader, Kafka integration).
<\/div>

<\/div>
Requirements
<\/div>
• Minimum of 5 years of experience with similar responsabilities.
<\/div>
• Deep knowledge of Databricks configuration, optimization, and administration.
<\/div>
• Experience with PySpark, SQL, and data performance tuning.
<\/div>
• Familiarity with Unity Catalog, DABs, and Terraform integration.
<\/div>
• Strong understanding of data governance, cost optimization, and cluster policies.
<\/div>
• Basic to intermediate experience with Kafka or interest in learning streaming processing.
<\/div>

<\/div>
Platform & Infrastructure
<\/div>
• Manage Databricks environments integrated with Airflow on AKS, Azure ADLS Gen2,
<\/div>
and Terraform.
<\/div>
• Collaborate with DataOps to ensure high availability, logging, and monitoring coverage.
<\/div>
• Implement performance and security benchmarks for production workloads.
<\/div>
• Our stack includes Talend, Azure ADLS Gen2, Azure Databricks, Airflow (AKS),
<\/div>
Terraform, SQL, Python, PySpark, Grafana, Kafka (Aiven), GitLab, Databricks Asset
<\/div>
Bundles (DABs), and DQX (Data Quality Framework).
<\/div>

<\/div>
If it sounds like you, share your CV with us and let's talk!
<\/div><\/span>
<\/body> <\/html>"}}],"isMobile":false,"iframe":"true","jobType":"Full time","applyName":"Apply Now","zsoid":"640477422","isRemoteJob":true,"FontFamily":"PuviRegular","jobOtherDetails":[{"fieldLabel":"Industry","uitype":2,"value":"IT Services"}],"headerName":"Data Engineer – Databricks (Performance & Security)","widgetId":"382353000000072311","isJobBoard":"false","userId":"382353000000148774","attachArr":[],"customTemplate":"5","isCandidateLoginEnabled":false,"jobId":"382353000018488068","FontSize":"14","location":"","embedsource":"CareerSite","indeedCallBackUrl":"https:\/\/recruit.zoho.com\/recruit\/JBApplyAuth.do","logoId":"iwp3fa803ab342c7341458ccd0ff07c203b58"}
Apply now
Share this job