Databricks Data Engineer

Embark on a data journey together with us at Sparkle, where don't just consult on BI – we ignite data revolutions. We are a holistic data partner with a strategic mindset, cutting-edge engineering & AI expertise. We help our clients become more data driven, and we make sure that they unleash the full potential of their data.  

Within our fun team you'll collaborate with seasoned professionals, each contributing their unique expertise to guide our clients through their data journey. At Sparkle, we stay ahead of the curve by working with the latest technologies and proudly hold certification as a Microsoft Partner.

With our headquarters situated in Belgium and our footprint into the Netherlands and Estonia, we are strategically positioned to serve clients both locally and across the Baltic region. As a proud member of the Cronos ecosystem, Sparkle offers more than just a workplace — we are a go-to destination for personal,  professional growth & fun. Together we are shaping the future of data. 

As a Databricks Data Engineer you: 

• Will be at the forefront of designing and building robust data pipelines
• Leverage the power of Databricks by transforming raw data into the fuel for smarter business decision and groundbreaking innovation 
• Architect and develop efficient Databricks-centric data platforms for a range of industries
• Craft ETL/ELT processes using a combination of PySpark, SQL, and Delta Lake
• Streamline data ingestion processes from diverse sources (cloud, on-premise)
• Collaborate with stakeholders to implement data quality and governance practices
• Troubleshoot and optimize Databricks environments for enhanced performance

You can Sparkle in this role if you have following must & nice-to-haves:

Must haves

• Databricks Mastery: demonstrable hands-on proficiency with core Databricks components – Delta Lake, Databricks SQL, and MLflow. Your experience goes beyond basic use, showcasing in-depth optimization techniques
• Data Warehousing Aptitude: firm grasp of data warehousing principles, schemas (star/snowflake), and experience optimizing performance for large-scale datasets
• Big Data Coding: fluency in SQL, Python, or Scala, specifically for data manipulation, transformations, and building robust ETL/ELT pipelines
• Fluent in English and Dutch or French (for Wallonia region) or Estonian (for Estonia) 

Nice to haves

• Azure Ecosystem Familiarity: experience with Azure Synapse Analytics, Data Factory, SQL Databases, or other complementary Microsoft data technologies
• Machine Learning Integration: track record of building and deploying machine learning models directly within the Databricks environment
• Broader Cloud Knowledge: awareness of cloud data services (AWS/GCP) and other big data technologies (Spark, Hadoop) is a definite plus

What we have to offer you when you become a Sparkleer: 

• You'll have the opportunity to work on cutting-edge projects, enhance your skills alongside experts in the field of data (and humor!), and contribute to solutions that make a real difference
• We're committed to your professional growth, offering a path to advance your career in a collaborative and supportive setting. Choose your apple tree buddy while your training budget lets you explore and expand your skills
• An attractive salary package in line with your expertise, including a company car & fuel card or mobility budget, hospitalization and group insurance, and top-notch gadgets that come extra being part of the Cronos Group 
• Our team thrives on team well-being, diversity & knowledge sharing
• Hybrid way of working. No rules on coming to the office, so that means time for your children, partner or dog/cat/parrot/bunny/...

We are always looking for talent in Belgium, Estonia or The Netherlands. If you cannot find a suitable job opening, don’t hesitate to send your spontaneous application to hello@sparkle.consulting if you think you there will be a mutual match!