A little bit about us!
At Snoonu, we hold the belief that technology has the power to make anything possible.
Our Vision: to be the first Qatari Super App that propels the region and its community through innovation and technology. We envision a global expansion where what we do surpasses norms and limitations every time.
Our Mission: To radically transform how people live by leveraging technology to connect them with endless possibilities.
Values We Live By
- Be Customer Obsessed - “Focus on the customer and all else will follow.”
- Act with Integrity - “We are honest, ethical, and trustworthy in everything we do.”
- Be Curious and Creative - “We constantly innovate and create solutions to bring a lasting positive impact.”
- Lead by Example and Take Ownership - “Be the change you want to see and take ownership.”
- Work Smart and Deliver Results - “You can do more by doing less, better, and faster.”
- It's all about people - “Be a team player, together we are stronger.”
Position Overview:
We look for experienced engineer for position of dedicated DE for ML team. Main responsibilities will include creating end extending existing feature marts and realtime marts, including investigation of feature drift and performance optimizations. What we also consider as important is having enough skills to take responsibility for full ML-DE interaction, including new pipelines creation in existing DE infrastructure. Main tools used for feature engineering are Dbt, BigQuery, Databricks and Spark structured streaming, having AWS streaming services and infrastructure as a code for DE part. Our workflow emphasizes adaptability, collaboration, with a focus on driving changes in company wide metrics - and you`ll be able to see the impact of your work on the business and customer experience.
Skills Required:
- Experience in several programming languages or Python frameworks
- PySpark knowledge i.e. Spark structured streaming, data distribution, optimizations
- Strong SQL skills, ability to apply subqueries, window functions, CTEs, math specific database functions
- Experience with modern ETL processes, collection, ingestion, storage, cleaning, transformation, analysis of data
- Software design skills - software patterns, application, data system design
- Math statistics knowhelege, i.e. stdev, quartiles, ability to apply them for drift or outlier detection
- Infrastructure as a code is a plus
- Experience with databricks as a plus
Responsibilities:
- Feature engineering - support and creating feature marts for ML team, including tests and validation
- Realtime Feature engineering - creating realtime pipelines, extending realtime feature store with new features
- Integrating new sources into existing data pipelines for ML needs, ensuring data quality and consistency
- Monitor and automate ML pipelines processes, including data drift, pipelines performance, alerting
Our Stack:
- GCP platform
- BigQuery
- Dbt
- Databricks
- Spark structured streaming
- AWS message brokers
- Tableau, Redash