Data Engineer
GeekSoft Consulting
Contract
On-site
Amsterdam, Amsterdam, Netherlands
- Help design, build and continuously improve the clients online platform
- Research, suggest and implement new technology solutions following best practices/standards
- Take responsibility for the resiliency and availability of different products
- Be a productive member of the team.
Requirements
Core Technologies & Experience:
- Hands-on experience with MongoDB and Parquet, with a solid understanding of data modeling principles
- Proficiency with Google Cloud Platform (GCP) services, especially BigQuery and Cloud Storage
- Understanding of core data science concepts
Essential Skills:
- Advanced proficiency in Scala and strong experience in Shell scripting
- Expertise in SQL, including the ability to write and optimize complex queries
- Experience with Infrastructure as Code (IaC) using Terraform for automating infrastructure changes
Desirable Skills:
- Working knowledge of Python (preferred but not mandatory)
- Familiarity with Apache Spark Structured Streaming and Hadoop ecosystems
- Prior experience working with Apache Kafka and building real-time data pipelines
Benefits
- A challenging, innovating environment.
- Opportunities for learning where needed.