Lead Data Engineer

About us

Founded in 1998, All Options is a proprietary trading firm headquartered in Amsterdam, with a growing presence in Austin, TX. As a fully regulated market maker, we trade on major European options exchanges and recently expanded into US markets.

Our mission is to ensure fair, transparent, and accessible financial markets by providing competitive prices and supporting genuine supply-demand dynamics. Collaboration with regulators and exchanges underscores our commitment to fair competition.

Guided by values of continuous learning, open sharing, and ownership, we foster a straightforward, informal culture driven by curiosity and teamwork. We seek ambitious professionals ready to excel in a dynamic, data-driven trading environment.

The role

We are looking for a Lead Data Engineer to shape and grow our performance-focused data engineering team. In this role, you’ll be responsible for defining the roadmap, setting best practices, and delivering high-quality infrastructure and tools that empower our traders, quant traders, and technology teams with accurate, fast, and accessible data.

You will take end-to-end ownership of all data, pipelines, and streams outside of TBricks, ensuring availability, quality, and governance. This includes managing vendor relationships, optimizing costs, and ensuring consistent, linked, and compliant data delivery to our trading and BI systems.

We’re actively evolving a stack with significant legacy components (e.g., MSSQL, SSIS/SSRS, MongoDB, InfluxDB) alongside modern technologies we are already building on (PostgreSQL, RedPanda/Kafka, KX/kdb+, Scylla, KeyDB, Kubernetes). Experience managing and migrating legacy systems to modern, scalable architectures, while successfully decommissioning outdated systems, is highly valuable.

You will lead by example, both technically and strategically, combining your DevOps, cloud, and hardware knowledge with a strong understanding of trading environments. You’ll monitor and continuously optimize inflow and query performance, proactively detect and resolve errors, and ensure access rights are managed in line with licensing, regulation, and safe practices—without creating unnecessary barriers.

Key Responsibilities:

• Build and lead a high-performing data engineering team focused on delivering real-time, high-throughput, low-latency systems
• Design, implement, and maintain scalable, performant data architectures, schemas, and pipelines

• Monitor data presence, reliability, and quality, including automated error detection and prevention of duplicates or erroneous entries
• Manage data vendors, optimize costs, and ensure seamless integration of external data with internal systems
• Govern access rights in compliance with licensing, regulation, and security best practices
• Integrate or replace existing legacy systems with modern, unified platforms and fully phase out deprecated technologies
• Maintain a minimal yet sufficient set of core technologies while staying aware of emerging tools and industry trends
• Provide standardized APIs and guidance to business users, enabling effective data consumption across the company
• Collaborate with DevOps and IT Infrastructure to ensure the right compute resources and Kubernetes clusters are available, with auto-scaling and proactive alerts
• Translate trading and business needs into a robust, forward-looking data strategy and roadmap
• Foster a culture of ownership, collaboration, and continuous improvement

Key Requirements:

• Deep experience building and scaling data platforms in performance-critical environments
• Hands-on experience with some of the following technologies:
  • PostgreSQL, RedPanda/Kafka, KX/kdb+, Scylla, KeyDB
  • Kubernetes, containerization, and cloud/hybrid deployments
• Proven experience migrating and decommissioning legacy systems in favour of modern architectures
• Strong understanding of distributed systems, real-time data processing, and network performance optimization
• DevOps and hardware infrastructure knowledge, especially in performance-sensitive systems
• Demonstrated leadership skills—able to hire, coach, and inspire a team of data engineers
• Strategic thinker with hands-on execution ability; ready to define vision and roll up your sleeves
• Prior experience in trading or financial markets is an advantage
  
  

Why Join All Options?

At All Options, we offer a dynamic role with room for professional development and collaboration. Enjoy a competitive salary, bonus opportunities, profit sharing, 29 vacation days, and perks like a well-being allowance and in-house meals. Celebrate success with monthly drinks and festivities, and take advantage of our bicycle plan and an NS Business Card.

Apply Now!

If this sounds like your next challenge, submit your CV and cover letter. Our interview process ensures we find the right fit—and if it’s a match, we can’t wait to welcome you to the team!