Senior Data Engineer
PURE InsuranceAbout PURE Insurance
PURE Insurance is actively investing in our data, analytics, data science, machine learning (ML), and artificial intelligence (AI) capabilities. We are building a centralized Data & ML/AI department that brings together specialists across data architecture, engineering, analytics, governance, and advanced modeling. This unique structure provides an extraordinary opportunity for growth, collaboration, and innovation (within your craft and across related disciplines).
As part of this team, you will engage with every function across the insurance ecosystem: Claims, Underwriting, Member Experience, Actuarial/Pricing, Product, Sales & Distribution, Marketing, HR, Finance, and more. We work with a modern data technology stack that includes platforms such as Databricks, dbt, GitHub, Hex, and Arize, while also developing in-house production-grade software in Python and other languages when it provides a competitive advantage.
At PURE, we embrace curiosity, innovation, and a relentless pursuit of improvement. We prioritize doing the right thing, even when it requires taking the more challenging path. Our culture values growth, mentorship, transparency, and ownership, and we know that building a strong foundation takes time and a willingness to experiment, learn, and adapt.
The Role
We are looking for a Senior Data Engineer to help design, build, and maintain the upstream components of our data platform (everything from ingestion and pipelines to real-time streaming and data quality frameworks). This is a hands-on, highly collaborative role: you will be coding daily, mentoring peers, and working closely with analytics engineers, data scientists, and business partners to deliver reliable, high-quality data that powers our silver and gold layers.
As part of a team building something from the ground up, you will have the freedom to bring fresh ideas, use the right tools for the job, and help shape the technical foundation of our future. We welcome engineers with strong expertise in Python and Apache Spark, along with deep proficiency in Databricks and Unity Catalog.
What You’ll Do
- Data Pipelines: Design, build, and maintain scalable data pipelines for batch and real-time processing, ensuring reliability, efficiency, and maintainability.
- Ingestion and Integration: Implement data ingestion frameworks, including change data capture (CDC) from core systems, APIs, and third-party platforms (Salesforce, Workday, Duckcreek, etc.).
- Spark and Databricks: Build and optimize distributed data processing jobs using Apache Spark on Databricks. Implement Delta Lake, DLT pipelines, and medallion and lakehouse architectures.
- Quality, Governance and Security: Ensure data quality, lineage, and governance using Unity Catalog, testing frameworks, and CI/CD practices. Implement role-based access control, encryption, and auditing.
- Collaboration and Leadership: Partner closely with Analytics Engineers (who own modeling with dbt) to ensure upstream data pipelines deliver clean, well-structured inputs. Familiarity with dbt is a plus. Mentor peers, contribute to architectural decisions, and encourage craftsmanship and pragmatic problem-solving.
- Cloud and DevOps: Leverage AWS cloud services (such as S3, Glue, Lambda) along with GitHub and CI/CD pipelines to enable scalable, production-grade deployments. Experience with other major cloud platforms (Azure, GCP) is also valued.
What We’re Looking For
- Experience: 5+ years of professional experience in data engineering, ideally with exposure to P&C insurance or broader insurance or financial services.
- Core Skills: Proficiency in Python, SQL, and Spark for building and optimizing data pipelines.
- Databricks & Azure Expertise: Hands-on experience with Databricks (Unity Catalog, Delta Lake, DLT pipelines) and/or Azure Data Services (ADF, ADLS, Synapse) is preferred.
- Cloud Platforms: Strong experience with AWS data services, with flexibility to apply knowledge from Azure or GCP.
- Architecture Knowledge: Familiarity with modern data architectures (medallion, lakehouse, streaming).
- Engineering Practices: Comfortable with GitHub, CI/CD pipelines, and testing frameworks for production-grade engineering.
- Mindset: Strong problem-solving skills and a pragmatic approach. You know when to build for scale and when to ship quickly. You are passionate about craftsmanship, curious about new approaches, and believe that great work is best done as a team.
Why Join Us?
- Be part of the ground floor of a major technological reinvention at a highly rated P&C insurance company.
- Work with modern tools and architectures without being locked into a single way of doing things.
- Collaborate with smart, passionate colleagues who value ownership, transparency, and innovation.
- Enjoy flexibility with a remote-first setup, plus the option to connect in person at offices across major U.S. cities.
- We pay competitive market value for top talent and provide benefits that support your growth and well-being.
Want to Learn More?