Lead Data Engineer

This is a remote position.

Position Summary

The Lead Data Engineer role revolves around providing both technical and team leadership. This is a hands-on position using modern technologies and innovative architecture within a forward-thinking organization dedicated to good customer experience. This individual will possess an in-depth understanding of system design principles, system scaling, DevOps methodologies, and the integration of AI for automating tasks. The ideal candidate will showcase expertise in data workflows, data quality, automated testing, and Cloud computing. Strong communication skills are essential, as the role involves assisting other engineers and conveying complex concepts to non-technical colleagues.

Daily Activities

• Develop new features and systems to support rapidly emerging business and project requirements.

• Contribute to design sessions, code reviews, collaborative coding, and research.

• Ensure application performance, uptime, and scalability whileupholding rigorous standards for code quality and application design.

• Employ agile development methodologies, embracing best practices and pursuing ongoing learning opportunities.

• Participate in all aspects of software development, including design, implementation, and deployment.

• Provide and implement solutions to automate internal or customer workflows.

• Provide and implement solutions for optimizations of system performance.

• Use AI tools to monitor and analyze various aspects of internal systems, including infrastructure, logs, and DevOps, and report onand implement improvements.

• Collaborate across time zones via Jira, GitHub, SharePoint, videoconferences, and other standard platforms.

• Work closely with the stakeholders to ensure IT solutions align withbusiness needs.

• Follow all applicable federal/state regulations concerningprivacy and security, as well as all compliance policies defined in SOC2, HIPAA, and HITRUST.

• Other duties as assigned.

Other Duties

This job description is not designed to cover or contain a comprehensive listing of activities, tasks, duties, or responsibilities required by this position.  This position's duties, responsibilities, tasks, and activities are subject to change at any time, with or without notice.

Education and Experience

• 8+ years of experience in DevOps and full-stack development.

• Healthcare technology, or other heavily regulated industry experience.

• A 4-year degree in computer science, healthcare information technology, or a relevant field or equivalent knowledge and skills obtained through a combination of education, training, and experience.

• Experience with Agile methodologies.

• Must be a US Citizen.

Technologies:

• Python 3.10+ / PySpark – Required

• SQL – at least on one of MS Sql Server, MySql, PostgreSql, SparkSql

• Databricks – Required or equivalent system

• Feature Flagging (e.g. LaunchDarkly) - Preferred

• Cloud Computing, Azure preferred – Required

• Event-driven or distributed systems – Required

• AI tools (e.g. Azure Copilot, GitHub Copilot, Kubiya)

Supervisory Responsibilities

• Leading and mentoring a team of Data Engineers

• Discussions with DevOps leadership to discuss designs, blockers, and progress.

Competencies

Every position in Engineering requires that we are each a “leader of one”. This means everyone is required to manage themselves. Core values and behaviors that support this attitude are

• Active Listening – Whether it is a colleague in Engineering or Product, it is our responsibility to listen and gain clarity on their input.

• Creativity – There are always constraints to solving a problem, it is our jobs as Engineers to find those creative solutions to help with scalability, efficiency, and cost.

• Cooperation – It has been proven time and again that more heads are better than one when it comes to building software. We practice no-ego development and focus on making the best product.

• Initiative – There are going to be these slow times that pop-up, and we all must take this time to do something to better ourselves or the team. Sometimes rest is the right thing to do, too.

• Learning – There is always something to learn from every situation.

• Outlook – We focus on finding the solution to a problem, not all the ways it can’t be solved.

• Communication – Even the greatest idea can’t be realized if no one can understand it.