Senior Data Engineer

Deep Sync is the industry leader in deterministic identity and AI-powered data solutions. Leveraging our 35-year foundation of compiling direct mail-grade datasets, Deep Sync develops data-first technologies that power marketing, measurement, AI, and business intelligence for agencies and brands with our fully deterministic identity graph, privacy-first audiences, comprehensive data solutions, and integrations with leading platforms and cloud providers.

Position Overview: We are seeking a Senior Data Engineer with a robust background in data engineering to join our team in Hyderabad, India. The ideal candidate will be pivotal in designing, developing, and maintaining our data infrastructure. This role emphasizes on building machine learning models but on integrating and deploying these models into our data pipelines to enhance our capabilities in advanced analytics and machine learning processes. The successful candidate will contribute expertise to improve and scale our data engineering practices, ensuring the seamless incorporation of machine learning models into our operational workflows.

Key Responsibilities:

Data Pipeline Development:

• Design, implement, and maintain scalable data pipelines to collect, process, and store data from various sources.
• Ensure data quality, accuracy, and consistency throughout the pipeline.

Data Modeling Integration:

• Design and implement existing data models for predictive analytics, machine learning, and data exploration.
• Optimize data structures and storage to support predictive analytics/machine learning processes.

Data Integration:

• Work closely with cross-functional teams to integrate data from diverse sources, including databases, APIs, and external data providers.
• Develop and maintain ETL processes to transform and enrich raw data into actionable insights.

Performance Tuning:

• Monitor and optimize the performance of data pipelines and databases to meet business requirements.
• Identify and resolve bottlenecks and performance issues.

Continuous Learning and mentoring:

• Stay up-to-date with the latest advancements in data engineering and data science technologies.
• Share knowledge and mentor junior team members.

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of software engineering experience.
• Proven experience in developing and delivering large-scale software products.
• Strong experience in AI/ML technologies and building AI-powered applications.
• Strong programming skills in languages such as Python, Java, or C++.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Docker, Kubernetes).
• Excellent problem-solving skills and a passion for innovation.
• Tech Stack:
  • Cloud Provider Experience: AWS
  • Data Storage and Warehousing Analytics Engine
    • Snowflake
  • Amazon Services
    • AWS Glue
    • AWS Elastic MapReduce (EMR)
    • AWS Lambda
  • Data Processing and Computation
    • Apache Spark
  • Workflow & DataOps 
    • Apache Airflow® DAGs  (Directed Acyclic Graph) for orchestration

Benefits: We are proud to offer a best-in-class benefits package designed to support the well-being and professional growth of our team members. Our comprehensive benefits are highly competitive and considered to be among the best offered by companies in India, ensuring you are well-cared for as part of the Deep Sync family.