DescriptionDevsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance the efficiency of our analytical capabilities.
Responsibilities:
- Design, develop, and maintain scalable data processing systems and data pipelines to facilitate the collection, storage, and analysis of large data sets.
- Collaborate with data scientists, analysts, and other engineers to understand data requirements and architecture needs, and to ensure data is accessible and reliable.
- Optimize data storage and retrieval performance while ensuring data integrity and security.
- Implement ETL (Extract, Transform, Terraform, Load) processes and automate data workflows to improve efficiency and accuracy.
- Monitor and troubleshoot data pipeline performance, addressing issues as they arise to minimize downtime.
- Maintain documentation for the data architecture, processes, and workflows to ensure smooth collaboration and knowledge transfer within the team.
- Stay updated on emerging technologies and best practices in data engineering and contribute to the continuous improvement of data processes and systems.
Requirements - Bachelor's or master's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering, data warehousing, or a related field.
- Strong proficiency in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra).
- Expertise in programming languages such as Python, Java, or Scala.
- Hands-on experience with big data technologies (e.g., Apache Hadoop, Spark, Kafka).
- Experience with cloud platforms (AWS, Azure, or GCP), including data storage solutions like S3, Redshift, or BigQuery.
- Understanding of data modeling, ETL concepts, and data pipeline automation tools.
- Demonstrated problem-solving skills and the ability to work effectively in a fast-paced, collaborative environment.
- Excellent communication skills, with at least 2 years of international client communication experience.