Job Description:
Position : Senior Data Engineer
Location : Remote
Experience : 4 to 8 years
Notice Period : Immediate to 15 days
Required Skills - AWS Data services, Redshift, Lambda, Glue, S3, Athena, Kinesis, ETL, SQL, No SQL, Python/scala/java, Agile, CICD.
Job Description:
The Senior Data Engineer is responsible for data processing in the company Data Cloud . The candidate will demonstrate a successful track record of thought leadership and management skills coupled with deep experience engineering and managing cloud-based data platforms. The ideal candidate will be distinguished not only by their experience working in a cloud-based, multi-tenant environment, but also by high levels of creativity, passion and thought leadership.
Responsibilities:
- Lead the company Data Cloud development effort focusing on scalability, quality and performance.
- Ensure adherence to Scholastic’s enterprise best practices.
- Design efficient, scalable processes to acquire, manipulate and project data.
- Participate actively in all facets of the Agile process.
- Contribute to the SDC codebase directly by taking on development tasks.
Requirements:
- Bachelor’s degree in computer science, Math, Statistics or other quantitative disciplines
- 5+ years’ experience implementing enterprise data solutions.
- Extensive experience with AWS data services: Redshift, RDS, DynamoDB, Data Pipeline, EMR, Athena, Spectrum, GLUE, Lambda, Airflow
- Extensive experience writing and tuning SQL queries.
- 5+ years using ETL / data movement tools (dbt, talend, Pentaho, Glue, SSIS, Sqoop, Matillion, Informatica).
- 3+ years programming in one or more languages (Python, Java, Scala, C/C++)
- 2+ years’ experience with NoSQL data platforms.
- Experience implementing a data lake architecture in AWS mainly for S3, and Lambda implementation.
- Experience with Agile process methodology, CI/CD automation, Test Driven Development.
- Experience with AWS Kinesis, Kafka, Storm, Spark, SonarQube highly desired Certifications.