Team Name:
IT - Infrastructure Engineering
Job Title:
Senior Data Engineer
Requisition ID:
R025704
Job Description:
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining local data warehouse infrastructure together with HQ data team and local partners. This role requires a deep understanding of data warehousing concepts, ETL processes, and data modeling. And the candidate needs to be highly self-driven, comfortable working with distributed remote virtual teams and partners.
Key Responsibilities:
- Design, develop, and maintain scalable data warehouse solutions to support business intelligence and analytics needs together with HQ data team and our local partner.
- Support and guide the implementation of ETL processes to extract, transform, and load data from various sources into the data warehouse.
- Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver high-quality data solutions.
- With local partner’s support, to optimize and tune data warehouse performance to ensure efficient data retrieval and processing
- Ensure data integrity, consistency, and security across the data warehouse.
- Develop and maintain documentation for data warehouse processes, data models, and data flows.
- Stay up to date with the latest industry trends and best practices in data engineering and data warehousing.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer, with a focus on data warehousing and ETL processes.
- Strong proficiency in SQL and experience with data modeling.
- Experience with data warehousing technologies such as Amazon Redshift, Google BigQuery, Snowflake or StarRocks.
- Familiarity with ETL tools such as Apache Airflow, DBT, Databricks, or SQLMesh.
- Knowledge of programming languages such as Python or Java
- Experience with distributed messaging systems like Kafka and RabbitMQ
- Experience with distributed computing frameworks like Apache Spark and Flink.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- Fluent in English and Mandarin
Preferred Qualifications:
- Experience with cloud platforms such as Ali Cloud, GCP, AWS, and Azure.
- Experience with large-scale distributed systems with large datasets.
- Knowledge of big data technologies such as Hadoop, Spark, or Kafka.
- Experience with data visualization tools such as Tableau, Looker, or Plotly.