C

Big Data Engineer

Centific
Full-time
On-site
Malaysia

About Centific

At Centific, people are at the center of our culture.We constantly seek out opportunities for people to enhance their skills,

and emphasize work-life balance for all our employees.We believe that competition can bring out the very best in people

– from our annual creative film and speech contests to our weekly office game tournaments,we mix work and play to engage our people and help our clients succeed.

About Job

Job Title: Data Engineer

Job Responsibilities:

1. Participate in the demand research and analysis of data projects and provide delivery results on time.

2. Participate in the design and development of data solutions, such as large-scale data batch processing and near-real-time data processing.

3. Responsible for the development and debugging of data logic. Data processing through SQL, Python, Scala, etc.

4. Responsible for using big data technologies (e.g., Spark, Hive, Flink, HBase, Elasticsearch, etc.) to solve technical challenges in the enterprise data space, including high throughput, low latency, and high availability or stability.

5. Ensure the stability of big data-related components in the data project and ensure the stable operation of the project in extreme situations such as high throughput or high concurrency.

6. Provide data technology solutions and perform technical feasibility tests to support the early process of big data projects.

Qualifications:

1. Bachelor’s degree or higher in computer science or related majors.

2. At least 3 years of data engineering and related work experience.

3. Logical and excellent coding skills.

4. Proficient in Spark SQL or HiveQL development; Python data processing experience is required.

5. Familiar with mainstream databases such as Oracle, DB2, SQL Server, etc.

6. Familiar with big data development and job scheduling process.

7. Familiar with data modelling, database storage process development, data query performance analysis and SQL tuning;

8. Experience in large-scale data platform or data warehouse design, terabyte level data processing experience is preferred.

9. Experience in Microsoft Azure data-related component services (such as ADF, Azure Databricks, Azure Synapse Analytics, etc.) is preferred.

10. Strong logical thinking and analysis skills, plan execution and teamwork skills.

11. Passionate about technology and patient to solve various data-related technical problems.

Centific is an equal opportunity employer. We aim to create an inclusive workplace and leverage the power of diversity. We are committed to providing a work environment free of discrimination and harassment. We do not discriminate or allow harassment on the basis of race, color, religion, disability, gender, national origin, sexual orientation, gender identity, gender expression, age, genetic information, military status or any other legally protected status. Workplace discrimination related to being pregnant and pregnancy-related harassment, including discrimination in the hiring process, is strictly prohibited in Centific Global Solutions.