Black & White logo

Data Engineer

Black & White
Contract
On-site
Bangalore North, Karnataka, India

Company Name :


Job Title :

Data Engineer

Qualification :

Any graduation

Experience :

4 to 7 years

Must Have Skills :

SQL & Data Modeling: Proficient in writing complex SQL queries and designing normalized and dimensional data models.

  • ETL/ELT Development: Experience with building and orchestrating robust data workflows (e.g., Apache Airflow, Talend, custom Python scripts).

  • Programming (Python or Scala): Strong scripting/coding experience for data processing and automation.

  • Cloud Platform Experience: Working knowledge of cloud data tools and services (e.g., S3, Redshift, BigQuery, Azure Data Factory).

  • Data Warehousing: Proven experience in designing and managing modern data warehouses like Snowflake, Redshift, or BigQuery.


Good to Have Skills :

Apache Spark or Apache Flink for large-scale or real-time data processing.

  • Experience with NoSQL databases (MongoDB, Cassandra, DynamoDB).

  • Familiarity with streaming platforms (Kafka, Google Pub/Sub).

  • Exposure to CI/CD, DevOps/DataOps practices.

  • Understanding of data governance, encryption, and compliance standards (e.g., GDPR, HIPAA).

  • Containerization using Docker/Kubernetes.

  • Integration experience with ML/AI pipelines and model data readiness.


Roles and Responsibilities :

Design, build, and maintain scalable ETL/ELT pipelines for structured and unstructured data.

  • Develop and optimize data models (star/snowflake schema) and data warehouses.

  • Collaborate with cross-functional teams to understand data needs and deliver integrated solutions.

  • Ensure data quality, lineage, governance, and security across all pipelines.

  • Deploy and manage data solutions on cloud platforms (AWS, GCP, or Azure).

  • Monitor, debug, and improve the performance and reliability of existing data systems.

  • Document data pipelines, systems architecture, and transformation logic.


Location :

Hyderabad , Noida

CTC Range :

200000


Notice period :

Immediate

Shift Timings :


Mode of Interview :

virtual

Mode of Work :


Mode of Hire :


Note :