p

Big Data Engineering

prudentialmanp
Full-time
On-site
Noida, Uttar Pradesh, India
₹19,000,000 - ₹35,000,000 INR yearly
  • Bachelor's degree in computer science, or similar technical field
  • Minimum 5 years of experience in Big Data Engineering/Data Analysis


Preferred Skills and Qualifications:

  • Proficiency in Python, SQL and Apache Spark
  • Strong Experience on Snowflake 
  • AWS services such as EMR, Glue (serverless architecture), S3, Athena, IAM, Lambda and CloudWatch
  • Core Spark, Spark Streaming, DataFrame API, Data Set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data
  • Advanced SQL using Hive/Impala framework including SQL performance tuning
  • Expertise in Hadoop, and other distributed computing frameworks 
  • ElasticSearch (OpenSearch) and Kibana Dashboards
  • Resource management frameworks such as Yarn or Mesos.
  • Physical table design in Big Data environment
  • External job schedulers such as autosys, AWS data pipeline, airflow etc.
  • Experience working in Key/Value data store such as Hbase


Data Analyst:


Skills, Experience and Requirements


  • Minimum of 5 years of experience delivering data solutions on a variety of data warehousing platforms.
  • Experience with SQL, Python and Excel in a business environment required
  • 2+ years of experience with Tableau developing calculated fields
  • Experience with data cleaning and blending multiple data sources using ETL tools
  • Experience in cloud technologies (like AWS) and data analytics platforms (ex: Redshift and Snowflake)
  • Experience in delivering of self-service analytics, insights, KPIs and metrics
  • Experience building and maintaining data catalog with dictionary 
  • Experience with scheduling tools like Control-M or Airflow
  • Strong understanding and experience with data warehousing concepts required
  • Experience manipulating large datasets in a business environment required
  • Experience translating data to actionable insights required
  • Excellent facilitation skills; Strong desire to communicate in all settings
  • Apply objective, analytical, and orderly thinking to the analysis of complex problems
  • Embrace the Adventure; Willing to take risks, try innovative approaches, be adaptable to change, and learn from failures
  • Demonstrate Curiosity; Strong desire to learn and add value to all aspects of the Dish business


Education and Experience:

  • Bachelor's Degree with 5 years of experience in a relevant field such as Business operations, Analytics and Computer science; Master & Degree a plus