Senior Data Engineer
Punch AgencyCompany Description
Punch is a full service digital agency based out of New York, Silicon Valley, LA, Boston, Stockholm and Phuket, Thailand. Here at Punch, we take pride in tackling our clients’ most challenging tasks. Founded by a group of former Google Engineers and now with over 75 staff, Punch is now leading the way in creating new cutting-edge technology.
We are building a more technical world.Go ahead and check out some of our work here: www.punch-agency.com
Job Description
We are seeking an extremely talented senior/lead data engineer to design & implement highly reliable & scalable Audience Management Big Data Platform (500+ Terabytes).
Responsibilities:
- Build, enhance and scale our existing Big Data Platform to process 500+ Terabytes of data from various 3rd party providers.
- Technically own the complete data pipeline module including data ingestion, validation, transformation & storage in the data platform.
- Design and write clean, robust, server-side code using Spark & Scala.
- Perform R & D to evaluate new technologies, generate different ideas & patentable IP to communicate value for company
- Work closely with team members & mentor them technically
- Partner with product managers to support product roadmap & business needs
Required Skills:
- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.
- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)
- Bachelors degree in Computer Science or equivalent.
- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.
- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)
- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala
- 3+ years experience working in Agile environment (SCRUM)
Nice To Have Skills:
- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)
- Experience working with AWS (S3, EMR, EC2, RDS)
Job Type: Full-time
Required education:
- Bachelor's
Required experience:
- designing, building: 5 years
Job Type: Full-time
Required education:
- Bachelor's
Required experience:
- designing, building: 5 years
Qualifications
Required Skills:
- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.
- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)
- Bachelors degree in Computer Science or equivalent.
- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.
- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)
- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala
- 3+ years experience working in Agile environment (SCRUM)
Nice To Have Skills:
- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)
- Experience working with AWS (S3, EMR, EC2, RDS)
Additional Information
We are a team of former Google Engineers and Designers based in Silicon Valley, New York and Phuket, Thailand.
All of our core engineers are paid in the $150,000 range or greater and we also provide our engineers the opportunity to work, all expenses paid, from our Phuket, Thailand office one month a year as a creative outlet to work and enjoy life to the fullest.
In this role you will work with some of the most exciting projects in the industry today with a team of fast moving engineers and designers who have a passion for building disruptive products.