Senior Data Engineer (USA based, Hybrid)
Bitcoin Devs Company
Full-time
On-site
New York, United States
Senior Jobs
Overview:
The Senior Data Engineer plays a crucial role in our organization, responsible for designing and implementing scalable and reliable data pipelines, as well as optimizing data flow and collection for various cross-functional teams. This position is vital in ensuring data accessibility and usability for data scientists, analysts, and other business stakeholders. As a Senior Data Engineer, you will work closely with the data architecture, data science, and business intelligence teams to support our overarching data infrastructure and contribute to the development of cutting-edge data solutions.
Key Responsibilities:
- Building data pipelines, alerting, and reporting for trade and blockchain data.
- Designing data pipelines and automating ETL processes and SQL optimization, which will influence the “next generation” for ledger reconciliation processes and reporting.
- Partnering with teams throughout the organization for all types of data reconciliation – both ad hoc and scheduled.
- Creating data validation processes, customized reporting, and investigating the underlying root cause for exception reports.
Required Qualifications:
- 5+years implementing a reconciliation system while improving existing data pipelines.
- Experience building real-time data solutions and processes.
- Experience building and integrating web analytics solutions.
- Advanced SQL skills is a must.
- Experience and expertise in Databricks, Spark, Hadoop etc.
- Skilled in programming languages Python and/or Java.
- Experience with one or more MPP databases(Redshift, Bigquery, Snowflake, etc).
- Able to identify gaps in existing reconciliation processes.
- Extensive ETL and database experience with financial transaction systems for (banking systems, exchange systems).
- Experience with Datadog or other alert monitoring systems.
Preferred Qualifications:
- Familiarity with reading and decoding FIX and REST messages.
- Financial certifications are not required, but encouraged. Understanding the regulatory landscape in traditional financial markets will lend well as the digital asset space evolves.
- Financial Reporting Requirements for publicly traded companies.