Curotec logo

Senior Data Engineer - LATAM - LocalAct (Cris)

Curotec
Full-time
Remote
Brazil

Job description

This is a remote position, 1 years Contract.

We are seeking a Senior Data Engineer to support the ingestion, processing, and synchronization of data across our analytics platform. This role focuses on using Python Notebooks to ingest data via APIs into Microsoft Fabric's Data Lake and Data Warehouse, with some data being synced to a Synapse Analytics database for broader reporting needs.

The ideal candidate will have hands-on experience working with API-based data ingestion and modern data architectures, including implementing Medallion layer architecture (Bronze, Silver, Gold) for optimal data organization and quality management, with bonus points for exposure to marketing APIs like Google Ads, Google Business Profile, and Google Analytics 4.

This is a remote position. We welcome applicants globally, but this role has a preference for LATAM candidates to ensure smoother collaboration with our existing team.

Job requirements

Build and maintain Python Notebooks to ingest data from third-party APIs

Design and implement Medallion layer architecture (Bronze, Silver, Gold) for structured data organization and progressive data refinement.

Store and manage data within Microsoft Fabric's Data Lake and Warehouse using delta parquet file formats.

Set up data pipelines and sync key datasets to Azure Synapse Analytics

Develop PySpark-based data transformation processes across Bronze, Silver, and Gold layers.

Collaborate with developers, analysts, and stakeholders to ensure data availability and accuracy.

Monitor, test, and optimize data flows for reliability and performance

Document processes and contribute to best practices for data ingestion and transformation.

All done!

Your application has been successfully submitted!