Job Description:
We are seeking a skilled and motivated Data Engineer to join our team in Richmond, VA. The ideal candidate will have a strong background in building and maintaining data pipelines and be proficient in the following technologies:
Required Skills:
Python: Strong programming skills for data manipulation, scripting, and automation.
AWS: Experience with various AWS services (e.g., S3, EC2, Lambda, Glue, Redshift, etc.).
PySpark: Hands-on experience with PySpark for big data processing and ETL jobs.
Domain Knowledge: Previous experience working in the Banking or Financial Services domain is highly preferred.
Key Responsibilities:
Design, develop, and maintain scalable and efficient data pipelines.
Collaborate with data scientists and analysts to support their data needs.
Ensure data quality, reliability, and security.
Optimize data processing jobs for performance.