Data Engineer
VivSoft Technologies
Full-time
On-site
San Antonio, Texas, United States
$120,000 - $149,999 USD yearly
Location: Remote
About the company:
VivSoft is an emerging technology company that specializes in using modern technologies to solve our clients' toughest mission challenges. We are focused on Cloud, Enterprise DevSecOps, Artificial Intelligence, and Digital Customer Experience to drive mission-enabling digital transformation. Our passion is building mission-focused, open, scalable solutions. We are a diverse team of strategists, engineers, designers, and creators experienced in building high-performance software and AI factory accelerators by embracing automation.
Job Summary:
We are looking for a Data Engineer to build a real-time data processing platform that supports fast and reliable data ingestion. This role involves designing scalable systems, ensuring efficient data flow, and implementing security and compliance measures. The ideal candidate will help create a high-performance infrastructure that enables real-time access to critical data.
Key Responsibilities:
Required Skills/Qualifications:
Benefits:
About the company:
VivSoft is an emerging technology company that specializes in using modern technologies to solve our clients' toughest mission challenges. We are focused on Cloud, Enterprise DevSecOps, Artificial Intelligence, and Digital Customer Experience to drive mission-enabling digital transformation. Our passion is building mission-focused, open, scalable solutions. We are a diverse team of strategists, engineers, designers, and creators experienced in building high-performance software and AI factory accelerators by embracing automation.
Job Summary:
We are looking for a Data Engineer to build a real-time data processing platform that supports fast and reliable data ingestion. This role involves designing scalable systems, ensuring efficient data flow, and implementing security and compliance measures. The ideal candidate will help create a high-performance infrastructure that enables real-time access to critical data.
Key Responsibilities:
- Stay abreast of industry trends and best practices in data engineering.
- Design, implement, and maintain data infrastructure and pipelines for efficient data ingestion, profiling, conformance, ETL, analytics, cleansing, classification, visualization, and machine learning.
- Collaborate with data scientists, DevSecOps teams, and software engineers to integrate data solutions across environments.
- Implement automation for data extraction, transformation, and loading (ETL) processes.
- Collect data provenance and integrity requirements from government stakeholders
- Decompose requirements into technical development requirements that can be executed
- Proficiency with Kubernetes or Terraform for infrastructure management and automation.
- Work collaboratively with cross-functional teams to understand data requirements and deliver high-quality solutions.
- Utilize your problem-solving skills to design scalable and efficient data pipelines.
Required Skills/Qualifications:
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- Proven hands-on experience as a Data Engineer, with a strong portfolio of successful data solutions.
- Proficiency in Python and other programming languages for data manipulation and analysis.
- Strong knowledge and experience with libraries such as Pandas, Numpy, and Scikit Learn.
- Solid understanding of databases, including PostGres, SQLServer, MySQL, Oracle, and proficiency in writing efficient SQL queries.
- Familiarity with cloud platforms such as AWS, Azure, Google Cloud, and their data services.
- Experience working with big data technologies like Spark and Hadoop.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
Benefits:
- Comprehensive Medical, Dental, and Visions Plans (Healthcare benefits are 100% employer-paid for employees only)
- Life Insurance
- Paid Time Off (Flexible/Combined PTO, Bereavement Leave, 11 Company Paid Holidays)
- 401K Retirement Plan with employer match
- Professional Development Training Reimbursement
- Flexible/remote work schedules