We’re seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will play a pivotal role in designing and managing scalable data architectures and pipelines to support analytics, machine learning, and business intelligence. Additionally, your work will enable us to serve better, engage members, and deliver public health services in smarter, more efficient ways.
Responsibilities:
- Develop and maintain high-performance data pipelines using Python and Spark.
- Integrate diverse data sources into unified systems and ensure data accuracy.
- Build and optimize ETL/ELT workflows to support analytics and machine learning.
- Monitor, troubleshoot, and enhance database performance.
- Implement data quality checks and ensure compliance with security standards.
- Research and recommend new technologies to improve data infrastructure.
- Collaborate with teams to ensure data accessibility and usability for stakeholders.
Requirements:
- 5+ years of professional experience in a data engineering role.
- Extensive experience with Python programming for data processing and automation.
- Hands-on experience with Apache Spark, including PySpark or Scala.
- Proficient in SQL for querying and managing data.
- Proficiency in AWS and AWS Athena.
- Knowledge of data modeling principles, including relational and non-relational databases.
- Experience with workflow orchestration tools (e.g., Airflow, Prefect).
- Experience in the healthcare field (would be a plus).
- Proactive, communicative, and highly skilled in self-management.
- Upper-Intermediate level of English and higher.
Our benefits:
- Professional and career growth promotion;
- Competitive salary;
- Paid vacations and sick leaves;
- Internal Medical Program;
- Program for veterans (which includes mentorship, an accessible office for individuals with disabilities, legal support, and additional benefits);
- Flexible working hours;
- Regular corporate social activities;
- Regular technical training at our office;
- English courses;
- Gym, etc.
