Senior Data Engineer (Health Research Team)
Milliman, Inc, Chicago, IL, United States
Individuals must be legally authorized to work in the United States without the need for immigration support or sponsorship from Milliman now or in the future.
Milliman's Health Research Team (HRT) seeks an enthusiastic senior data engineer to design, maintain, and enhance data ETL pipelines that feed Databricks. The role primarily uses Python, PySpark, SQL, and AWS services like EC2 and S3, and processes healthcare data through Milliman tools.
This role is based out of the Milliman office in Chicago, Illinois. Candidates may work remotely anywhere in the United States and are expected to travel to the Chicago office for three consecutive days each quarter. Flexible work arrangements are available.
Job Responsibilities
Work closely with key stakeholders to ensure data pipelines meet business objectives and transform data to support analyst requirements.
Write, incorporate, and maintain Databricks notebook scripts within standard data processing jobs.
Ensure the integrity of HRT’s data pipelines, Databricks lakehouse, APIs, and Milliman products by conducting in‑depth validation reviews, applying data governance and retention policies, and establishing data quality metrics.
Lead comprehensive data pipeline reviews across HRT’s data assets, ensuring accuracy, completeness, consistency, and timeliness of healthcare data pipelines and downstream products.
Design, develop, and execute systematic data validation frameworks to identify anomalies, discrepancies, and integrity issues within data pipelines and product tools.
Investigate and document root causes of data pipeline failures, partnering with data engineering and analytics teams to implement corrective actions and preventive controls.
Deploy workflows into production environments, ensuring robust operation, monitoring performance, and promptly addressing any pipeline issues to maintain reliability and stability.
Collaborate with other HRT data analytics, engineering, and project management professionals to identify, propose, and implement process enhancements.
Assist in developing ad hoc data workflows that support Health Research Board (HRB) approved initiatives and Milliman practice client projects.
Provide support to Milliman’s practices via our help desk system by answering questions about data assets and data use policies.
Collaborate with HRT finance, operations, and project management teammates to provide technical and healthcare data expertise.
Communicate progress, status, issues, and decisions on a regular cadence.
Minimum Requirements
A bachelor’s degree in Computer/Software Engineering, Computer Science, Information Technology, Electrical Engineering, Data Science, Actuarial Science, or a similar field.
6+ years of relevant experience in data engineering or related roles, with advanced programming in SQL or Python.
Consistently produces high‑quality, accurate deliverables on schedule and effectively communicates progress, outcomes, and recommended next steps.
Four or more years of experience building data pipelines for enrollment, claims (medical or pharmacy), risk scores, or other common healthcare data sources; data modeling and architecture within Databricks or similar cloud‑based analytics platforms; using distributed data processing frameworks (preferably Apache Spark); version control using GitHub; applying best data governance and retention practices.
Intermediate or higher knowledge of Microsoft Office applications (Teams, Word, PowerPoint, SharePoint, Outlook) and Adobe Acrobat.
Travel to Milliman’s Chicago office for three consecutive days each quarter is required.
Competencies and Behaviors that Support Success in this Role
Ability to use REST API to perform standard database functions.
Experience migrating between AWS and Azure.
Competent with coding in the SAS Windowing Environment.
General business knowledge of at least two healthcare lines of business (e.g., individual, employer group, Medicare, Part D, Medicaid, Dental).
Exposure to CMS LDSSAF data files.
Proficiency in intermediate Excel skills, including complex formulas, Power Query, or VBA automation.
Experience working in a project management setting.
Strong written and verbal communication skills, especially communicating technical details to non‑technical audiences.
Polished demeanor with a consultative approach, capable of interacting with, influencing, and communicating effectively with all levels of health professionals; flexible, with a strong work ethic and a team‑player attitude.
Positive attitude, growth mindset, eagerness to learn, and openness to feedback.
Adaptable and stays up to date with evolving data technology landscape.
Service‑oriented, dependable, and tactful, capable of working independently.
Demonstrates integrity and respects confidentiality.
Skilled in prioritizing and managing multiple projects and tasks amidst interruptions and tight deadlines.
Takes pride in work and showcases excellent problem‑solving ability that adds value to the business.
Compensation
Overall salary range: $104,900 – $199,065.
For residents of Alaska, California, Connecticut, Illinois, Maryland, Massachusetts, New Jersey, New York City, Newark, San Jose, San Francisco, Pennsylvania, Virginia, Washington, or the District of Columbia: salary range $120,635 – $199,065.
All other states: salary range $104,900 – $173,100.
Salary determined by education, experience, and other factors.
Benefits
Medical, Dental, and Vision coverage for employees, dependents, and domestic partners.
Employee Assistance Program (EAP) – Confidential support for personal and work‑related challenges.
401(k) Plan – Includes a company matching program and profit‑sharing contributions.
Discretionary Bonus Program – Recognizing employee contributions.
Flexible Spending Accounts (FSA) – Pre‑tax savings for dependent care, transportation, and eligible medical expenses.
Paid Time Off (PTO) – Begins accruing on the first day of work. Full‑time employees accrue 15 days per year, prorated for part‑time.
Holidays – Minimum of 10 observed holidays per year.
Family Building Benefits – Includes adoption and fertility assistance.
Paid Parental Leave – Up to 12 weeks of paid leave for eligible employees.
Life Insurance & AD&D – 100% of premiums covered by Milliman.
Short‑Term and Long‑Term Disability – Fully paid by Milliman.
Equal Opportunity
All qualified applicants will receive consideration for employment, without regard to race, color, religion, sex, sexual orientation, national origin, disability, or status as a protected veteran.
For further information, please review the Know Your Rights notice from the Department of Labor.
#J-18808-Ljbffr
Milliman's Health Research Team (HRT) seeks an enthusiastic senior data engineer to design, maintain, and enhance data ETL pipelines that feed Databricks. The role primarily uses Python, PySpark, SQL, and AWS services like EC2 and S3, and processes healthcare data through Milliman tools.
This role is based out of the Milliman office in Chicago, Illinois. Candidates may work remotely anywhere in the United States and are expected to travel to the Chicago office for three consecutive days each quarter. Flexible work arrangements are available.
Job Responsibilities
Work closely with key stakeholders to ensure data pipelines meet business objectives and transform data to support analyst requirements.
Write, incorporate, and maintain Databricks notebook scripts within standard data processing jobs.
Ensure the integrity of HRT’s data pipelines, Databricks lakehouse, APIs, and Milliman products by conducting in‑depth validation reviews, applying data governance and retention policies, and establishing data quality metrics.
Lead comprehensive data pipeline reviews across HRT’s data assets, ensuring accuracy, completeness, consistency, and timeliness of healthcare data pipelines and downstream products.
Design, develop, and execute systematic data validation frameworks to identify anomalies, discrepancies, and integrity issues within data pipelines and product tools.
Investigate and document root causes of data pipeline failures, partnering with data engineering and analytics teams to implement corrective actions and preventive controls.
Deploy workflows into production environments, ensuring robust operation, monitoring performance, and promptly addressing any pipeline issues to maintain reliability and stability.
Collaborate with other HRT data analytics, engineering, and project management professionals to identify, propose, and implement process enhancements.
Assist in developing ad hoc data workflows that support Health Research Board (HRB) approved initiatives and Milliman practice client projects.
Provide support to Milliman’s practices via our help desk system by answering questions about data assets and data use policies.
Collaborate with HRT finance, operations, and project management teammates to provide technical and healthcare data expertise.
Communicate progress, status, issues, and decisions on a regular cadence.
Minimum Requirements
A bachelor’s degree in Computer/Software Engineering, Computer Science, Information Technology, Electrical Engineering, Data Science, Actuarial Science, or a similar field.
6+ years of relevant experience in data engineering or related roles, with advanced programming in SQL or Python.
Consistently produces high‑quality, accurate deliverables on schedule and effectively communicates progress, outcomes, and recommended next steps.
Four or more years of experience building data pipelines for enrollment, claims (medical or pharmacy), risk scores, or other common healthcare data sources; data modeling and architecture within Databricks or similar cloud‑based analytics platforms; using distributed data processing frameworks (preferably Apache Spark); version control using GitHub; applying best data governance and retention practices.
Intermediate or higher knowledge of Microsoft Office applications (Teams, Word, PowerPoint, SharePoint, Outlook) and Adobe Acrobat.
Travel to Milliman’s Chicago office for three consecutive days each quarter is required.
Competencies and Behaviors that Support Success in this Role
Ability to use REST API to perform standard database functions.
Experience migrating between AWS and Azure.
Competent with coding in the SAS Windowing Environment.
General business knowledge of at least two healthcare lines of business (e.g., individual, employer group, Medicare, Part D, Medicaid, Dental).
Exposure to CMS LDSSAF data files.
Proficiency in intermediate Excel skills, including complex formulas, Power Query, or VBA automation.
Experience working in a project management setting.
Strong written and verbal communication skills, especially communicating technical details to non‑technical audiences.
Polished demeanor with a consultative approach, capable of interacting with, influencing, and communicating effectively with all levels of health professionals; flexible, with a strong work ethic and a team‑player attitude.
Positive attitude, growth mindset, eagerness to learn, and openness to feedback.
Adaptable and stays up to date with evolving data technology landscape.
Service‑oriented, dependable, and tactful, capable of working independently.
Demonstrates integrity and respects confidentiality.
Skilled in prioritizing and managing multiple projects and tasks amidst interruptions and tight deadlines.
Takes pride in work and showcases excellent problem‑solving ability that adds value to the business.
Compensation
Overall salary range: $104,900 – $199,065.
For residents of Alaska, California, Connecticut, Illinois, Maryland, Massachusetts, New Jersey, New York City, Newark, San Jose, San Francisco, Pennsylvania, Virginia, Washington, or the District of Columbia: salary range $120,635 – $199,065.
All other states: salary range $104,900 – $173,100.
Salary determined by education, experience, and other factors.
Benefits
Medical, Dental, and Vision coverage for employees, dependents, and domestic partners.
Employee Assistance Program (EAP) – Confidential support for personal and work‑related challenges.
401(k) Plan – Includes a company matching program and profit‑sharing contributions.
Discretionary Bonus Program – Recognizing employee contributions.
Flexible Spending Accounts (FSA) – Pre‑tax savings for dependent care, transportation, and eligible medical expenses.
Paid Time Off (PTO) – Begins accruing on the first day of work. Full‑time employees accrue 15 days per year, prorated for part‑time.
Holidays – Minimum of 10 observed holidays per year.
Family Building Benefits – Includes adoption and fertility assistance.
Paid Parental Leave – Up to 12 weeks of paid leave for eligible employees.
Life Insurance & AD&D – 100% of premiums covered by Milliman.
Short‑Term and Long‑Term Disability – Fully paid by Milliman.
Equal Opportunity
All qualified applicants will receive consideration for employment, without regard to race, color, religion, sex, sexual orientation, national origin, disability, or status as a protected veteran.
For further information, please review the Know Your Rights notice from the Department of Labor.
#J-18808-Ljbffr