Data Engineering Manager
State of New Mexico, Santa Fe, NM, United States
$51.72 - $82.76 Hourly
$107,584 - $172,135 Annually
This position is a Pay Band C13
Posting Details
Interviews are anticipated to be conducted within two weeks of closing date.
This posting may be used to fill multiple vacancies.
Our Vision
Every New Mexican has access to affordable health care coverage through a coordinated and seamless health care system.
Our Mission
We ensure that New Mexicans attain their highest level of health by providing whole-person, cost-effective, accessible, and high-quality health care and safety-net services.
Our Goals
Leverage purchasing power and partnerships to create innovative policies and models of comprehensive health care coverage that improve the health and well-being of New Mexicans and the workforce.
Achieve health equity by addressing poverty, discrimination, and lack of resources, building a New Mexico where everyone thrives.
Implement innovative technology and data-driven decision-making to provide unparalleled, convenient access to services and information.
Build the best team in state government by supporting employees' continuous growth and wellness.
Why does the job exist?
The Data Engineering Manager is responsible for designing, developing, and maintaining the infrastructure and systems that support data storage, processing, and analysis. This role plays a critical part in building and managing data pipelines that ensure efficient, reliable integration, transformation, and delivery of data across the department.
The Data Engineering Manager will:
Design and develop data pipelines that extract data from multiple sources, transform it into the required formats, and load it into appropriate storage systems;
Collaborate with data scientists and analysts to optimize models, algorithms, and overall data workflows, with a focus on data quality, security, and governance;
Integrate data from a wide range of sources, including databases, data warehouses, APIs, and third party systems;
Ensure data consistency and integrity throughout the integration process by performing validation, cleaning, and other quality checks;
Transform raw data into usable formats through cleansing, aggregation, filtering, and enrichment techniques;
Ensure that data engineering practices and policies meet SOC 2 compliance requirements;
Optimize data pipelines and processing workflows for performance, scalability and efficiency;
Support the development of DevOps project structures to standardize processes and promote best practices.
How does it get done?
The Data Engineering Manager is responsible for:
Designing and enabling a modern, cloud based data lake that supports structured and semi structured data in its native form;
Monitoring and tuning data systems by identifying and resolving performance bottlenecks and implementing caching and indexing strategies to improve query performance;
Implementing data quality checks and validations within data pipelines to ensure the accuracy, consistency, and completeness of data;
Taking responsibility and accountability for maximizing the value of enterprise information assets and the analytics that support decision making, automated processes, and the augmentation of human performance;
Partnering with board members and executive leadership to define the organization¿s vision for managing data as a strategic business asset;
Establishing governance for data and algorithms used in analysis, analytical applications, and automated decision making.
Who are the customers?
This position will collaborate daily with data engineers, data analysts, security teams, and related roles to equip the analytical community with the insights and support needed to help leadership make informed decisions.
Ideal Candidate
The Ideal Candidate has:
Project experience developing and maintaining data warehouses or data lakes within modern big data environments (e.g., Snowflake);
Knowledge of Apache technologies such as Kafka, Airflow, and Spark for building scalable, efficient data pipelines;
The ability to design, build, and deploy data solutions that capture, explore, transform, and utilize data to support AI, ML, and business intelligence initiatives;
Strong programming skills in languages such as Java, Python, and C/C++, along with proficiency in tools such as SQL, R, SAS, or Excel;
The ability to collaborate within and across teams with varying levels of technical expertise, supporting delivery efforts and educating end users on data products;
Advanced problem solving and debugging skills, including the ability to identify root causes in unfamiliar code or systems and resolve recurring issues;
Excellent business acumen and interpersonal skills, with the ability to work across business lines at senior levels to influence, drive alignment, and achieve shared goals;
Minimum Qualification
A Bachelor's degree in Computer Science, Data Science, Software Engineering, Information Systems, or related quantitative field and seven (7) years of combined experience in cloud engineering, cloud migration, data engineering, data integration, streaming data development, data warehousing, data curation, data analysis, design, storage, and data protection and security. At least two (2) years of which must be leading/supervising a data management team. Any combination of education from an accredited college or university in a related quantitative field and/or direct experience in master data management, data analytics, or data engineering cloud engineering totaling eleven (11) years, including two (2) years supervisory experience, may substitute for the required education and experience.
Employment Requirements
Must possess and maintain a valid Driver's License.
Must possess or obtain Defensive Driving Certificate.
Employment is subject to a pre-employment criminal background investigation and is conditional pending results.
Supplemental Information
Do you know what Total Compensation is? Click here
Agency Contact Information: Theresa Romero, (505) 394-2977. Email
For information on Statutory Requirements for this position, click the Classification Description link on the job advertisement.
Bargaining Unit Position
This position is not covered by a collective bargaining agreement.
$107,584 - $172,135 Annually
This position is a Pay Band C13
Posting Details
Interviews are anticipated to be conducted within two weeks of closing date.
This posting may be used to fill multiple vacancies.
Our Vision
Every New Mexican has access to affordable health care coverage through a coordinated and seamless health care system.
Our Mission
We ensure that New Mexicans attain their highest level of health by providing whole-person, cost-effective, accessible, and high-quality health care and safety-net services.
Our Goals
Leverage purchasing power and partnerships to create innovative policies and models of comprehensive health care coverage that improve the health and well-being of New Mexicans and the workforce.
Achieve health equity by addressing poverty, discrimination, and lack of resources, building a New Mexico where everyone thrives.
Implement innovative technology and data-driven decision-making to provide unparalleled, convenient access to services and information.
Build the best team in state government by supporting employees' continuous growth and wellness.
Why does the job exist?
The Data Engineering Manager is responsible for designing, developing, and maintaining the infrastructure and systems that support data storage, processing, and analysis. This role plays a critical part in building and managing data pipelines that ensure efficient, reliable integration, transformation, and delivery of data across the department.
The Data Engineering Manager will:
Design and develop data pipelines that extract data from multiple sources, transform it into the required formats, and load it into appropriate storage systems;
Collaborate with data scientists and analysts to optimize models, algorithms, and overall data workflows, with a focus on data quality, security, and governance;
Integrate data from a wide range of sources, including databases, data warehouses, APIs, and third party systems;
Ensure data consistency and integrity throughout the integration process by performing validation, cleaning, and other quality checks;
Transform raw data into usable formats through cleansing, aggregation, filtering, and enrichment techniques;
Ensure that data engineering practices and policies meet SOC 2 compliance requirements;
Optimize data pipelines and processing workflows for performance, scalability and efficiency;
Support the development of DevOps project structures to standardize processes and promote best practices.
How does it get done?
The Data Engineering Manager is responsible for:
Designing and enabling a modern, cloud based data lake that supports structured and semi structured data in its native form;
Monitoring and tuning data systems by identifying and resolving performance bottlenecks and implementing caching and indexing strategies to improve query performance;
Implementing data quality checks and validations within data pipelines to ensure the accuracy, consistency, and completeness of data;
Taking responsibility and accountability for maximizing the value of enterprise information assets and the analytics that support decision making, automated processes, and the augmentation of human performance;
Partnering with board members and executive leadership to define the organization¿s vision for managing data as a strategic business asset;
Establishing governance for data and algorithms used in analysis, analytical applications, and automated decision making.
Who are the customers?
This position will collaborate daily with data engineers, data analysts, security teams, and related roles to equip the analytical community with the insights and support needed to help leadership make informed decisions.
Ideal Candidate
The Ideal Candidate has:
Project experience developing and maintaining data warehouses or data lakes within modern big data environments (e.g., Snowflake);
Knowledge of Apache technologies such as Kafka, Airflow, and Spark for building scalable, efficient data pipelines;
The ability to design, build, and deploy data solutions that capture, explore, transform, and utilize data to support AI, ML, and business intelligence initiatives;
Strong programming skills in languages such as Java, Python, and C/C++, along with proficiency in tools such as SQL, R, SAS, or Excel;
The ability to collaborate within and across teams with varying levels of technical expertise, supporting delivery efforts and educating end users on data products;
Advanced problem solving and debugging skills, including the ability to identify root causes in unfamiliar code or systems and resolve recurring issues;
Excellent business acumen and interpersonal skills, with the ability to work across business lines at senior levels to influence, drive alignment, and achieve shared goals;
Minimum Qualification
A Bachelor's degree in Computer Science, Data Science, Software Engineering, Information Systems, or related quantitative field and seven (7) years of combined experience in cloud engineering, cloud migration, data engineering, data integration, streaming data development, data warehousing, data curation, data analysis, design, storage, and data protection and security. At least two (2) years of which must be leading/supervising a data management team. Any combination of education from an accredited college or university in a related quantitative field and/or direct experience in master data management, data analytics, or data engineering cloud engineering totaling eleven (11) years, including two (2) years supervisory experience, may substitute for the required education and experience.
Employment Requirements
Must possess and maintain a valid Driver's License.
Must possess or obtain Defensive Driving Certificate.
Employment is subject to a pre-employment criminal background investigation and is conditional pending results.
Supplemental Information
Do you know what Total Compensation is? Click here
Agency Contact Information: Theresa Romero, (505) 394-2977. Email
For information on Statutory Requirements for this position, click the Classification Description link on the job advertisement.
Bargaining Unit Position
This position is not covered by a collective bargaining agreement.