Data Engineer - Senior
HTC Global Services, Fort Wayne, IN, United States
Overview
We are looking for a
Senior Data Engineer
with over 8 years of experience in data engineering to design, build, and maintain scalable data solutions. The role focuses on leveraging Azure services, including Azure Databricks and Azure Data Lake, to develop efficient data pipelines and support data processing and analytics needs.
Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Factory
Write clean, modular, and scalable Python code for data ingestion, transformation, and integration
Develop and optimize complex SQL queries and stored procedures
Implement ETL/ELT processes and manage large-scale data flows from multiple sources to data lake/warehouse
Ensure data quality, integrity, and security across all stages of data processing
Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions
Apply data modeling, data warehousing concepts, and big data best practices
Utilize version control, CI/CD pipelines, and Agile methodologies in development processes
Required Qualifications
8+ years of experience in data engineering or a related field
Strong hands-on experience with Azure Databricks, Azure Data Lake, and other Azure services
Proficiency in Python and PySpark
Strong command of SQL for data querying and transformation
Understanding of data modeling, data warehousing concepts, and big data best practices
Experience with Git, CI/CD pipelines, and Agile methodologies
Excellent communication and problem-solving skills
HTC Global Services is an Equal Opportunity Employer. Our employees have access to a comprehensive benefits package including Group Health (Medical, Dental, and Vision), Paid Time Off, Paid Holidays, 401(k) matching, Group Life and Disability insurance, Professional Development opportunities, Wellness programs, and other perks. We are committed to providing a workplace free from discrimination and harassment, where every employee is treated with dignity and respect. We celebrate differences and believe that diverse cultures, perspectives, and skills drive innovation and success.
#J-18808-Ljbffr
We are looking for a
Senior Data Engineer
with over 8 years of experience in data engineering to design, build, and maintain scalable data solutions. The role focuses on leveraging Azure services, including Azure Databricks and Azure Data Lake, to develop efficient data pipelines and support data processing and analytics needs.
Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Factory
Write clean, modular, and scalable Python code for data ingestion, transformation, and integration
Develop and optimize complex SQL queries and stored procedures
Implement ETL/ELT processes and manage large-scale data flows from multiple sources to data lake/warehouse
Ensure data quality, integrity, and security across all stages of data processing
Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions
Apply data modeling, data warehousing concepts, and big data best practices
Utilize version control, CI/CD pipelines, and Agile methodologies in development processes
Required Qualifications
8+ years of experience in data engineering or a related field
Strong hands-on experience with Azure Databricks, Azure Data Lake, and other Azure services
Proficiency in Python and PySpark
Strong command of SQL for data querying and transformation
Understanding of data modeling, data warehousing concepts, and big data best practices
Experience with Git, CI/CD pipelines, and Agile methodologies
Excellent communication and problem-solving skills
HTC Global Services is an Equal Opportunity Employer. Our employees have access to a comprehensive benefits package including Group Health (Medical, Dental, and Vision), Paid Time Off, Paid Holidays, 401(k) matching, Group Life and Disability insurance, Professional Development opportunities, Wellness programs, and other perks. We are committed to providing a workplace free from discrimination and harassment, where every employee is treated with dignity and respect. We celebrate differences and believe that diverse cultures, perspectives, and skills drive innovation and success.
#J-18808-Ljbffr