Data Engineer IV
Motion Industries, Birmingham, AL, United States
Overview
Birmingham, AL, USA • Full time
Role: Data Engineer IV – focuses on data transformation, quality, and pipeline design for ETL processes. Responsible for cleaning and transforming raw data into a usable format, implementing data validation and quality checks, optimizing storage and retrieval for performance, and collaborating with data scientists to ensure data readiness for analytics and machine learning. Eligibility to work in the US without Visa Sponsorship required.
Job Duties
Design and Build Pipelines: Create, maintain, and optimize scalable data pipelines that handle extraction from various sources, transformation into a consistent format, and loading into destinations for analysis and reporting.
Develop Transformation Logic: Implement algorithms and logic to clean, standardize, and transform data into a consistent and actionable format for downstream use.
Integrate: Combine raw information from diverse sources to create unified, comprehensive datasets for analytical purposes.
Implement Quality Checks: Design and implement robust data validation processes, data quality checks, and error handling to ensure accuracy and reliability of datasets.
Ensure Consistency: Maintain data consistency across various systems to ensure reliable data for business decision-making.
Optimize Data Infrastructure: Develop and manage data architecture, including databases and data warehouses, for efficient storage, quick retrieval, and accessibility of data.
Collaborate with Stakeholders: Partner with data scientists, analysts, and other teams to understand data requirements and deliver high-quality, ready-to-use datasets.
Performance Tuning: Optimize database and query performance through fine-tuning, indexing, and other strategies to ensure fast, resource-efficient data processing and retrieval.
Mentorship and Leadership: Manage critical projects and advise junior team members; mentor developers with code reviews, design reviews, and unit test plan reviews.
Other duties as assigned.
Education & Experience
Typically requires a bachelor's degree in computer science, software engineering, or a related field and eight (8) or more years of related experience; or an equivalent combination.
Knowledge, Skills, Abilities
Cloud data engineering experience (Google Cloud Platform, AWS, Azure or similar)
SQL
Python
AI/ML
Ability to automate and operationalize machine learning workflows
Apply knowledge to analyze and develop solutions to highly complex problems
Develop and maintain knowledge of key business processes and requirements
Understand key business drivers and translate needs to technical solutions
Ability to collaborate effectively with senior management
Compensation & Benefits
Motion offers an excellent benefits package including options for healthcare coverage, 401(k), tuition reimbursement, vacation, sick, and holiday pay.
Disclaimers
This job description illustrates the general nature and level of work performed. It is not intended to be a comprehensive inventory of duties. Management reserves the right to modify duties at any time. See description for more details. Equal employment opportunity: GPC prohibits discrimination and provides equal opportunity to all employees and applicants. See company policy for details.
Note
Where permitted by law, successful applicants must be fully vaccinated against COVID-19 prior to start date, subject to approved accommodations. Proof of vaccination may be required on or before start date.
#J-18808-Ljbffr
Birmingham, AL, USA • Full time
Role: Data Engineer IV – focuses on data transformation, quality, and pipeline design for ETL processes. Responsible for cleaning and transforming raw data into a usable format, implementing data validation and quality checks, optimizing storage and retrieval for performance, and collaborating with data scientists to ensure data readiness for analytics and machine learning. Eligibility to work in the US without Visa Sponsorship required.
Job Duties
Design and Build Pipelines: Create, maintain, and optimize scalable data pipelines that handle extraction from various sources, transformation into a consistent format, and loading into destinations for analysis and reporting.
Develop Transformation Logic: Implement algorithms and logic to clean, standardize, and transform data into a consistent and actionable format for downstream use.
Integrate: Combine raw information from diverse sources to create unified, comprehensive datasets for analytical purposes.
Implement Quality Checks: Design and implement robust data validation processes, data quality checks, and error handling to ensure accuracy and reliability of datasets.
Ensure Consistency: Maintain data consistency across various systems to ensure reliable data for business decision-making.
Optimize Data Infrastructure: Develop and manage data architecture, including databases and data warehouses, for efficient storage, quick retrieval, and accessibility of data.
Collaborate with Stakeholders: Partner with data scientists, analysts, and other teams to understand data requirements and deliver high-quality, ready-to-use datasets.
Performance Tuning: Optimize database and query performance through fine-tuning, indexing, and other strategies to ensure fast, resource-efficient data processing and retrieval.
Mentorship and Leadership: Manage critical projects and advise junior team members; mentor developers with code reviews, design reviews, and unit test plan reviews.
Other duties as assigned.
Education & Experience
Typically requires a bachelor's degree in computer science, software engineering, or a related field and eight (8) or more years of related experience; or an equivalent combination.
Knowledge, Skills, Abilities
Cloud data engineering experience (Google Cloud Platform, AWS, Azure or similar)
SQL
Python
AI/ML
Ability to automate and operationalize machine learning workflows
Apply knowledge to analyze and develop solutions to highly complex problems
Develop and maintain knowledge of key business processes and requirements
Understand key business drivers and translate needs to technical solutions
Ability to collaborate effectively with senior management
Compensation & Benefits
Motion offers an excellent benefits package including options for healthcare coverage, 401(k), tuition reimbursement, vacation, sick, and holiday pay.
Disclaimers
This job description illustrates the general nature and level of work performed. It is not intended to be a comprehensive inventory of duties. Management reserves the right to modify duties at any time. See description for more details. Equal employment opportunity: GPC prohibits discrimination and provides equal opportunity to all employees and applicants. See company policy for details.
Note
Where permitted by law, successful applicants must be fully vaccinated against COVID-19 prior to start date, subject to approved accommodations. Proof of vaccination may be required on or before start date.
#J-18808-Ljbffr