Data Engineer
PDS, Salt Lake City, UT, United States
We are seeking a Data Engineer with strong experience in Azure, Databricks, and data ingestion pipelines. This role focuses on building scalable ELT pipelines using Databricks and Medallion (Bronze/Silver/Gold) architecture to support analytics and reporting.
Key Responsibilities
Design and build data ingestion and transformation pipelines using Azure Data Factory, ADLS Gen2, and Databricks
Implement Medallion architecture patterns for raw, curated, and analytics‑ready data
Ingest data from enterprise systems such as ERP, CRM, APIs, and external sources
Develop and optimize Databricks jobs using PySpark, Spark SQL, and Delta Lake
Support data migration, validation, and reconciliation efforts
Collaborate with data architects and stakeholders on data models and definitions
Monitor and optimize pipelines for performance, reliability, and cost
Contribute to CI/CD, automation, and data engineering best practices
Required Qualifications
3-5+ years of experience in Data Engineering
Strong hands‑on experience with Azure data services and Azure Databricks
Solid understanding of Medallion architecture and lakehouse design
Strong SQL and Python skills
Experience with API‑based integrations
Strong understanding of data modeling concepts
Nice to Have
Experience with streaming technologies such as Event Hubs, Kafka, or Structured Streaming
Power BI experience
Experience migrating legacy or on‑prem data platforms to Azure
#J-18808-Ljbffr
Key Responsibilities
Design and build data ingestion and transformation pipelines using Azure Data Factory, ADLS Gen2, and Databricks
Implement Medallion architecture patterns for raw, curated, and analytics‑ready data
Ingest data from enterprise systems such as ERP, CRM, APIs, and external sources
Develop and optimize Databricks jobs using PySpark, Spark SQL, and Delta Lake
Support data migration, validation, and reconciliation efforts
Collaborate with data architects and stakeholders on data models and definitions
Monitor and optimize pipelines for performance, reliability, and cost
Contribute to CI/CD, automation, and data engineering best practices
Required Qualifications
3-5+ years of experience in Data Engineering
Strong hands‑on experience with Azure data services and Azure Databricks
Solid understanding of Medallion architecture and lakehouse design
Strong SQL and Python skills
Experience with API‑based integrations
Strong understanding of data modeling concepts
Nice to Have
Experience with streaming technologies such as Event Hubs, Kafka, or Structured Streaming
Power BI experience
Experience migrating legacy or on‑prem data platforms to Azure
#J-18808-Ljbffr