Azure Databricks Engineer
Ethereum Technologies LLC, Houston, TX, United States
Seeking a Specialist with 7 years of experience in designing and developing scalable data solutions using Azure Databricks
Design develop and optimize scalable data pipelines leveraging Azure Databricks to support enterprise level data processing and analytics Implement and maintain ETL workflows ensuring high performance data quality and reliability Integrate Azure Databricks with various Azure data services to build robust and scalable data platforms Monitor and optimize data workflows for scalability cost effectiveness and operational efficiency Collaborate with cross functional teams to align data solutions with business objectives and technical requirements Stay updated with the latest advancements in Azure Databricks and recommend best practices for continuous improvement
Roles and Responsibilities
Lead the design development and enhancement of complex data pipelines using Azure Databricks
Write clean maintainable and efficient PySpark and Python code to support data ingestion transformation and analytics
Troubleshoot and resolve issues related to data pipelines and workflows to ensure minimal downtime and high availability
Collaborate with data architects analysts and stakeholders to gather requirements and deliver scalable data solutions
Mentor and guide junior team members on Azure Databricks and best practices in data engineering
Document data processes architectures and workflows to ensure knowledge sharing and compliance
Participate actively in design discussions code reviews and agile ceremonies to foster a collaborative and high performing team environment
ETHEREUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ETHEREUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ETHEREUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract
#J-18808-Ljbffr
Design develop and optimize scalable data pipelines leveraging Azure Databricks to support enterprise level data processing and analytics Implement and maintain ETL workflows ensuring high performance data quality and reliability Integrate Azure Databricks with various Azure data services to build robust and scalable data platforms Monitor and optimize data workflows for scalability cost effectiveness and operational efficiency Collaborate with cross functional teams to align data solutions with business objectives and technical requirements Stay updated with the latest advancements in Azure Databricks and recommend best practices for continuous improvement
Roles and Responsibilities
Lead the design development and enhancement of complex data pipelines using Azure Databricks
Write clean maintainable and efficient PySpark and Python code to support data ingestion transformation and analytics
Troubleshoot and resolve issues related to data pipelines and workflows to ensure minimal downtime and high availability
Collaborate with data architects analysts and stakeholders to gather requirements and deliver scalable data solutions
Mentor and guide junior team members on Azure Databricks and best practices in data engineering
Document data processes architectures and workflows to ensure knowledge sharing and compliance
Participate actively in design discussions code reviews and agile ceremonies to foster a collaborative and high performing team environment
ETHEREUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ETHEREUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ETHEREUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract
#J-18808-Ljbffr