Sr. ETL Developer
3B Staffing LLC, Irving, TX, United States
JOB: Sr. ETL Developer
LOCATION : 290 E. John Carpenter Freeway, Irving 75062 (onsite Tues.-Thurs. required)
TYPE : 6+ month contract (long-term contract she said could be 2+ years; possibly convert in the future--not guaranteed when)
*Open to visa candidates if well-vetted
INTERVIEWS : Video SQL screen with us; 1) 30-min. Teams (technical interview with client); 2) 1-hour onsite including SQL coding and Databricks technical interview
(no exceptions - has to be onsite )
Must Have : 7+ years of ETL development with expertise in Databricks (Delta Lake, Unity Catalog), SQL Server, SSIS, ADF, advanced SQL, and CI/CD in a DataOps environment, with preferred skills in PySpark/Python and pharmaceutical data experience.
REQUIREMENTS :
7+ years' experience in Database engineering and ETL design/development/maintenance
Expertise in Databricks and SQL Server database development and ETL:
Knowledgeable of Databricks Delta Lake architecture, Unity Catalog, Notebooks, Workflows
SQL in Databricks Notebooks and SSIS ETL package development
Intermediate skillset in ADF for data pipelines required
Advanced SQL skills required --complex queries, stored procedures, advanced window functions, CTE, etc.
PySpark or Python development preferred (Python not required, but would really prefer one of the two)
Must be proficient in query tuning and optimization as well
Experience in Agile dataOps environment ; familiar with CI/CD pipelines for data engineering (using Pulumi here, not Azure DevOps here--can be easily taught)
Good written/verbal communication skills
(not heavily business-facing but still a small company that will be part of meetings)
Healthcare industry experience a bonus; not required--would like someone familiar with the terminology and type of data files, but mostly dealing with pharmaceutical transactional data here (not much HIPAA data)
Bachelors of Science in Computer Science, MIS, Analytics or equivalent work experience
LOCATION : 290 E. John Carpenter Freeway, Irving 75062 (onsite Tues.-Thurs. required)
TYPE : 6+ month contract (long-term contract she said could be 2+ years; possibly convert in the future--not guaranteed when)
*Open to visa candidates if well-vetted
INTERVIEWS : Video SQL screen with us; 1) 30-min. Teams (technical interview with client); 2) 1-hour onsite including SQL coding and Databricks technical interview
(no exceptions - has to be onsite )
Must Have : 7+ years of ETL development with expertise in Databricks (Delta Lake, Unity Catalog), SQL Server, SSIS, ADF, advanced SQL, and CI/CD in a DataOps environment, with preferred skills in PySpark/Python and pharmaceutical data experience.
REQUIREMENTS :
7+ years' experience in Database engineering and ETL design/development/maintenance
Expertise in Databricks and SQL Server database development and ETL:
Knowledgeable of Databricks Delta Lake architecture, Unity Catalog, Notebooks, Workflows
SQL in Databricks Notebooks and SSIS ETL package development
Intermediate skillset in ADF for data pipelines required
Advanced SQL skills required --complex queries, stored procedures, advanced window functions, CTE, etc.
PySpark or Python development preferred (Python not required, but would really prefer one of the two)
Must be proficient in query tuning and optimization as well
Experience in Agile dataOps environment ; familiar with CI/CD pipelines for data engineering (using Pulumi here, not Azure DevOps here--can be easily taught)
Good written/verbal communication skills
(not heavily business-facing but still a small company that will be part of meetings)
Healthcare industry experience a bonus; not required--would like someone familiar with the terminology and type of data files, but mostly dealing with pharmaceutical transactional data here (not much HIPAA data)
Bachelors of Science in Computer Science, MIS, Analytics or equivalent work experience