Data Integration Engineer
3B Staffing LLC, New York, NY, United States
Data Integration Engineer
We are seeking a highly skilled Integration/Data Engineer with 5+ years of experience to design, develop, and maintain robust system integrations and data pipelines across enterprise applications.
The ideal candidate will have expertise in SQL Server, SSIS, PowerShell, REST APIs, JSON, and XML, and will be responsible for ensuring seamless, secure, and accurate data flow across platforms. This role also involves leading and executing data migration initiatives and supporting ETL and automation tasks.
RESPONSIBILITIES:
Design, develop, and manage data integration solutions between enterprise systems using SSIS, REST APIs, and custom scripts.
Create and maintain ETL pipelines to ingest, transform, and load structured and semi-structured data across systems.
Ensure data quality, consistency, and integrity through validation, cleansing, and reconciliation procedures.
Develop and execute data migration plans for legacy system upgrades, application transitions, and cloud transformations.
Collaborate with business analysts, developers, and system owners to define integration and data movement requirements.
Create and maintain PowerShell scripts for automation, data transformation, and system tasks.
Monitor integration performance, troubleshoot issues, and optimize data pipelines for efficiency and reliability.
Work with JSON and XML formats for API integrations and data transformation.
Implement error handling, logging, and notification frameworks to support robust data workflows.
Maintain documentation for integration solutions, data mappings, and transformation logic.
Support data governance, security, and compliance standards related to data movement and sharing.
REQUIRED SKILLS
Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
5+ years of experience in data integration and engineering roles.
Expertise with:
SQL Server (T-SQL, stored procedures, views, performance tuning)
SSIS (package development, deployment, and automation)
PowerShell scripting
RESTful APIs integration
JSON and XML data formats
Experience designing and executing data migration and ETL strategies.
Strong analytical and problem-solving skills.
Experience in troubleshooting integration issues and identifying root causes.
Familiarity with source control tools like Git and Agile development practices.
Excellent communication and collaboration skills.
Must be certified in Microsoft Certified: Data Analyst Associate or equivalent
PREFERRED EXPERIENCE:
Experience integrating with cloud-based platforms (e.g., Azure, AWS, Salesforce).
Familiarity with API management tools (e.g., Postman, Swagger).
Knowledge of modern data platforms (e.g., Databricks, Snowflake, Azure Data Factory).
Understanding data governance, security protocols, and compliance standards.
We are seeking a highly skilled Integration/Data Engineer with 5+ years of experience to design, develop, and maintain robust system integrations and data pipelines across enterprise applications.
The ideal candidate will have expertise in SQL Server, SSIS, PowerShell, REST APIs, JSON, and XML, and will be responsible for ensuring seamless, secure, and accurate data flow across platforms. This role also involves leading and executing data migration initiatives and supporting ETL and automation tasks.
RESPONSIBILITIES:
Design, develop, and manage data integration solutions between enterprise systems using SSIS, REST APIs, and custom scripts.
Create and maintain ETL pipelines to ingest, transform, and load structured and semi-structured data across systems.
Ensure data quality, consistency, and integrity through validation, cleansing, and reconciliation procedures.
Develop and execute data migration plans for legacy system upgrades, application transitions, and cloud transformations.
Collaborate with business analysts, developers, and system owners to define integration and data movement requirements.
Create and maintain PowerShell scripts for automation, data transformation, and system tasks.
Monitor integration performance, troubleshoot issues, and optimize data pipelines for efficiency and reliability.
Work with JSON and XML formats for API integrations and data transformation.
Implement error handling, logging, and notification frameworks to support robust data workflows.
Maintain documentation for integration solutions, data mappings, and transformation logic.
Support data governance, security, and compliance standards related to data movement and sharing.
REQUIRED SKILLS
Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
5+ years of experience in data integration and engineering roles.
Expertise with:
SQL Server (T-SQL, stored procedures, views, performance tuning)
SSIS (package development, deployment, and automation)
PowerShell scripting
RESTful APIs integration
JSON and XML data formats
Experience designing and executing data migration and ETL strategies.
Strong analytical and problem-solving skills.
Experience in troubleshooting integration issues and identifying root causes.
Familiarity with source control tools like Git and Agile development practices.
Excellent communication and collaboration skills.
Must be certified in Microsoft Certified: Data Analyst Associate or equivalent
PREFERRED EXPERIENCE:
Experience integrating with cloud-based platforms (e.g., Azure, AWS, Salesforce).
Familiarity with API management tools (e.g., Postman, Swagger).
Knowledge of modern data platforms (e.g., Databricks, Snowflake, Azure Data Factory).
Understanding data governance, security protocols, and compliance standards.