GCP Architect
TechDigital Group, Secaucus, NJ, United States
General Description
8+ years of experience in Data Engineering or L3 level support in data Analytics
Experience with Data Lake, data warehouse ETL pipeline development and design
Hands-on experience with GCP data and analytics services such as Cloud DataProc, Cloud Dataflow, Cloud Dataprep, Apache Beam/Composer, Cloud BigQuery
Data Pipeline Development: Design, develop, and maintain ETL/ELT pipelines for seamless data flow using DBT or GCP BigQuery
Data Modelling: Implement and manage data models in BigQuery to support analytics and reporting
Version Control: Use GIT for managing changes in data pipelines, schemas, and code
Strong coding skills in SQL, Python, or Java
Technical Requirements
Create and support data models and implement ETL processes based on business needs
Monitor data quality to ensure accuracy and availability for stakeholders
Maintain company data lake (UDP) and regional platforms data streaming from Apache Kafka
Develop scalable data pipelines and API integrations for increasing data volumes
Collaborate with analytics and business teams to enhance data models for BI tools
Write unit/integration tests, document work, and contribute to engineering wiki
Troubleshoot data issues through analysis
Work with frontend/backend engineers, product managers, and analysts
Design data integrations and data quality frameworks
Evaluate open source and vendor tools for data lineage
Develop long-term data platform strategies in collaboration with business units
Plan and maintain data architectures aligned with business needs
Support digital projects by understanding solutions and data structures
Create reports, dashboards, and datasets for business users
Maintain existing reports and dashboards
Soft Skills
Excellent communication and presentation skills
Problem-solving and critical thinking abilities
Project management and organizational skills
Team collaboration and leadership
Market awareness and client focus
Certifications (Optional)
Google Professional Data Engineer
Google Professional Data Architect
Educational Qualifications
Bachelor's Degree in Computer Science, Computer Engineering, or related field
#J-18808-Ljbffr
8+ years of experience in Data Engineering or L3 level support in data Analytics
Experience with Data Lake, data warehouse ETL pipeline development and design
Hands-on experience with GCP data and analytics services such as Cloud DataProc, Cloud Dataflow, Cloud Dataprep, Apache Beam/Composer, Cloud BigQuery
Data Pipeline Development: Design, develop, and maintain ETL/ELT pipelines for seamless data flow using DBT or GCP BigQuery
Data Modelling: Implement and manage data models in BigQuery to support analytics and reporting
Version Control: Use GIT for managing changes in data pipelines, schemas, and code
Strong coding skills in SQL, Python, or Java
Technical Requirements
Create and support data models and implement ETL processes based on business needs
Monitor data quality to ensure accuracy and availability for stakeholders
Maintain company data lake (UDP) and regional platforms data streaming from Apache Kafka
Develop scalable data pipelines and API integrations for increasing data volumes
Collaborate with analytics and business teams to enhance data models for BI tools
Write unit/integration tests, document work, and contribute to engineering wiki
Troubleshoot data issues through analysis
Work with frontend/backend engineers, product managers, and analysts
Design data integrations and data quality frameworks
Evaluate open source and vendor tools for data lineage
Develop long-term data platform strategies in collaboration with business units
Plan and maintain data architectures aligned with business needs
Support digital projects by understanding solutions and data structures
Create reports, dashboards, and datasets for business users
Maintain existing reports and dashboards
Soft Skills
Excellent communication and presentation skills
Problem-solving and critical thinking abilities
Project management and organizational skills
Team collaboration and leadership
Market awareness and client focus
Certifications (Optional)
Google Professional Data Engineer
Google Professional Data Architect
Educational Qualifications
Bachelor's Degree in Computer Science, Computer Engineering, or related field
#J-18808-Ljbffr