Sr Data Engineer
TechTriad, New York, NY, United States
Location: New York City, NY, 10001- 3 days onsite
Duration: Full-Time
Overview
The ideal candidate has hands-on experience building modern data pipelines and platforms using
Python, SQL, and AWS services
such as
Glue, Lambda, S3, EMR, Kinesis, and SageMaker . You will work on cloud-native analytics, leveraging open-source tools and machine learning frameworks to optimize data workflows and enhance the delivery of innovative payment and financial solutions. This role requires a strong foundation in
data structures, algorithms, and database management , along with proficiency in data visualization tools like
Tableau
or
AWS QuickSight . You’ll also apply best practices in version control, CI/CD, and Infrastructure as Code using
Terraform
to manage secure and scalable cloud environments.
Responsibilities
Build modern data pipelines and platforms using Python, SQL, and AWS services (Glue, Lambda, S3, EMR, Kinesis, SageMaker).
Work on cloud-native analytics to optimize data workflows and support financial solutions.
Leverage open-source tools and ML frameworks to enhance data delivery and analytics capabilities.
Apply best practices in version control, continuous integration/continuous deployment, and IaC with Terraform to manage secure cloud environments.
Required Qualifications
Bachelor’s degree or the equivalent in a scientific or quantitative discipline, such as Mathematics, Engineering, Computer Science, Economics, or Physical Sciences
5+ years of experience or equivalent in the data engineering/science field as a programmer, analyst, engineer or scientist
Hands-on development experience using programming languages, ideally Python, with statistical and data visualization libraries, such as pandas and matplotlib
Experience with data structures, algorithms and database query languages, such as SQL
Familiarity using git code repositories and interactive editors, such as Jupyter notebooks, Sublime or VS Code
Familiarity with cloud services for data management and analysis, such as AWS Glue
Experience managing a variety of large-scale data sets on Linux, Windows or MacOS
Excellent writing and presentation skills
#J-18808-Ljbffr
Duration: Full-Time
Overview
The ideal candidate has hands-on experience building modern data pipelines and platforms using
Python, SQL, and AWS services
such as
Glue, Lambda, S3, EMR, Kinesis, and SageMaker . You will work on cloud-native analytics, leveraging open-source tools and machine learning frameworks to optimize data workflows and enhance the delivery of innovative payment and financial solutions. This role requires a strong foundation in
data structures, algorithms, and database management , along with proficiency in data visualization tools like
Tableau
or
AWS QuickSight . You’ll also apply best practices in version control, CI/CD, and Infrastructure as Code using
Terraform
to manage secure and scalable cloud environments.
Responsibilities
Build modern data pipelines and platforms using Python, SQL, and AWS services (Glue, Lambda, S3, EMR, Kinesis, SageMaker).
Work on cloud-native analytics to optimize data workflows and support financial solutions.
Leverage open-source tools and ML frameworks to enhance data delivery and analytics capabilities.
Apply best practices in version control, continuous integration/continuous deployment, and IaC with Terraform to manage secure cloud environments.
Required Qualifications
Bachelor’s degree or the equivalent in a scientific or quantitative discipline, such as Mathematics, Engineering, Computer Science, Economics, or Physical Sciences
5+ years of experience or equivalent in the data engineering/science field as a programmer, analyst, engineer or scientist
Hands-on development experience using programming languages, ideally Python, with statistical and data visualization libraries, such as pandas and matplotlib
Experience with data structures, algorithms and database query languages, such as SQL
Familiarity using git code repositories and interactive editors, such as Jupyter notebooks, Sublime or VS Code
Familiarity with cloud services for data management and analysis, such as AWS Glue
Experience managing a variety of large-scale data sets on Linux, Windows or MacOS
Excellent writing and presentation skills
#J-18808-Ljbffr