Big Data Developer
New York Technology Partners, St Louis, MO, United States
Big data role
St Louis, MO onsite
A high number of candidates may make applications for this position, so make sure to send your CV and application through as soon as possible.
Spark, Scala, PySpark, Python is mandatory skills.
Role Overview:
Team Focus: Supports critical data ingestion, streaming and model monitoring platforms that enable real time decisioning and fraud risk capabilities across Mastercard. The team contributes to enhancements & modernization. The main team focus right now is model monitoring, second is modernization of applications/legacy systems and third, leveraging AI tools
High level overview: Engineer with experience in Scala, Python or Java, Big Data+ AWS/Databricks. Needs AI agent knowledge to create agents within the team to automate the processes
Core skills:
• Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI)
• Big Data Platforms (Spark, Hadoop/Ozone, xywuqvp Hive or impala, AWS, Databricks, cloudera manager platform)
• Production Support & Platform Reliability (using Splunk for monitoring, troubleshooting, performance tuning)
• Strong SQL
• AI agent knowledge
Team schedule: Onsite Monday, Tues and Fri
St Louis, MO onsite
A high number of candidates may make applications for this position, so make sure to send your CV and application through as soon as possible.
Spark, Scala, PySpark, Python is mandatory skills.
Role Overview:
Team Focus: Supports critical data ingestion, streaming and model monitoring platforms that enable real time decisioning and fraud risk capabilities across Mastercard. The team contributes to enhancements & modernization. The main team focus right now is model monitoring, second is modernization of applications/legacy systems and third, leveraging AI tools
High level overview: Engineer with experience in Scala, Python or Java, Big Data+ AWS/Databricks. Needs AI agent knowledge to create agents within the team to automate the processes
Core skills:
• Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI)
• Big Data Platforms (Spark, Hadoop/Ozone, xywuqvp Hive or impala, AWS, Databricks, cloudera manager platform)
• Production Support & Platform Reliability (using Splunk for monitoring, troubleshooting, performance tuning)
• Strong SQL
• AI agent knowledge
Team schedule: Onsite Monday, Tues and Fri