Principal Data/Software Engineer
Federal Reserve Bank of New York, Boston, MA, United States
Top level technical expert in one or more highly specialized areas of applications systems analysis and programming. Responsible for software design, coding, testing, debugging, and documentation. Has full technical knowledge of all phases of applications systems analysis and development. Provides technical leadership on complex projects. Interacts with internal project teams and work groups regularly. Level of work required is considered highly advanced and staff must be able to work under minimal supervision. This job does not have any direct reports. You have an appetite to learn, and a passion for technology, innovation, and developing new skills on evolving technologies.**Position Contributions-**Top level technical expert in one or more highly specialized areas of applications systems analysis and programming. Responsible for software design, coding, testing, debugging, and documentation. Has full technical knowledge of all phases of applications systems analysis and development. Provides technical leadership on complex projects. Interacts with internal project teams and work groups regularly. Level of work required is considered highly advanced and staff must be able to work under minimal supervision. This job does not have any direct reports. You have an appetite to learn, and a passion for technology, innovation, and developing new skills on evolving technologies.**What will be expected of you-*** Serves as a Principal Data Engineer: to design, develop and implement end-to-end data pipelines for ingestion, transformation, and distribution, supporting both batch and streaming workloads in accordance with FedNow and Fed Standards.* Develops software solutions that are reusable, well-documented, and optimized for Analytics, BI, and AI/ML consumers. Implements and manages modern data lake and Lakehouse architectures, including Apache Iceberg table formats.* Optimizes data platforms for performance, scalability, cost efficiency, and reliability. Collaborates closely with architects, product managers, analytics teams, and platform engineers to align data solutions with business needs.* Defines and enforces data quality standards, implementing automated validation and monitoring.* In addition to being able to engineer across numerous areas of technology, you’ll serve as subject matter expert in one or more areas* Trains and consults cross functionally within the organization on troubleshooting/resolving highly complex and/or highly time critical problems* Collaborates with analysts as part of an integrated Agile team to define user requirements and conduct design review for the development of complex and innovative cloud applications using modern internet-scale technologies and Serverless architecture in Cloud* Demonstrates skill dexterity; seeking to continuously adapt and employ new technical skills alongside proven staples* Ensures that the quality of software developed, maintained and enhanced in-house and installed into production is sufficient to prevent the occurrence of catastrophic defects that cause the customer significant problems, missed deadlines, or interruption to the production environment* Ensure compliance with Fed policies, procedures and standards* Provides primary or backup production support for applications and components, including but not limited to timely resolution to production problems and processing issues**Expertise you will bring-*** + 8+ years of implementing data-intensive solutions using agile methodologies (Scrum, Kanban, Lean etc).
+ 4+ years working with AWS cloud-based platforms in an enterprise environment.
+ Experience designing and building performant, resilient big data solutions.
+ Deep expertise in programming languages used in data engineering such as **Python and Java**.
+ Experience developing high performance, high volume, highly available
+ (24/7/365) environments
+ Experience with Agile software engineering (Scrum, Kanban, Lean etc)
+ Bachelor's degree in Computer Science, Information Systems,**Logistics& Requirements-*** Deep expertise in Python and Java and proficient knowledge of programming languages (JavaScript, XML, JSON, HTML, CSS etc.)* Proficient knowledge of operating systems (Linux, Unix, Windows)* Proficient knowledge of database development (SQL, Oracle, DB2)* Ideally, you’ll have experience with AWS services, and integrating them into an application* Ideally you’ll have experience with leading edge Cloud technologies, such as Kafka, in-memory and NoSQL databases, messaging platforms, memcache etc).* Demonstrates independent thinking and decision-making abilities* Demonstrates excellent written and oral communication abilities* Proficient knowledge of cloud security for application development and delivery* Advanced knowledge of object-oriented programming* Ideally, Infrastructure as Code (IAC); Terraform**Nice to Have-*** Experience with API Development and consumption and microservices architecture* Experience with agile development methodology* Knowledge of technology project and secure coding standards* Strong interpersonal, teamwork and negotiation skills* Strong customer service skills* Strong problem solving and critical thinking skills* Familiarity with usability techniques and best practices* Infrastructure as Code (IAC); TerraformOUR BANK has one of the most recognizable brands around the world. The Federal Reserve is the central bank of the United States—one of the world's most influential, trusted and prestigious financial organizations. The Federal Reserve is charged with the important mission of promoting a strong economy and a stable financial system and fulfills this responsibility by formulating national monetary policy, supervising and regulating banks and bank holding companies, and providing financial services for banks and the U.S. government.OUR PEOPLE are diverse in background and ideas, which allows for ongoing creativity and innovation. Ultimately, they are the ones who push our high-performance, exchange-driven culture forward.Why Our People Choose Us:
Our reputation precedes us
There will always be room for personal growth
Our people are first
You’ll find the right balance
Your responsibilities will be meaningfulWe hope that you will be our future colleague.Always verify and apply to jobs on
or through verified Federal Reserve Bank social media channels.
#J-18808-Ljbffr
+ 4+ years working with AWS cloud-based platforms in an enterprise environment.
+ Experience designing and building performant, resilient big data solutions.
+ Deep expertise in programming languages used in data engineering such as **Python and Java**.
+ Experience developing high performance, high volume, highly available
+ (24/7/365) environments
+ Experience with Agile software engineering (Scrum, Kanban, Lean etc)
+ Bachelor's degree in Computer Science, Information Systems,**Logistics& Requirements-*** Deep expertise in Python and Java and proficient knowledge of programming languages (JavaScript, XML, JSON, HTML, CSS etc.)* Proficient knowledge of operating systems (Linux, Unix, Windows)* Proficient knowledge of database development (SQL, Oracle, DB2)* Ideally, you’ll have experience with AWS services, and integrating them into an application* Ideally you’ll have experience with leading edge Cloud technologies, such as Kafka, in-memory and NoSQL databases, messaging platforms, memcache etc).* Demonstrates independent thinking and decision-making abilities* Demonstrates excellent written and oral communication abilities* Proficient knowledge of cloud security for application development and delivery* Advanced knowledge of object-oriented programming* Ideally, Infrastructure as Code (IAC); Terraform**Nice to Have-*** Experience with API Development and consumption and microservices architecture* Experience with agile development methodology* Knowledge of technology project and secure coding standards* Strong interpersonal, teamwork and negotiation skills* Strong customer service skills* Strong problem solving and critical thinking skills* Familiarity with usability techniques and best practices* Infrastructure as Code (IAC); TerraformOUR BANK has one of the most recognizable brands around the world. The Federal Reserve is the central bank of the United States—one of the world's most influential, trusted and prestigious financial organizations. The Federal Reserve is charged with the important mission of promoting a strong economy and a stable financial system and fulfills this responsibility by formulating national monetary policy, supervising and regulating banks and bank holding companies, and providing financial services for banks and the U.S. government.OUR PEOPLE are diverse in background and ideas, which allows for ongoing creativity and innovation. Ultimately, they are the ones who push our high-performance, exchange-driven culture forward.Why Our People Choose Us:
Our reputation precedes us
There will always be room for personal growth
Our people are first
You’ll find the right balance
Your responsibilities will be meaningfulWe hope that you will be our future colleague.Always verify and apply to jobs on
or through verified Federal Reserve Bank social media channels.
#J-18808-Ljbffr