Software Development Engineer, Open Data Analytics - Engines
Amazon, Arlington, VA, United States
Want to change the world with Big Data and Analytics? Come join us on the Amazon Analytics team in Amazon Web Services!
Amazon EMR is a web service which enables customers to run massive clusters with open-source data processing frameworks like Spark, Trino, Flink, Hive, Hadoop, HBase and more, with the ability to effortlessly scale up and down as needed. We run a large number of customer clusters, enabling a variety of customer use cases including analytics and web‑scale machine learning.
We are doing innovative work on the open source data processing frameworks with the goal of making the EMR the best place to run big‑data workloads. We’re looking for top engineers to design and build features and accelerate performance.
You will work backwards from the customer needs and get to do everything from designing and building large‑scale systems and features for the savviest customers in the business.
You will have a chance to work with the open‑source community and contribute to open‑source projects including Spark, Trino, Flink, Hive, Hadoop and HBase. You need to be a top software developer with excellent programming skills, an understanding of distributed systems and parallel data processing, and a stellar record of delivery, while excelling at leadership, customer obsession and having a real passion for massive‑scale computing.
By joining our team you will get to work with a minimum of technical supervision, playing a variety of roles as needed to respond efficiently to multiple program priorities, collaborating with the best and brightest minds in the industry, and enjoying a competitive salary, great benefits, a creative and agile work environment, and the opportunity to make products that millions use every day.
Key job responsibilities
Designing and building the next‑generation technologies that will make EMR the best environment to run large‑scale data processing workloads.
Working on complex problems in distributed systems and query engines.
Translating complex functional and technical requirements into detailed architecture and design.
Delivering systems and features with top‑notch quality, on time.
Owning the software development process end‑to‑end, including working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying and operating production EMR systems.
Basic Qualifications
Experience programming with at least one software programming language.
1+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling).
2+ years of non‑internship professional software development experience.
2+ years of non‑internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
3+ years of experience with a Master’s degree in Computer Science or equivalent OR 5+ years experience with a Bachelor’s Degree in Computer Science or equivalent, in software development, including design, implementation, debugging, and support.
Very strong Computer Science fundamentals in algorithm design, data structures, problem solving, and complexity analysis.
Strong proficiency in developing object‑oriented software, with deep experience in one or more relevant languages (Java, C, C++, C#).
Preferred Qualifications
3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
Experience in query processing, query engines, and/or query optimization.
Thorough understanding of parallel algorithms, concurrency, asynchronous architectures.
Proficiency in high‑performance, multi‑threaded programming.
Knowledge of and contribution to the Hadoop ecosystem.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
The base salary range for this position is listed below. Your Amazon package will include sign‑on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, VA, Arlington - 143,700.00 - 194,400.00 USD annually
#J-18808-Ljbffr
Amazon EMR is a web service which enables customers to run massive clusters with open-source data processing frameworks like Spark, Trino, Flink, Hive, Hadoop, HBase and more, with the ability to effortlessly scale up and down as needed. We run a large number of customer clusters, enabling a variety of customer use cases including analytics and web‑scale machine learning.
We are doing innovative work on the open source data processing frameworks with the goal of making the EMR the best place to run big‑data workloads. We’re looking for top engineers to design and build features and accelerate performance.
You will work backwards from the customer needs and get to do everything from designing and building large‑scale systems and features for the savviest customers in the business.
You will have a chance to work with the open‑source community and contribute to open‑source projects including Spark, Trino, Flink, Hive, Hadoop and HBase. You need to be a top software developer with excellent programming skills, an understanding of distributed systems and parallel data processing, and a stellar record of delivery, while excelling at leadership, customer obsession and having a real passion for massive‑scale computing.
By joining our team you will get to work with a minimum of technical supervision, playing a variety of roles as needed to respond efficiently to multiple program priorities, collaborating with the best and brightest minds in the industry, and enjoying a competitive salary, great benefits, a creative and agile work environment, and the opportunity to make products that millions use every day.
Key job responsibilities
Designing and building the next‑generation technologies that will make EMR the best environment to run large‑scale data processing workloads.
Working on complex problems in distributed systems and query engines.
Translating complex functional and technical requirements into detailed architecture and design.
Delivering systems and features with top‑notch quality, on time.
Owning the software development process end‑to‑end, including working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying and operating production EMR systems.
Basic Qualifications
Experience programming with at least one software programming language.
1+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling).
2+ years of non‑internship professional software development experience.
2+ years of non‑internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
3+ years of experience with a Master’s degree in Computer Science or equivalent OR 5+ years experience with a Bachelor’s Degree in Computer Science or equivalent, in software development, including design, implementation, debugging, and support.
Very strong Computer Science fundamentals in algorithm design, data structures, problem solving, and complexity analysis.
Strong proficiency in developing object‑oriented software, with deep experience in one or more relevant languages (Java, C, C++, C#).
Preferred Qualifications
3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
Experience in query processing, query engines, and/or query optimization.
Thorough understanding of parallel algorithms, concurrency, asynchronous architectures.
Proficiency in high‑performance, multi‑threaded programming.
Knowledge of and contribution to the Hadoop ecosystem.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
The base salary range for this position is listed below. Your Amazon package will include sign‑on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, VA, Arlington - 143,700.00 - 194,400.00 USD annually
#J-18808-Ljbffr