OpenAI is hiring: Software Engineer, Collective Communication in San Francisco
OpenAI, San Francisco, CA, United States
Overview The Workload Networking team is responsible for the collective communication stack used in our largest training jobs. Using a combination of C++ and CUDA we work on novel collective communication techniques that enable efficient training of our flagship models on our largest custom built supercomputers.
The models we train are key ingredients to the AI research progress at OpenAI and the field as a whole, and we continually incorporate learnings from our entire research org into our training platform.
Role As a Software Engineer, Networking you will design and implement custom networking collectives that are tightly integrated into our training stack.
We\'re looking for people who have a background in low level performance critical software. Experience with collective communication is a bonus.
This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.
Responsibilities Collaborate closely with ML researchers to design and implement efficient collective operations in C++ and CUDA.
Ensure that our largest training jobs take full advantage of the different network transports used in our supercomputers.
Work on simulations to inform our future supercomputer network designs.
Qualifications Have written distributed algorithms using RDMA in the past.
Are comfortable writing low level performance sensitive CPU and/or GPU code.
Are familiar with network simulation techniques.
About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement.
Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
Compensation Range: $380K - $555K
#J-18808-Ljbffr
In Summary: The Workload Networking team is responsible for the collective communication stack used in our largest training jobs . We're looking for people who have a background in low level performance critical software . The models we train are key ingredients to the AI research progress at OpenAI and the field as a whole .
En Español: Resumen El equipo de Workload Networking es responsable de la pila de comunicación colectiva utilizada en nuestros trabajos de capacitación más grandes. Utilizando una combinación de C++ y CUDA, trabajamos en nuevas técnicas de comunicaciones colectivas que permiten un entrenamiento eficiente de nuestros modelos insignia en nuestras supercomputadoras construidas a medida mayores. Utilizamos un modelo de trabajo híbrido de 3 días por semana en la oficina y ofrecemos asistencia para la reubicación a nuevos empleados. Responsabilidades Colaborar estrechamente con investigadores del ML para diseñar e implementar operaciones colectivas eficientes en C++ y CUDA. Asegurar que nuestros trabajos más grandes de capacitación aprovechen al máximo los diferentes transportes de red utilizados en nuestras supercomputadoras. Trabajar en simulaciones para informar sobre nuestros futuros diseños de redes de superordenadores. La IA es una herramienta extremadamente poderosa que debe ser creada con seguridad y necesidades humanas en su núcleo, y para lograr nuestra misión, debemos abarcar y valorar las muchas perspectivas diferentes, voces y experiencias que forman todo el espectro de la humanidad. Somos un empleador de igualdad de oportunidades, y no discriminamos sobre la base de raza, religión, color, origen nacional, sexo, orientación sexual, edad, estatus de veterano, discapacidad, información genética u otra característica legalmente protegida aplicable. Para obtener más información, consulte OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement. Los solicitantes calificados con antecedentes de arresto o condenación serán considerados para empleo de conformidad con la ley, incluida la San Francisco Fair Chance Ordinance, la Ordenanza del Condado de Los Ángeles para los Empleadores y la Ley de California Fair Chance. Además, las tareas laborales requieren acceso a sistemas de tecnología de la información seguros y protegidos y obligaciones relacionadas con la seguridad de datos. Para notificar a OpenAI que cree que esta publicación de trabajo no es conforme, envíe un informe a través de este formulario. No se proporcionará respuesta a consultas no relacionadas con el cumplimiento de publicación de empleo. Nos comprometemos a proporcionar acomodamientos razonables a los solicitantes con discapacidades, y las solicitudes pueden hacerse a través del enlace. Política de privacidad para solicitantes globales de OpenAI En OpenAI creemos que la inteligencia artificial tiene el potencial de ayudar a las personas a resolver inmensos desafíos mundiales, y queremos compartir ampliamente la ventaja de AI. Únase a nosotros para dar forma al futuro de la tecnología. Rango de compensación: $380K - $555K #J-18808-Ljbffr
The models we train are key ingredients to the AI research progress at OpenAI and the field as a whole, and we continually incorporate learnings from our entire research org into our training platform.
Role As a Software Engineer, Networking you will design and implement custom networking collectives that are tightly integrated into our training stack.
We\'re looking for people who have a background in low level performance critical software. Experience with collective communication is a bonus.
This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.
Responsibilities Collaborate closely with ML researchers to design and implement efficient collective operations in C++ and CUDA.
Ensure that our largest training jobs take full advantage of the different network transports used in our supercomputers.
Work on simulations to inform our future supercomputer network designs.
Qualifications Have written distributed algorithms using RDMA in the past.
Are comfortable writing low level performance sensitive CPU and/or GPU code.
Are familiar with network simulation techniques.
About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement.
Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
Compensation Range: $380K - $555K
#J-18808-Ljbffr
In Summary: The Workload Networking team is responsible for the collective communication stack used in our largest training jobs . We're looking for people who have a background in low level performance critical software . The models we train are key ingredients to the AI research progress at OpenAI and the field as a whole .
En Español: Resumen El equipo de Workload Networking es responsable de la pila de comunicación colectiva utilizada en nuestros trabajos de capacitación más grandes. Utilizando una combinación de C++ y CUDA, trabajamos en nuevas técnicas de comunicaciones colectivas que permiten un entrenamiento eficiente de nuestros modelos insignia en nuestras supercomputadoras construidas a medida mayores. Utilizamos un modelo de trabajo híbrido de 3 días por semana en la oficina y ofrecemos asistencia para la reubicación a nuevos empleados. Responsabilidades Colaborar estrechamente con investigadores del ML para diseñar e implementar operaciones colectivas eficientes en C++ y CUDA. Asegurar que nuestros trabajos más grandes de capacitación aprovechen al máximo los diferentes transportes de red utilizados en nuestras supercomputadoras. Trabajar en simulaciones para informar sobre nuestros futuros diseños de redes de superordenadores. La IA es una herramienta extremadamente poderosa que debe ser creada con seguridad y necesidades humanas en su núcleo, y para lograr nuestra misión, debemos abarcar y valorar las muchas perspectivas diferentes, voces y experiencias que forman todo el espectro de la humanidad. Somos un empleador de igualdad de oportunidades, y no discriminamos sobre la base de raza, religión, color, origen nacional, sexo, orientación sexual, edad, estatus de veterano, discapacidad, información genética u otra característica legalmente protegida aplicable. Para obtener más información, consulte OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement. Los solicitantes calificados con antecedentes de arresto o condenación serán considerados para empleo de conformidad con la ley, incluida la San Francisco Fair Chance Ordinance, la Ordenanza del Condado de Los Ángeles para los Empleadores y la Ley de California Fair Chance. Además, las tareas laborales requieren acceso a sistemas de tecnología de la información seguros y protegidos y obligaciones relacionadas con la seguridad de datos. Para notificar a OpenAI que cree que esta publicación de trabajo no es conforme, envíe un informe a través de este formulario. No se proporcionará respuesta a consultas no relacionadas con el cumplimiento de publicación de empleo. Nos comprometemos a proporcionar acomodamientos razonables a los solicitantes con discapacidades, y las solicitudes pueden hacerse a través del enlace. Política de privacidad para solicitantes globales de OpenAI En OpenAI creemos que la inteligencia artificial tiene el potencial de ayudar a las personas a resolver inmensos desafíos mundiales, y queremos compartir ampliamente la ventaja de AI. Únase a nosotros para dar forma al futuro de la tecnología. Rango de compensación: $380K - $555K #J-18808-Ljbffr