Logo
Toyota Research Institute

VR Teleoperation UI/UX Engineer, Large Behavior Models Job at Toyota Research In

Toyota Research Institute, Cambridge, MA, United States, 02140

Save Job

At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life. We’re developing new tools and capabilities to amplify the human experience. To lead this progressive shift in mobility, we’ve built a world-class team in Automated Driving, Energy & Materials, Human-Centered AI, Human Interactive Driving, Large Behavior Models, and Robotics.

The Mission

Make general-purpose robots a reality.

The Challenge

We envision a future where robots assist with household chores and cooking, aid the older population in maintaining their independence, and enable people to spend more time on the activities they enjoy most. To achieve this, robots need to operate reliably in messy, unstructured environments. Our mission is to answer the question “What will it take to create truly general-purpose robots that can accomplish a wide variety of tasks in settings like human homes with minimal human supervision?”. We believe that the answer lies in cultivating large-scale datasets of physical interaction from various sources and building on the latest advances in machine learning to learn general-purpose robot behaviors.

Robotics

The mission of TRI Robotics is to invent and prove new robotic capabilities required to enable home robots to solve challenges faced by an aging society. We are developing an open-source robotics software suite called Drake (https://drake.mit.edu) for use in our projects and the wider research community.

The Team

Join TRI’s LBM-C division to create and ship useful AI-driven robots. Lead the teleoperation experience and turn pioneering R&D into real-world products that empower human-robot collaboration.

The Opportunity

As a VR Teleoperation UI/UX Engineer, you will design and implement user interfaces for our VR teleoperation system, enabling intuitive control of humanoid robots through live camera and sensor feeds, ensuring low latency and natural interaction. You will oversee the entire user-facing pipeline to facilitate effective remote operation of our robots.

Responsibilities

  1. Design and Implement VR UI/UX: Create intuitive interfaces, control schemes, and interactive elements for robotic teleoperation within VR environments.
  2. Develop Immersive Experiences: Build VR/XR systems that provide high situational awareness and minimize operator fatigue during extended sessions.
  3. User Research & Iteration: Conduct user research, gather feedback, and iterate designs to optimize the teleoperation experience.
  4. Front-End Engineering: Develop robust, real-time front-end code ensuring seamless integration with data streams and robot commands.
  5. Collaborate Cross-Functionally: Work with hardware, AI, robot control, and deployment teams to align UI/UX with system capabilities and goals.

Qualifications

  1. VR/XR UI/UX Design & Implementation: 5+ years of experience with immersive UI/UX design, with a strong portfolio (VR or XR video games preferred).
  2. Front-End Development Expertise: Ability to build efficient, reusable, high-performance front-end systems, with experience in graphics and data visualization.
  3. Game Design Principles: Understanding of game design related to user feedback, immersion, and intuitive interaction.
  4. User-Centered Design: Commitment to user-centered principles, including testing and feedback incorporation.
  5. Collaborative Approach: Passion for robotics and teamwork across hardware and software domains.

Bonus Qualifications

  1. Game Engine Proficiency: Experience with Unity or Unreal Engine for VR development.
  2. Haptics & Spatial Audio: Familiarity with integrating haptic feedback and spatial audio systems.
  3. Real-Time Data Pipelines: Experience with real-time data processing and rendering pipelines.
  4. Robotics Experience: Prior experience with robotic systems or teleoperation interfaces.

Please refer to the Candidate Privacy Notice for information on data collection and usage.

TRI values diversity and inclusion, fostering an environment of innovation and collaboration. We are an Equal Opportunity Employer, considering all qualified applicants without regard to race, color, creed, gender, or other protected statuses.

Note: It is unlawful in Massachusetts to require or administer a lie detector test for employment. We also consider qualified applicants with arrest and conviction records pursuant to the San Francisco Fair Chance Ordinance.

#J-18808-Ljbffr