Robotics Intern, Dexterous Manipulation - Large Behavior Models

Toyota Research Institute

Toyota Research Institute

Kendall Square, Cambridge, MA, USA
Posted on Wednesday, October 18, 2023
At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life. We’re developing new tools and capabilities to amplify the human experience. To lead this transformative shift in mobility, we’ve built a world-class team in Robotics, Human-Centered AI, Human Interactive Driving, and Energy & Materials.
This is a summer 2024 paid 12-week internship opportunity. Please note that this internship will be an in-office role.
The Mission
We are working to create general-purpose robots capable of accomplishing a wide variety of dexterous tasks. To do this, our team is building general-purpose machine learning foundation models for dexterous robot manipulation. These models, which we call Large Behavior Models, use generative AI techniques to produce robot action from sensor data and human request. To accomplish this, we are creating a large curriculum of embodied robot demonstration data and combining that data with a rich corpus of internet-scale text, image, and video data. We are also using high-quality simulation to augment real world robot data with procedurally-generated synthetic demonstrations.
The Team
The Dexterous Manipulation Team’s charter is to push the frontiers of research in robotics and machine learning to develop the future capabilities required for general-purpose robots able to operate in unstructured environments such as homes!
The Internship
We have several research thrusts under our broad mission, and we are looking for a research intern in any of these areas:
- Data-efficient and general algorithms for learning robust policies leveraging multiple sensing modalities: proprioception, images, force, and dense tactile sensing.
- Scaling learning approaches to large-scale models trained on diverse sources of data including web-scale text, images, and video.
- Quick and efficient improvement of learned policies.
The intern who joins our team will be expected to create working code prototypes, interact frequently with team members, run experiments with both simulated and real (physical) robots, and participate in publishing the work to peer-reviewed venues. We’re looking for an intern who is comfortable working with both existing large static datasets as well as a growing and dynamic corpus of robot data.

Qualifications

  • Either: Hands-on experience with using machine learning for learned control, including RL, offline RL or behavior cloning, for manipulation. Hardware experience not required, but strongly preferred. -OR- Strong experience with machine learning and familiarity with large datasets and models.
  • Strong software development skills in Python.
  • A “make it happen” attitude and comfortable with fast prototyping.
  • A passion for robotics and doing research grounded in important fundamental problems.
Please add a link to Google Scholar and include a full list of publications when submitting your CV to this position.
The pay range for this position at commencement of employment is expected to be between $45 and $65/hour for California-based roles; however, base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. Note that TRI offers a generous benefits package including vacation and sick time. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.
Please reference this Candidate Privacy Notice to inform you of the categories of personal information that we collect from individuals who inquire about and/or apply to work for Toyota Research Institute, Inc. or its subsidiaries, including Toyota A.I. Ventures GP, L.P., and the purposes for which we use such personal information.
TRI is fueled by a diverse and inclusive community of people with unique backgrounds, education and life experiences. We are dedicated to fostering an innovative and collaborative environment by living the values that are an essential part of our culture. We believe diversity makes us stronger and are proud to provide Equal Employment Opportunity for all, without regard to an applicant’s race, color, creed, gender, gender identity or expression, sexual orientation, national origin, age, physical or mental disability, medical condition, religion, marital status, genetic information, veteran status, or any other status protected under federal, state or local laws.