Machine Learning Research Intern (Reinforcement/Imitation Learning)

Job detailsApplication formYour New Role and TeamSanctuary AI, a world leader in building dexterity-driven Physical AI for general purpose robots, is looking to hire a skilled and motivated intern to join our ML team and contribute to our team’s work in engineering and innovating unique robotic manipulation tasks.Reporting to the RL Lead, you will have the opportunity to tackle a variety of challenges related to the perception, planning, and motion systems for humanoid general-purpose robots. The best candidates for this role have excellent software development and machine learning skills as well as hands-on experience with robotics. In this role you’ll be a valued contributor and you’ll gain a comprehensive understanding of the design, architecture, and implementation of the simulation platform and machine learning systems that power our general-purpose robots. We are flexible regarding both the internship start date and the duration of the term.Our Success CriteriaDesign, implement, and improve state-of-the-art Reinforcement Learning (RL) and Imitation Learning (IL) algorithms and test them in real-world settingsKeep up to date with state-of-the-art RL/IL methodologies and roboticsIdentify, communicate, and drive promising research directions to the teamFind ways of improving existing implementations of RL/IL pipelines with regards to standard metrics such as sample efficiency, speed, computational resource usage, and scalabilityDesign RL/IL training and data-collection pipelines to facilitate fast deployment on physical robotsWork with a multidisciplinary team to develop novel algorithms and investigate sources of errors with existing implementationsYour ExperienceDesired Qualifications Pursuing MS or Ph.D. in Machine Learning, Computer Science, Applied Math, or related fieldExperience implementing a variety of RL and IL methods with a focus in a specialization such as computer vision or roboticsHands-on experience integrating ML models onto a robotics platformExperience implementing and deploying (dexterous) robotic manipulation tasks in simulation and on physical robots Experience taking ML R&D and trained models into productionExperience with computer vision systemsExperience in simulation-to-reality transfer learningSkillsDevelopment with Python 3.6 or laterWorking knowledge of PyTorch and/or JAXFamiliarity with ROS2Extensive knowledge of RL/IL principles and useTraitsAbove all else, a consistently positive attitude and a willingness to do whatever it takes to create robust solutions to complex problemsOptimistic listening and conflict resolution capabilitiesDemonstrated ability to influence others without authorityEager to take on new challenges with tenacity and positivityPatience, persistence, and attention to detail when resolving performance issuesObsession with bringing human-like intelligence to machinesApply for this positionAutofill from resumeSave time by uploading your resume. (Only PDF or DOCX format supported)Upload filePersonal InformationFirst name*Last name*Email*Phone*🇺🇸+1LinkedIn URLGithub URLWebsite URLProfileResume*Drag and drop files or click to uploadSupported files: .pdf & .docx, up to 20 MBCover LetterDrag and drop files or click to uploadSupported files: .pdf & .docx, up to 20 MBTerm Availability Which term(s) are you available to start?*Select an optionAre you able to work onsite or willing to relocate to our Vancouver offices for this term ?*Select an optionAttach Your PortfolioPortfolio FileDrag and drop files or click to uploadSupported files: .pdf & .docx, up to 20 MBAdd the link to your personal website, or portfolio site here (type n/a if you uploaded a file)Reinforcement/Imitation LearningDo you have experience training RL/IL policies with an embodied AI agent, either in simulation or reality?*Select an optionFeel free to elaborate or share links here:Simulation EnginesWhich simulation engines have you worked with?*Select an optionOther simulation enginesLegal Work Status - CANAre you legally authorized to work in Canada?*Select an optionWill you require sponsorship to work in Canada?*Select an optionApply for this positionJob detailsApplication form