Yisong Yue (he/him)
California Institute of Technology
1200 E. California Blvd.
CMS, 305-16
Pasadena, CA 91125

Office: 303 Annenberg

Contact Information >

• Neural-Fly published in Science Robotics: our work on Neural-Fly has been published in Science Robotics. [article][press release]
  
• Neurosymbolic Programming Summer School (July 11-13 2022 @Caltech): Neurosymbolic programming is an exciting new area at the intersection of Program Synthesis and Machine Learning that aims to learn models that incorporate program-like structure. More info here.
• Sabbatical at Argo AI: I have started my role as Principal Scientist at Argo AI. Learn more about my new role here.
• Neurosymbolic Programming Survey Paper: published in Foundations and Trends in Programming Languages. (preprint)
• Best Paper Award: "End-to-End Sequential Sampling and Reconstruction for MR Imaging" won Best Paper at ML4Health 2021! [project]
  
• Invited Talk: I presented on Neurosymbolic Programming at the Caltech Explainable AI Virtual Workshop. [slides]
  
• Advances in Machine Learning-Assisted Directed Evolution for Protein Design: new paper showing that smart training set selection can significantly improve machine learning-guided directed evolution in highly epistatic protein fitness landscapes with large low-fitness regions. [online][bioRxiv][code]
  
• Personalized Preference Learning from Spinal Cord Stimulation to Exoskeletons: interactive learning approaches for personalizing medical assistive devices. [slides]
  
• Fine-Grained Identification of Biological Neural Networks: our KDD 2021 paper on "Fine-Grained System Identification of Nonlinear Neural Circuits" demonstrated identifying sparse nonlinear neural networks from real neural recording data. [arxiv][code]
  
• Multi-Agent Behavior Workshop: Video recordings from our Multi-Agent Behavior Workshop (co-located with CVPR 2021) are now available. [playlist]
  
• Bon Voyage! We have four departures in the 2020-2021 academic year:
  • Ellen Novoseller completed her PhD and has started as a postdoc in Ken Goldberg's group at UC Berkeley.
  • Angie Liu completed her postdoc and will start as an assistant professor at Johns Hopkins University.
  • Joe Marino completed his PhD and will start as a research scientist at DeepMind.
  • Jialin Song completed his PhD and has started as a research scientist at NVIDIA AI.
  
• Paper Award: Our work on Task Programming won Best Student Paper at CVPR 2021! [arxiv][code][project]
  
• AI for Science Challenge: We have released the Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions. [arxiv][dataset][code]
  
• Invited Talk: Video now available of my talk on "Learning to Optimize as Policy Learning" presented at the Princeton Optimization Seminar. [slides]
  
• Invited Talk: I presented on "Learning for Safety-Critical Control in Dynamical Systems" at the Control Meets Learning seminar series.
  
• Invited Talk: I gave the Earnest C. Watson Lecture on January 13th, 2021.
  
• Invited Talk: I gave a presentation on AI for Adaptive Experiment Design at the Directions in ML: AutoML and Automating Algorithms hosted by Microsoft Research. [slides]
  
• Neural-Swarm2: we have released the details of our heterogeneous neural swarm approach! [paper]
  
• Invited Talk: I am presenting on "Competitive Algorithms for Online Control" at the Simons Institute Workshop on Mathematics of Online Decision Making. [slides]
  
• Invited Talk: I am presenting at the Workshop on Imitation Learning: Single & Multi-Agent hosted by DAI 2020. [slides]
• Invited Talk: I am presenting on "Learning to Optimize as Policy Learning" at the Princeton Optimization Seminar. [slides]
• ML for Rover Path Planning: check out this video of our MLNav extension of ENav (the path planner currently on the Mars Perseverance Rover). [arxiv]
  
• NSF Expeditions on Program Learning: we are starting a new research initiative titled Understanding the World Through Code, funded through the NSF Expeditions in Computing Program.
• Controllable Generation of Behaviors: we designed a new method that can generate behaviors calibrated to many different styles. [paper][code][demo]
  
• AI for Swarm Automation: check out this new article titled Machine Learning Helps Robot Swarms Coordinate. [paper 1][paper 2] (videos below)
  
• Invited Talk: I gave a talk on "Learning for Safety-Critical Control in Dynamical Systems" in the Physics ∩ ML seminar. [slides] (video below)
  
• Best Paper Award: Our work on preference learning for exoskeleton gait optimization is appearing at ICRA 2020 with a Best Paper Award! [arxiv][project] (video below).
  
• Partnered with PyTorch to film a short clip on our robotics research at CAST.
  
• Invited Talk: I am giving a talk at University of Chicago on November 13th, 2019.
• Invited Talk: I am giving a talk at the UIUC Computer Science Colloquium on November 11th, 2019.
• Keynote talk at AI-for-Science: I am giving a keynote talk on Adaptive Experiment Design at the Caltech AI-for-Science workshop.
  
• Invited Talk: I am speaking at the PyTorch Developer Conference on October 10th, 2019.
  
• Invited Workshop: I am giving a talk at the Workshop on Automated Algorithm Design hosted by the TTI-Chicago 2019 Summer Workshop Program.
• Invited Workshop: I am giving a talk at the Workshop on Data Collection, Curation, and Labeling for Mining and Learning co-located with KDD 2019.
• Invited Workshop: I am giving a talk at the Adversarial Machine Learning in Real-World Computer Vision Systems co-located with CVPR 2019.
• Invited Workshop: I am giving a talk at the 2019 Workshop on Human In the Loop Learning (HILL) co-located with ICML 2019 [video].
• ICML 2019 Workshop: Please consider attending or submitting to the Real-World Sequential Decision Making Workshop co-located with ICML 2019!
• Simons Symposium: I am attending a Simons Symposium on New Directions in Theoretical Machine Learning on May 5-11, 2019.
• Invited Talk: I am speaking at the Machine Learning Seminar at CMU on April 23rd, 2019.
• Neural Lander: Our work on deep learning for provably stable drone landing control is appearing at ICRA 2019! [arxiv] (video below)
  
• Earthquake Early Detection: State-of-the-art results on earthquake early detection using deep learning! [arxiv]
• Earthquake Localization: State-of-the-art results on earthquake localization using deep learning! [arxiv]
• Invited Workshop: I am presenting at the NeurIPS 2018 workshop on Imitation Learning and its Challenges in Robotics.
• Invited Talk: I am presenting at UCLA on November 20th, 2018.
• Invited Talk: I am presenting at the University of Maryland College Park on October 24th, 2018.
• Invited Talk: I am presenting at Microsoft Research Redmond on October 3rd & 4th, 2018.
• Invited Talk: I am presenting at the University of Washington AI Seminar on October 2nd, 2018.
• Invited Talk: I am presenting at the Rice Computer Science Colloquium on September 27th, 2018.
• Okawa Award: I recently received the Okawa Foundation Research Grant.
• Invited Workshop: I am presenting on Inference+Imitation at the Tractable Probabilistic Models workshop at ICML 2018.
• Invited Workshop: I am presenting on Machine Teaching for Human Learners at the Humanizing AI workshop at IJCAI 2018.
• Tutorial: I am giving a tutorial on imitation learning with Hoang Le at ICML 2018. (video below)
  
• Invited Talk: I am presenting at the Intel AI DevCon. (video below)
  
• Invited Talk: Invited talk at UT Austin AI Seminar on March 30th, 2018.
• Invited Workshop: I am attending the Data-driven Algorithmics workshop on November 5-10, 2017.
• Invited Talk: Invited talk at Southern California Machine Learning Symposium on October 6th, 2017.
• Blog Article: Our paper on smooth imitation learning was covered in an invited blog article titled Beyond Deep Learning: a Case Study in Sports Analytics. [ICML paper]
• Invited Talk: Invited talk at Microsoft Research Colloquium at MSR New England on September 6th, 2017. [video]
• Dagstuhl Seminar: I am attending the Machine Learning and Formal Methods Dagstuhl Seminar on August 28th - September 1st, 2017.
• Press Release: Our work on data-driven speech animation is highlighted on Road to VR! [SIGGRAPH paper][demo video (shown below)]
  
• Press Release & Interview: Neural Networks Model Audience Reactions to Movies, also radio interview. [CVPR paper]
• Microsoft Faculty Summit: I am attending the Edge of AI Microsoft Research Faculty Summit on July 17-18, 2017.
• Invited Talk: Invited talk at Machine Learning Methods for Recommender Systems Workshop to be held at SDM 2017.
• Invited talk: Invited talk at Symposium on Machine Learning and Human Behavior to be held at UC Irvine on March 10th, 2017.
• Best Paper Runner Up: Our paper "Data-Driven Ghosting using Deep Imitation Learning" wins Runner Up to Best Research Paper at the MIT Sloan Sports Analytics Conferece! [pdf][project][press release][demo video (shown below)]
  
• Caltech Computes Alumni College: I gave a talk titled Automatically Improving Automation using Big Data at the Caltech Computes Alumni College.
  
• Southern California Machine Learning Symposium: I am co-organizing the next SoCal ML Symposium, to be held at Caltech on November 18th, 2016.
• Innovation in Artificial Intelligence: I will be moderating a discussion panel on Innovation in Artificial Intelligence on September 15th, 2016.
• Coverage on Sports Illustrated: My collaboration with Disney Research on imitation learning for camera control is featured on Sports Illustrated! [ICML paper][CVPR paper]
• Bloomberg Data Science Research Grant: I'm delighted to be awarded a Data Science Research Grant from Bloomberg Labs!
• Personalization Workshop: Please consider participating in our Computational Frameworks for Personalization Workshop being held at ICML 2016!
• Sports Analytics Workshop: Please consider participating in our Large-Scale Sports Analytics Workshop being held at KDD 2016!
• Blog Post: Thoughts on NeurIPS 2015 and OpenAI.
• Invited Workshop: Algorithms for Human Robot Interaction Workshop.
• Blog Post: Thoughts on KDD 2015.
• Fundraising Chair of AISTATS 2016.
• Invited Talk at Reflections | Projections 2015 organized by ACM@UIUC.
• Invited Workshop: Data-driven Algorithmics Workshop. [slides]
• A Decision Tree Framework for Spatiotemporal Sequence Prediction accepted for publication at KDD 2015. [pdf][demo]
• Sports Analytics Workshop: Please consider participating in our Large-Scale Sports Analytics Workshop being held at KDD 2015!
• Interview by Jessica Stoller-Conrad @Caltech. [link]
• Invited Talk at Human Propelled Machine Learning Workshop at NeurIPS 2014.
• Learning Fine-Grained Spatial Models for Dynamic Sports Play Prediction accepted for publication at ICDM 2014. [pdf][demo][press release]
• Personalization Workshop: Please consider participating in our Personalization Workshop being held at NeurIPS 2014!
• Sports Analytics Workshop: Please consider participating in our Large-Scale Sports Analytics Workshop being held at KDD 2014!
• Personalized Collaborative Clustering accepted for publication at WWW 2014. [pdf][slides][data]
• Invited Talk at DISCML Workshop at NeurIPS 2013.
• Press release of EMS ambulance allocation project with the iLab is now up! [link][research paper]
• Invited talk at WSCD Workshop at WSDM 2012.