Bio

I am a Machine Learning Research Lead at Google X for a project in AI for ethology / ecology. My team works on a range of problems, including sensing, ML for sensing and behavior, and optimal control. We collaborate with leading academic labs.

Formerly, I obtained my PhD from the Caltech Computer Vision Lab, where I was advised by Pietro Perona and collaborated with Meister Lab. My research focused on sequential decision making in brains and machines. This involved topics spanning AI and naturalistic behavior, including computer vision, machine learning / reinforcement learning, systems neuroscience, and behavior modeling and prediction.

Previous to Caltech, I worked with various organizations internationally in advancing environmental policy, including the WHO, and theoretical neuroscience, as a Loran Scholar.

Get in touch.

News

5/2022: Our new bumble bee behavior paper, the result of a collaboration between Google X and the Crall Lab, is published in Springer’s Artificial Life and Robotics.

11/2021: I defended my PhD thesis and will be starting full-time at X in Jan 2022.

9/2021: Our latest preprint proposing a new theoretical model for sequential learning in mapping and navigation is out on arxiv.

9/2021: I’ll be in Ann Arbor from 9/30 - 10/2 for an invited talk about our recent maze work at the Annual Meeting of the Pavlovian Society.

8/2021: Caltech featured our research on the homepage! Read the story or watch the interview to learn more about the inspirations behind the work.

7/2021: Our paper on fast sequential learning has been published in eLife.

1/2021: Our first full report characterizing and modeling few-shot learning and efficient exploration in a complex hierarchical maze is out on arxiv.

9/2020: I’ve returned to Caltech full-time while remaining the ML Lead for a Google X project part-time.

6/2020: I joined Google X as a AI Resident, continuing work on ML for behavior with multiple modalities.

10/2019: Our work on rapid learning and intrinsic motivated exploration in complex maze environments for mice has been accepted to the NeurIPS Biological and Artificial Reinforcement Learning workshop

3/2019: I presented our work on automated training and iterative latent strategy inference at the SoCal Machine Learning Symposium

Publications

Long-term tracking and quantification of individual behavior in bumble bee colonies
Matthew Smith, August Easton-Calabria, Tony Zhang, et al. 2022.
[Artificial Life and Robotics] [DARS-SWARM 2021]

Endotaxis: A Universal Algorithm for Mapping, Goal-Learning, and Navigation
Tony Zhang, Matthew Rosenberg, Pietro Perona, Markus Meister. 2021.
[Arxiv]

Mice in a labyrinth: Rapid learning, sudden insight, and efficient exploration
Matthew Rosenberg*, Tony Zhang*, Pietro Perona, Markus Meister. 2021.
[eLife] [Arxiv]

Semi-Supervised Audio Representation Learning for Modeling Beehive Strengths
Tony Zhang, Szymon Zmyslony, Sergei Nozdrenkov, Matthew Smith, Brandon Hopkins. 2021.
[Arxiv]

Rapid learning and efficient exploration by mice navigating a complex maze
Matthew Rosenberg*, Tony Zhang*, Pietro Perona, Markus Meister. 2019.
[NeurIPS Bio & Artificial RL]

Mouse Academy: high-throughput automated training and trial-by-trial behavioral analysis during learning
Mu Qiao, Tony Zhang, Cristina Segalin, Sarah Sam, Pietro Perona, Markus Meister. 2018.
[SoCal ML Symposium ‘19] [Arxiv]