Shane Griffith. Ph.D.

I am a computer scientist with specialization in spatial computing and robotics. I am currently founder of MassSim, where I'm bringing digital humans to life through state-of-the-art interactive simulators. Previously up to 2023 I was at TuSimple, where I created pose estimation, state estimation, sensor calibration, and mapping technology. Before that up to 2019 I built 360 deg image capture technology at Fyusion. I have been a part of multiple academic labs and internships. I obtained my Ph.D. from the Georgia Institute of Technology in Fall 2019. I received my M.S. and B.S. in 2011 and 2008, respectively from Iowa State University.

DEMOS

(2024)

HairSim v0.3.0

(2021)

World's First "Driver Out" Fully Autonomous Semi-Truck Operating on Open Public Roads.

patent

slides

(2020)

Fyusion 360 Image Capture

patent

slides

[+] SELECTED PUBLICATIONS

[+]

(2019)

Transforming Multiple Visual Surveys of a Natural Environment Into Time-Lapses.
[slides] [video] [dataset]
Shane Griffith, Frank Dellaert, and Cedric Pradalier.
International Journal of Robotics Research (IJRR).

(2016)

Reprojection Flow for Image Registration Across Seasons.
Shane Griffith and Cedric Pradalier.
British Machine Vision Conference (BMVC), York, UK.

Vision is one of the primary sensory modalities of animals and robots, yet among robots it still has limited power in natural environments. Dynamic processes of Nature continuously change how an environment looks, which work against appearance-based methods for visual data association. As a robot is deployed again and again, the possibility of finding correspondences diminishes between surveys increasingly separated in time. This is a major limitation of intelligent systems targeted for precision agriculture, search and rescue, and environment monitoring. So for my PhD Cedric and I saught a new approach to visual data association to overcome the variation in appearance of a natural environment, as it was experienced by a field robot over several years.

We found success with a map-centric approach, which builds on 3D vision to achieve visual data association across seasons. We first created the Symphony Lake Dataset, which consists of fortnightly visual surveys of a 1.3 km lakeshore captured from an autonomous surface vehicle over three years. We then established dense correspondence as a technique to both provide robust visual data association and to eliminate the variation in viewpoint between surveys. Given a consistent map and localized poses, visual data association across seasons is achieved with the integration of map point priors and geometric constraints within the dense correspondence image alignment optimization. We called this algorithm "Reprojection Flow".

We presented the first work to see through the variation in appearance across seasons in a natural environment using map point priors and localized poses. Our algorithm for map-anchored dense correspondence showed a substantial gain on visual data association in the midst of the difficult variation in appearance. Up to 37 surveys were transformed into year-long time-lapses at the scenes where their maps were consistent. This indicates that, at a time when frequent advancements are made towards robust visual data association, the spatial information in a map may be able to close the distance where hard cases have persisted between observations.

[+]

(2013)

Policy Shaping: Integrating Human Feedback with Reinforcement Learning.
[slides] [code] [appendix]
Shane Griffith, Kaushik Subramanian, Jon Scholz, Charles Isbell, and Andrea Thomaz.
Advances in Neural Information Processing Systems (NeurIPS), 2625-2633, Lake Tahoe, Nevada.

I passed the Qual after investigating how robots might learn, particularly explore, without being labeled defective. Although a large body of work already addresses how a robot might explore its environment in order to learn and adapt to it, the risks of exploration are commonly overlooked. Few papers addressed how a robot could reliably stay out of harm's way if it is left to freely explore. After I saw this problem, my research goal was to investigate how robots could avoid committing serious errors while exploring.

A step towards error free learning is made possible with a new insight about how to learn from human feedback. Feedback interpreted as a direct label on the optimality of an action can provide a way to eliminate hazardous sections of the state space. This is in contrast to most previous work in which feedback is interpreted as a reward (e.g., reward shaping), which creates something like a trail of breadcrumbs for coaxing an agent out of an undesirable or dangerous area. Our new ``policy shaping'' approach to interactive machine learning called for a fundamentally new way to use feedback with reinforcement learning.

We ended up deriving a simple, yet rigorous, information theoretic algorithm to maximize the information gained from human feedback, which we named Advise. Our experiments showed Advise in some cases significantly outperformed state-of-the-art methods, and was robust to noise. It also eliminates the ad hoc parameter tuning common of methods that interpret feedback as a reward. These advancements were presented at the 1st Biennial Conference on Reinforcement Learning and Decision Making (RLDM), where it was one of the top four papers, and published in the 27th Annual Conference on Neural Information Processing Systems (NeurIPS).

[+]

(2012)

A Behavior-Grounded Approach to Forming Object Categories:
Separating Containers from Non-Containers.
[slides] [videos]
Shane Griffith, Jivko Sinapov, Vlad Sukhoy, and Alex Stoytchev,
IEEE Transactions on Autonomous Mental Development (TAMD), 4:1, 54-69.

I earned my M.S. after 3.5 years of studying what a container is, and how a humanoid robot can learn what a container is. Although a growing body of literature in robotics addressed many different container manipulation problems, individual papers only chipped away at isolated problems one by one. This meant that the algorithms for one domain were not directly applicable to other domains. After I saw this problem, the goal of my thesis was to identify how a robot could start to learn about containers in a more general way.

Because people have a representation of containers that is generalizable across many different container manipulation problems, I looked to psychology for all the information on the origins of container learning. Psychologists observed that infants form an abstract spatial category for containers, which allows them to apply their knowledge to novel containers. At the time, however, the current theories of object categorization weren't clear about exactly how infants form an object category for containers. Consequently, I looked more deeply into the psychology literature in order to try and understand how infants learn.

By citing many different theories and observations from psychology, I extrapolated an explanation for how infants learn object categories. As a result of the expertise of the whole team, we were able to create a computational framework for learning object categories in a similar way by a robot. Our experiments with containers showed that this method of object categorization really works, and it works really well.

Our work was well received when we submitted it to the IEEE Transactions on Autonomous Mental Development (TAMD) for publication in their journal. An eminent developmental psychologist reviewed the object categorization theory (the expertise of the other two reviewers was robotics), and in her "comments to the author" that we received when the paper was accepted, she signed her name in her review (reviews are usually anonymous) and said:

"I commend the authors on a fantastic literature review of my domain. The authors accurately cite a broad array of the relevant literature. There were no relevant articles missing. I do not have any suggested changes because I think the literature is very good as it is. ...I was tickled by the unification of citations from people that are often perceived to be in opposing theoretical camps. ...I signed this review because I hope that the authors send me a copy when they get it published. I find the work fascinating and I would like to refer to their in my own work."

In addition to technical comments that helped us to improve our work, the two roboticists said "[this paper presents] an interesting and out-of-the-box way of addressing concept acquisition" and "this paper makes a significant contribution to the existing literature." In the end, my research productivity for my M.S. came to rest at π (11 papers in 3.5 years).

DEMOS

[+] SELECTED PUBLICATIONS

FULL PUBLICATION LIST