Skip to main content

October 3, 2012

Title: Visual Search for an Object in a 3D Environment using a Mobile Robot

Speaker: John K. Tsotsos, Department of Computer Science and Engineering, and Centre for Vision Research, York University, Toronto, Ontario

Abstract: Consider the problem of visually finding an object in a mostly unknown space with a mobile robot. It is clear that all possible views and images cannot be examined in a practical system. Visual attention is a complex phenomenon; we view it as a mechanism that optimizes the search processes inherent in vision. Here, we describe a particular example of a practical robotic vision system that employs some of these attentive processes. We cast this as an optimization problem, i.e., optimizing the probability of finding the target given a fixed cost limit in terms of total number of robotic actions required to find the visual target. Due to the inherent intractability of this problem, we present an approximate solution and investigate its performance and properties. We conclude that our approach is sufficient to solve this problem and has additional desirable empirical characteristics. Examples will be shown of the operation of the algorithm in both test and real domains, specifically in our autonomous wheelchair robot and on Honda's ASIMO humanoid robot.