Header logo is


2009


no image
Expectation Propagation on the Maximum of Correlated Normal Variables

Hennig, P.

Cavendish Laboratory: University of Cambridge, July 2009 (techreport)

Abstract
Many inference problems involving questions of optimality ask for the maximum or the minimum of a finite set of unknown quantities. This technical report derives the first two posterior moments of the maximum of two correlated Gaussian variables and the first two posterior moments of the two generating variables (corresponding to Gaussian approximations minimizing relative entropy). It is shown how this can be used to build a heuristic approximation to the maximum relationship over a finite set of Gaussian variables, allowing approximate inference by Expectation Propagation on such quantities.

ei pn

Web [BibTex]

2009


Web [BibTex]


no image
ISocRob-MSL 2009 Team Description Paper for Middle Sized League

Lima, P., Santos, J., Estilita, J., Barbosa, M., Ahmad, A., Carreira, J.

13th Annual RoboCup International Symposium 2009, July 2009 (techreport)

Abstract
This paper describes the status of the ISocRob MSL roboticsoccer team as required by the RoboCup 2009 qualification procedures.Since its previous participation in RoboCup, the ISocRob team has car-ried out significant developments in various topics, the most relevantof which are presented here. These include self-localization, 3D objecttracking and cooperative object localization, motion control and rela-tional behaviors. A brief description of the hardware of the ISocRobrobots and of the software architecture adopted by the team is also in-cluded.

ps

[BibTex]

[BibTex]


Fields of Experts
Fields of Experts

Roth, S., Black, M. J.

International Journal of Computer Vision (IJCV), 82(2):205-29, April 2009 (article)

Abstract
We develop a framework for learning generic, expressive image priors that capture the statistics of natural scenes and can be used for a variety of machine vision tasks. The approach provides a practical method for learning high-order Markov random field (MRF) models with potential functions that extend over large pixel neighborhoods. These clique potentials are modeled using the Product-of-Experts framework that uses non-linear functions of many linear filter responses. In contrast to previous MRF approaches all parameters, including the linear filters themselves, are learned from training data. We demonstrate the capabilities of this Field-of-Experts model with two example applications, image denoising and image inpainting, which are implemented using a simple, approximate inference scheme. While the model is trained on a generic image database and is not tuned toward a specific application, we obtain results that compete with specialized techniques.

ps

pdf pdf from publisher [BibTex]

pdf pdf from publisher [BibTex]


Full phase and amplitude control in computer-generated holography
Full phase and amplitude control in computer-generated holography

Fratz, M., Fischer, P., Giel, D. M.

OPTICS LETTERS, 34(23):3659-3661, 2009 (article)

Abstract
We report what we believe to be the first realization of a computer-generated complex-valued hologram recorded in a single film of photoactive polymer. Complex-valued holograms give rise to a diffracted optical field with control over its amplitude and phase. The holograms are generated by a one-step direct laser writing process in which a spatial light modulator (SLM) is imaged onto a polymer film. Temporal modulation of the SLM during exposure controls both the strength of the induced birefringence and the orientation of the fast axis. We demonstrate that complex holograms can be used to impart arbitrary amplitude and phase profiles onto a beam and thereby open new possibilities in the control of optical beams. (C) 2009 Optical Society of America

pf

[BibTex]

[BibTex]


Digital polarization holograms with defined magnitude and orientation of each pixel's birefringence
Digital polarization holograms with defined magnitude and orientation of each pixel’s birefringence

Fratz, M., Giel, D. M., Fischer, P.

OPTICS LETTERS, 34(8):1270-1272, 2009 (article)

Abstract
A new form of digital polarization holography is demonstrated that permits both the amplitude and the phase of a diffracted beam to be independently controlled. This permits two independent intensity images to be stored in the same hologram. To fabricate the holograms, a birefringence with defined retardance and orientation of the fast axis is recorded into a photopolymer film. The holograms are selectively read out by choosing the polarization state of the read beam. Polarization holograms of this kind increase the data density in holographic data storage and allow higher quality diffractive optical elements to be written. (C) 2009 Optical Society of America

pf

[BibTex]


Controlled Propulsion of Artificial Magnetic Nanostructured Propellers
Controlled Propulsion of Artificial Magnetic Nanostructured Propellers

Ghosh, A., Fischer, P.

NANO LETTERS, 9(6):2243-2245, 2009, Featured highlight ‘Nanotechnology: The helix that delivers’ Nature 459, 13 (2009). (article)

Abstract
For biomedical applications, such as targeted drug delivery and microsurgery, it is essential to develop a system of swimmers that can be propelled wirelessly in fluidic environments with good control. Here, we report the construction and operation of chiral colloidal propellers that can be navigated in water with micrometer-level precision using homogeneous magnetic fields. The propellers are made via nanostructured surfaces and can be produced in large numbers. The nanopropellers can carry chemicals, push loads, and act as local probes in rheological measurements.

Featured highlight ‘Nanotechnology: The helix that delivers’ Nature 459, 13 (2009).

pf

Video - Nanospropellers DOI [BibTex]

Video - Nanospropellers DOI [BibTex]


Absolute Asymmetric Reduction Based on the Relative Orientation of Achiral Reactants
Absolute Asymmetric Reduction Based on the Relative Orientation of Achiral Reactants

Kuhn, A., Fischer, P.

ANGEWANDTE CHEMIE-INTERNATIONAL EDITION, 48(37):6857-6860, 2009 (article)

pf

DOI [BibTex]

DOI [BibTex]


no image
Magnetic mobile micro-robots

Pawashe, C., Floyd, S., Sitti, M.

7eme Journees Nationales de la Recherche en Robotique, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Gecko-Inspired Directional and Controllable Adhesion

Murphy, M. P., Aksak, B., Sitti, M.

Small, 5(2):170-175, WILEY-VCH Verlag, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Multiple magnetic microrobot control using electrostatic anchoring

Pawashe, C., Floyd, S., Sitti, M.

Applied Physics Letters, 94(16):164108, AIP, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Wet self-cleaning of biologically inspired elastomer mushroom shaped microfibrillar adhesives

Kim, S., Cheung, E., Sitti, M.

Langmuir, 25(13):7196-7199, ACS Publications, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Robot ceiling climbers harness new tricks

Marks, Paul

New Scientist, 202(2705):18-19, Reed Business Information, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Biologically-Inspired Patterned and Coated Adhesives for Medical Devices

Glass, P, Chung, H, Lee, C, Tworkoski, E, Washburn, NR, Sitti, M

Journal of Medical Devices, 3(2):027537, American Society of Mechanical Engineers, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Modeling and experimental characterization of an untethered magnetic micro-robot

Pawashe, C., Floyd, S., Sitti, M.

The International Journal of Robotics Research, 28(8):1077-1094, Sage Publications, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Towards automated nanoassembly with the atomic force microscope: A versatile drift compensation procedure

Krohs, F., Onal, C., Sitti, M., Fatikow, S.

Journal of Dynamic Systems, Measurement, and Control, 131(6):061106, American Society of Mechanical Engineers, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Enhanced adhesion by gecko-inspired hierarchical fibrillar adhesives

Murphy, M. P., Kim, S., Sitti, M.

ACS applied materials \& interfaces, 1(4):849-855, American Chemical Society, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Miniature devices: Voyage of the microrobots

Sitti, M.

Nature, 458(7242):1121-1122, Nature Publishing Group, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Dry spinning based spinneret based tunable engineered parameters (STEP) technique for controlled and aligned deposition of polymeric nanofibers

Nain, A. S., Sitti, M., Jacobson, A., Kowalewski, T., Amon, C.

Macromolecular rapid communications, 30(16):1406-1412, WILEY-VCH Verlag, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Two-dimensional contact and noncontact micromanipulation in liquid using an untethered mobile magnetic microrobot

Floyd, S., Pawashe, C., Sitti, M.

IEEE Transactions on Robotics, 25(6):1332-1342, IEEE, 2009 (article)

pi

[BibTex]

[BibTex]


Automatic recognition of rodent behavior: A tool for systematic phenotypic analysis
Automatic recognition of rodent behavior: A tool for systematic phenotypic analysis

Serre, T.*, Jhuang, H*., Garrote, E., Poggio, T., Steele, A.

CBCL paper #283/MIT-CSAIL-TR #2009-052., MIT, 2009 (techreport)

ps

pdf [BibTex]

pdf [BibTex]


Left Ventricular Regional Wall Curvedness and Wall Stress in Patients with Ischemic Dilated Cardiomyopathy
Left Ventricular Regional Wall Curvedness and Wall Stress in Patients with Ischemic Dilated Cardiomyopathy

Liang Zhong, Yi Su, Si Yong Yeo, Ru San Tan Dhanjoo Ghista, Ghassan Kassab

American Journal of Physiology – Heart and Circulatory Physiology, 296(3):H573-84, 2009 (article)

Abstract
Geometric remodeling of the left ventricle (LV) after myocardial infarction is associated with changes in myocardial wall stress. The objective of this study was to determine the regional curvatures and wall stress based on three-dimensional (3-D) reconstructions of the LV using MRI. Ten patients with ischemic dilated cardiomyopathy (IDCM) and 10 normal subjects underwent MRI scan. The IDCM patients also underwent delayed gadolinium-enhancement imaging to delineate the extent of myocardial infarct. Regional curvedness, local radii of curvature, and wall thickness were calculated. The percent curvedness change between end diastole and end systole was also calculated. In normal heart, a short- and long-axis two-dimensional analysis showed a 41 +/- 11% and 45 +/- 12% increase of the mean of peak systolic wall stress between basal and apical sections, respectively. However, 3-D analysis showed no significant difference in peak systolic wall stress from basal and apical sections (P = 0.298, ANOVA). LV shape differed between IDCM patients and normal subjects in several ways: LV shape was more spherical (sphericity index = 0.62 +/- 0.08 vs. 0.52 +/- 0.06, P < 0.05), curvedness at end diastole (mean for 16 segments = 0.034 +/- 0.0056 vs. 0.040 +/- 0.0071 mm(-1), P < 0.001) and end systole (mean for 16 segments = 0.037 +/- 0.0068 vs. 0.067 +/- 0.020 mm(-1), P < 0.001) was affected by infarction, and peak systolic wall stress was significantly increased at each segment in IDCM patients. The 3-D quantification of regional wall stress by cardiac MRI provides more precise evaluation of cardiac mechanics. Identification of regional curvedness and wall stresses helps delineate the mechanisms of LV remodeling in IDCM and may help guide therapeutic LV restoration.

ps

[BibTex]

[BibTex]


no image
A scaled bilateral control system for experimental one-dimensional teleoperated nanomanipulation

Onal, C. D., Sitti, M.

The International Journal of Robotics Research, 28(4):484-497, Sage Publications, 2009 (article)

pi

[BibTex]

[BibTex]


no image
A Swallowable Tethered Capsule Endoscope for Diagnosing Barrett’s Esophagus

Glass, P., Sitti, M., Pennathur, A., Appasamy, R.

Gastrointestinal Endoscopy, 69(5):AB106, Mosby, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Adhesion of biologically inspired polymer microfibers on soft surfaces

Cheung, E., Sitti, M.

Langmuir, 25(12):6613-6616, ACS Publications, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Dangling chain elastomers as repeatable fibrillar adhesives

Sitti, M., Cusick, B., Aksak, B., Nese, A., Lee, H., Dong, H., Kowalewski, T., Matyjaszewski, K.

ACS applied materials \& interfaces, 1(10):2277-2287, American Chemical Society, 2009 (article)

pi

[BibTex]

[BibTex]


A Curvature-Based Approach for Left Ventricular Shape Analysis from Cardiac Magnetic Resonance Imaging
A Curvature-Based Approach for Left Ventricular Shape Analysis from Cardiac Magnetic Resonance Imaging

Si Yong Yeo, Liang Zhong, Yi Su, Ru San Tan, Dhanjoo Ghista

Medical & Biological Engineering & Computing, 47(3):313-322, 2009 (article)

Abstract
It is believed that left ventricular (LV) regional shape is indicative of LV regional function, and cardiac pathologies are often associated with regional alterations in ventricular shape. In this article, we present a set of procedures for evaluating regional LV surface shape from anatomically accurate models reconstructed from cardiac magnetic resonance (MR) images. LV surface curvatures are computed using local surface fitting method, which enables us to assess regional LV shape and its variation. Comparisons are made between normal and diseased hearts. It is illustrated that LV surface curvatures at different regions of the normal heart are higher than those of the diseased heart. Also, the normal heart experiences a larger change in regional curvedness during contraction than the diseased heart. It is believed that with a wide range of dataset being evaluated, this approach will provide a new and efficient way of quantifying LV regional function.

ps

link (url) [BibTex]

link (url) [BibTex]


no image
Reversible dry micro-fibrillar adhesives with thermally controllable adhesion

Kim, S., Sitti, M., Xie, T., Xiao, X.

Soft Matter, 5(19):3689-3693, Royal Society of Chemistry, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Biologically Inspired Polymer Microfibrillar Arrays for Mask Sealing

Cheung, E., Aksak, B., Sitti, M.

CARNEGIE-MELLON UNIV PITTSBURGH PA, 2009 (techreport)

pi

[BibTex]

[BibTex]


no image
Enhanced reversible adhesion of dopamine methacrylamide-coated elastomer microfibrillar structures under wet conditions

Glass, P., Chung, H., Washburn, N. R., Sitti, M.

Langmuir, 25(12):6607-6612, ACS Publications, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]

2004


On the variability of manual spike sorting
On the variability of manual spike sorting

Wood, F., Black, M. J., Vargas-Irwin, C., Fellows, M., Donoghue, J. P.

IEEE Trans. Biomedical Engineering, 51(6):912-918, June 2004 (article)

ps

pdf pdf from publisher [BibTex]

2004


pdf pdf from publisher [BibTex]


Modeling and decoding motor cortical activity using a switching {Kalman} filter
Modeling and decoding motor cortical activity using a switching Kalman filter

Wu, W., Black, M. J., Mumford, D., Gao, Y., Bienenstock, E., Donoghue, J. P.

IEEE Trans. Biomedical Engineering, 51(6):933-942, June 2004 (article)

Abstract
We present a switching Kalman filter model for the real-time inference of hand kinematics from a population of motor cortical neurons. Firing rates are modeled as a Gaussian mixture where the mean of each Gaussian component is a linear function of hand kinematics. A “hidden state” models the probability of each mixture component and evolves over time in a Markov chain. The model generalizes previous encoding and decoding methods, addresses the non-Gaussian nature of firing rates, and can cope with crudely sorted neural data common in on-line prosthetic applications.

ps

pdf pdf from publisher [BibTex]

pdf pdf from publisher [BibTex]


no image
E. Coli Inspired Propulsion for Swimming Microrobots

Behkam, Bahareh, Sitti, Metin

pages: 1037–1041, 2004 (article)

Abstract
Medical applications are among the most fascinating areas of microrobotics. For long, scientists have dreamed of miniature smart devices that can travel inside the human body and carry out a host of complex operations such as minimally invasive surgery (MIS), highly localized drug delivery, and screening for diseases that are in their very early stages. Still a distant dream, significant progress in micro and nanotechnology brings us closer to materializing it. For such a miniature device to be injected into the body, it has to be 800 μm or smaller in diameter. Miniature, safe and energy efficient propulsion systems hold the key to maturing this technology but they pose significant challenges. Scaling the macroscale natation mechanisms to micro/nano length scales is unfeasible. It has been estimated that a vibrating-fin driven swimming robot shorter than 6 mm can not overcome the viscous drag forces in water. In this paper, the authors propose a new type of propulsion inspired by the motility mechanism of bacteria with peritrichous flagellation, such as Escherichia coli, Salmonella typhimurium and Serratia marcescens. The perfomance of the propulsive mechanism is estimated by modeling the dynamics of the motion. The motion of the moving organelle is simulated and key parameters such as velocity, distribution of force and power requirments for different configurations of the tail are determined theoretically. In order to validate the theoretical result, a scaled up model of the swimming robot is fabricated and characterized in silicone oil using the Buckingham PI theorem for scaling. The results are compared with the theoretically computed values. These robots are intended to swim in stagnation/low velocity biofluid and reach currently inaccessible areas of the human body for disease inspection and possibly treatment. Potential target regions to use these robots include eyeball cavity, cerebrospinal fluid and the urinary system.

pi

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Atomic force microscope probe based controlled pushing for nanotribological characterization

Sitti, M.

IEEE/ASME Transactions on mechatronics, 9(2):343-349, IEEE, 2004 (article)

pi

[BibTex]

[BibTex]

1998


Summarization of video-taped presentations: Automatic analysis of motion and gesture
Summarization of video-taped presentations: Automatic analysis of motion and gesture

Ju, S. X., Black, M. J., Minneman, S., Kimber, D.

IEEE Trans. on Circuits and Systems for Video Technology, 8(5):686-696, September 1998 (article)

Abstract
This paper presents an automatic system for analyzing and annotating video sequences of technical talks. Our method uses a robust motion estimation technique to detect key frames and segment the video sequence into subsequences containing a single overhead slide. The subsequences are stabilized to remove motion that occurs when the speaker adjusts their slides. Any changes remaining between frames in the stabilized sequences may be due to speaker gestures such as pointing or writing, and we use active contours to automatically track these potential gestures. Given the constrained domain, we define a simple set of actions that can be recognized based on the active contour shape and motion. The recognized actions provide an annotation of the sequence that can be used to access a condensed version of the talk from a Web page.

ps

pdf pdf from publisher DOI [BibTex]

1998


pdf pdf from publisher DOI [BibTex]


Robust anisotropic diffusion
Robust anisotropic diffusion

Black, M. J., Sapiro, G., Marimont, D., Heeger, D.

IEEE Transactions on Image Processing, 7(3):421-432, March 1998 (article)

Abstract
Relations between anisotropic diffusion and robust statistics are described in this paper. Specifically, we show that anisotropic diffusion can be seen as a robust estimation procedure that estimates a piecewise smooth image from a noisy input image. The edge-stopping; function in the anisotropic diffusion equation is closely related to the error norm and influence function in the robust estimation framework. This connection leads to a new edge-stopping; function based on Tukey's biweight robust estimator that preserves sharper boundaries than previous formulations and improves the automatic stopping of the diffusion. The robust statistical interpretation also provides a means for detecting the boundaries (edges) between the piecewise smooth regions in an image that has been smoothed with anisotropic diffusion. Additionally, we derive a relationship between anisotropic diffusion and regularization with line processes. Adding constraints on the spatial organization of the line processes allows us to develop new anisotropic diffusion equations that result in a qualitative improvement in the continuity of edges

ps

pdf pdf from publisher [BibTex]

pdf pdf from publisher [BibTex]


Surface second-order nonlinear optical activity
Surface second-order nonlinear optical activity

Fischer, P., Buckingham, A.

JOURNAL OF THE OPTICAL SOCIETY OF AMERICA B-OPTICAL PHYSICS, 15(12):2951-2957, 1998 (article)

Abstract
Following the recent observation of a large second-harmonic intensity difference from a monolayer of chiral molecules with left and right circularly polarized light, the scattering theory is generalized and extended to predict linear and circular intensity differences for the more Versatile sum-frequency spectroscopy. Estimates indicate that intensity differences should be detectable for a typical experimental arrangement. The second-order nonlinear surface susceptibility tensor is given for different surface point groups in the electric dipole approximation; it is shown that nonlinear optical activity phenomena unambiguously probe molecular chirality only for molecular monolayers that are symmetric about the normal. Other surface symmetries can give rise to intensity differences from monolayers composed of achiral molecules. A water surface is predicted to show Linear and nonlinear optical activity in the presence of an electric field parallel to the surface. (C) 1998 Optical Society of America {[}S0740-3224(98)01311-3] OCIS codes: 190.0190, 190.4350, 240.6490.

pf

DOI [BibTex]

DOI [BibTex]


Linear electro-optic effect in optically active liquids
Linear electro-optic effect in optically active liquids

Buckingham, A., Fischer, P.

CHEMICAL PHYSICS LETTERS, 297(3-4):239-246, 1998 (article)

Abstract
A linear effect of an electrostatic field F on the intensity of sum- and difference-frequency generation in a chiral liquid is predicted. It arises in the electric dipole approximation. The effect changes sign with the enantiomer and on reversing the direction of the electrostatic field. The sum-frequency generator chi(alpha beta gamma)((2)) (-omega(3);omega(1),omega(2)), where omega(3) = omega(1) + omega(2), and the electric field-induced sum-frequency generator chi(alpha beta gamma delta)((3))(-omega(3);omega(1),omega(2),0)F-delta interfere and their contributions to the scattering power can be distinguished. Encouraging predictions are given for a typical experimental arrangement. (C) 1998 Elsevier Science B.V. All rights reserved.

pf

DOI [BibTex]

DOI [BibTex]


Monolayers of hexadecyltrimethylammonium p-tosylate at the air-water interface. 1. Sum-frequency spectroscopy
Monolayers of hexadecyltrimethylammonium p-tosylate at the air-water interface. 1. Sum-frequency spectroscopy

Bell, G., Li, Z., Bain, C., Fischer, P., Duffy, D.

JOURNAL OF PHYSICAL CHEMISTRY B, 102(47):9461-9472, 1998 (article)

Abstract
Sum-frequency vibrational spectroscopy has been used to determine the structure of monolayers of the cationic surfactant, hexadecyltrimethylammonium p-tosylate (C(16)TA(+)Ts(-)), at the surface of water. Selective deuteration of the cation or the anion allowed the separate detection of sum-frequency spectra of the surfactant and of counterions that are bound to the monolayer. The p-tosylate ions an oriented with their methyl groups pointing away from the aqueous subphase and with the C-2 axis tilted, on average, by 30-40 degrees from the surface normal. The vibrational spectra of C(16)TA(+) indicate that the number of gauche defects in the monolayer does not change dramatically when bromide counterions are replaced by p-tosylate. The ends of the hydrocarbon chains of C16TA+ are, however, tilted much further from the surface normal in the presence of p-tosylate than in the presence of bromide. A quantitative analysis of the sum-frequency spectra requires a knowledge of the molecular hyperpolarizability tensor: the role of ab initio calculations and Raman spectroscopy in determining the components of this tensor is discussed.

pf

DOI [BibTex]

DOI [BibTex]


Ultraviolet resonance Raman study of drug binding in dihydrofolate reductase, gyrase, and catechol O-methyltransferase
Ultraviolet resonance Raman study of drug binding in dihydrofolate reductase, gyrase, and catechol O-methyltransferase

Couling, V., Fischer, P., Klenerman, D., Huber, W.

BIOPHYSICAL JOURNAL, 75(2):1097-1106, 1998 (article)

Abstract
This paper presents a study of the use of ultraviolet resonance Raman (UVRR) spectroscopic methods as a means of elucidating aspects of drug-protein interactions. Some of the RR vibrational bands of the aromatic amino acids tyrosine and tryptophan are sensitive to the microenvironment, and the use of UV excitation radiation allows selective enhancement of the spectral features of the aromatic amino acids, enabling observation specifically of their change in microenvironment upon drug binding. The three drug-protein systems investigated in this study are dihydrofolate reductase with its inhibitor trimethoprim, gyrase with novobiocin, and catechol O-methyltransferase with dinitrocatechol. It is demonstrated that UVRR spectroscopy has adequate sensitivity to be a useful means of detecting drug-protein interactions in those systems for which the electronic absorption of the aromatic amino acids changes because of hydrogen bonding and/or possible dipole-dipole and dipole-polarizability interactions with the ligand.

pf

DOI [BibTex]

DOI [BibTex]


no image
Tele-nanorobotics using an atomic force microscope as a nanorobot and sensor

Sitti, M., Hashimoto, H.

Advanced Robotics, 13(4):417-436, Taylor & Francis, 1998 (article)

pi

[BibTex]

[BibTex]


{PLAYBOT}: A visually-guided robot for physically disabled children
PLAYBOT: A visually-guided robot for physically disabled children

Tsotsos, J. K., Verghese, G., Dickinson, S., Jenkin, M., Jepson, A., Milios, E., Nuflo, F., Stevenson, S., Black, M., Metaxas, D., Culhane, S., Ye, Y., Mann, R.

Image & Vision Computing, Special Issue on Vision for the Disabled, 16(4):275-292, 1998 (article)

Abstract
This paper overviews the PLAYBOT project, a long-term, large-scale research program whose goal is to provide a directable robot which may enable physically disabled children to access and manipulate toys. This domain is the first test domain, but there is nothing inherent in the design of PLAYBOT that prohibits its extension to other tasks. The research is guided by several important goals: vision is the primary sensor; vision is task directed; the robot must be able to visually search its environment; object and event recognition are basic capabilities; environments must be natural and dynamic; users and environments are assumed to be unpredictable; task direction and reactivity must be smoothly integrated; and safety is of high importance. The emphasis of the research has been on vision for the robot this is the most challenging research aspect and the major bottleneck to the development of intelligent robots. Since the control framework is behavior-based, the visual capabilities of PLAYBOT are described in terms of visual behaviors. Many of the components of PLAYBOT are briefly described and several examples of implemented sub-systems are shown. The paper concludes with a description of the current overall system implementation, and a complete example of PLAYBOT performing a simple task.

ps

pdf pdf from publisher DOI [BibTex]

pdf pdf from publisher DOI [BibTex]


EigenTracking: Robust matching and tracking of articulated objects using a view-based representation
EigenTracking: Robust matching and tracking of articulated objects using a view-based representation

Black, M. J., Jepson, A.

International Journal of Computer Vision, 26(1):63-84, 1998 (article)

Abstract
This paper describes an approach for tracking rigid and articulated objects using a view-based representation. The approach builds on and extends work on eigenspace representations, robust estimation techniques, and parameterized optical flow estimation. First, we note that the least-squares image reconstruction of standard eigenspace techniques has a number of problems and we reformulate the reconstruction problem as one of robust estimation. Second we define a “subspace constancy assumption” that allows us to exploit techniques for parameterized optical flow estimation to simultaneously solve for the view of an object and the affine transformation between the eigenspace and the image. To account for large affine transformations between the eigenspace and the image we define a multi-scale eigenspace representation and a coarse-to-fine matching strategy. Finally, we use these techniques to track objects over long image sequences in which the objects simultaneously undergo both affine image motions and changes of view. In particular we use this “EigenTracking” technique to track and recognize the gestures of a moving hand.

ps

pdf pdf from publisher video [BibTex]