Header logo is

22 results (View BibTeX file of all listed publications)

2016

Thumb xl psychscience
Creating body shapes from verbal descriptions by linking similarity spaces

Hill, M. Q., Streuber, S., Hahn, C. A., Black, M. J., O’Toole, A. J.

Psychological Science, 27(11):1486-1497, November 2016, (article)

Abstract
Brief verbal descriptions of bodies (e.g. curvy, long-legged) can elicit vivid mental images. The ease with which we create these mental images belies the complexity of three-dimensional body shapes. We explored the relationship between body shapes and body descriptions and show that a small number of words can be used to generate categorically accurate representations of three-dimensional bodies. The dimensions of body shape variation that emerged in a language-based similarity space were related to major dimensions of variation computed directly from three-dimensional laser scans of 2094 bodies. This allowed us to generate three-dimensional models of people in the shape space using only their coordinates on analogous dimensions in the language-based description space. Human descriptions of photographed bodies and their corresponding models matched closely. The natural mapping between the spaces illustrates the role of language as a concise code for body shape, capturing perceptually salient global and local body features.

ps

pdf [BibTex]

2016

ps Hill, M. Q., Streuber, S., Hahn, C. A., Black, M. J., O’Toole, A. J. Creating body shapes from verbal descriptions by linking similarity spaces Psychological Science, 27(11):1486-1497, November 2016, (article)

pdf [BibTex]

no image
An electro-active polymer based lens module for dynamically varying focal system

Yun, S., Park, S., Nam, S., Park, B., Park, S. K., Mun, S., Lim, J. M., Kyung, K.

Applied Physics Letters, 109(14):141908, October 2016 (article)

Abstract
We demonstrate a polymer-based active-lens module allowing a dynamic focus controllable optical system with a wide tunable range. The active-lens module is composed of parallelized two active- lenses with a convex and a concave shaped hemispherical lens structure, respectively. Under opera- tion with dynamic input voltage signals, each active-lens produces translational movement bi-directionally responding to a hybrid driving force that is a combination of an electro-active response of a thin dielectric elastomer membrane and an electro-static attraction force. Since the proposed active lens module widely modulates a gap-distance between lens-elements, an optical system based on the active-lens module provides widely-variable focusing for selective imaging of objects in arbitrary position.

hi

link (url) DOI [BibTex]

hi Yun, S., Park, S., Nam, S., Park, B., Park, S. K., Mun, S., Lim, J. M., Kyung, K. An electro-active polymer based lens module for dynamically varying focal system Applied Physics Letters, 109(14):141908, October 2016 (article)

link (url) DOI [BibTex]

no image
Wrinkle structures formed by formulating UV-crosslinkable liquid prepolymers

Park, S. K., Kwark, Y., Nam, S., Park, S., Park, B., Yun, S., Moon, J., Lee, J., Yu, B., Kyung, K.

Polymer, 99, pages: 447-452, September 2016 (article)

Abstract
Artificial wrinkles have recently been in the spotlight due to their potential use in high-tech applications. A spontaneously wrinkled film can be fabricated from UV-crosslinkable liquid prepolymers. Here, we controlled the wrinkle formation by simply formulating two UV-crosslinkable liquid prepolymers, tetraethylene glycol bis(4-ethenyl-2,3,5,6-tetrafluorophenyl) ether (TEGDSt) and tetraethylene glycol diacrylate (TEGDA). The wrinkles were formed from the TEGDSt/TEGDA formulated prepolymer layers containing up to 30 wt% of TEGDA. The wrinkle formation depended upon the rate of photo-crosslinking reaction of the formulated prepolymers. The first order apparent rate constant, kapp, was between ca. 5.7 × 10−3 and 12.2 × 10−3 s−1 for the wrinkle formation. The wrinkle structures were modulated within the kapp mainly due to variation in the extent of shrinkage of the formulated prepolymer layers with the content of TEGDA

hi

link (url) DOI [BibTex]

hi Park, S. K., Kwark, Y., Nam, S., Park, S., Park, B., Yun, S., Moon, J., Lee, J., Yu, B., Kyung, K. Wrinkle structures formed by formulating UV-crosslinkable liquid prepolymers Polymer, 99, pages: 447-452, September 2016 (article)

link (url) DOI [BibTex]

Thumb xl webteaser
Body Talk: Crowdshaping Realistic 3D Avatars with Words

Streuber, S., Quiros-Ramirez, M. A., Hill, M. Q., Hahn, C. A., Zuffi, S., O’Toole, A., Black, M. J.

ACM Trans. Graph. (Proc. SIGGRAPH), 35(4):54:1-54:14, July 2016 (article)

Abstract
Realistic, metrically accurate, 3D human avatars are useful for games, shopping, virtual reality, and health applications. Such avatars are not in wide use because solutions for creating them from high-end scanners, low-cost range cameras, and tailoring measurements all have limitations. Here we propose a simple solution and show that it is surprisingly accurate. We use crowdsourcing to generate attribute ratings of 3D body shapes corresponding to standard linguistic descriptions of 3D shape. We then learn a linear function relating these ratings to 3D human shape parameters. Given an image of a new body, we again turn to the crowd for ratings of the body shape. The collection of linguistic ratings of a photograph provides remarkably strong constraints on the metric 3D shape. We call the process crowdshaping and show that our Body Talk system produces shapes that are perceptually indistinguishable from bodies created from high-resolution scans and that the metric accuracy is sufficient for many tasks. This makes body “scanning” practical without a scanner, opening up new applications including database search, visualization, and extracting avatars from books.

ps

pdf web tool video talk (ppt) [BibTex]

ps Streuber, S., Quiros-Ramirez, M. A., Hill, M. Q., Hahn, C. A., Zuffi, S., O’Toole, A., Black, M. J. Body Talk: Crowdshaping Realistic 3D Avatars with Words ACM Trans. Graph. (Proc. SIGGRAPH), 35(4):54:1-54:14, July 2016 (article)

pdf web tool video talk (ppt) [BibTex]

Thumb xl ijcv tumb
Capturing Hands in Action using Discriminative Salient Points and Physics Simulation

Tzionas, D., Ballan, L., Srikantha, A., Aponte, P., Pollefeys, M., Gall, J.

International Journal of Computer Vision (IJCV), 118(2):172-193, June 2016 (article)

Abstract
Hand motion capture is a popular research field, recently gaining more attention due to the ubiquity of RGB-D sensors. However, even most recent approaches focus on the case of a single isolated hand. In this work, we focus on hands that interact with other hands or objects and present a framework that successfully captures motion in such interaction scenarios for both rigid and articulated objects. Our framework combines a generative model with discriminatively trained salient points to achieve a low tracking error and with collision detection and physics simulation to achieve physically plausible estimates even in case of occlusions and missing visual data. Since all components are unified in a single objective function which is almost everywhere differentiable, it can be optimized with standard optimization techniques. Our approach works for monocular RGB-D sequences as well as setups with multiple synchronized RGB cameras. For a qualitative and quantitative evaluation, we captured 29 sequences with a large variety of interactions and up to 150 degrees of freedom.

ps

Website pdf link (url) DOI Project Page [BibTex]

ps Tzionas, D., Ballan, L., Srikantha, A., Aponte, P., Pollefeys, M., Gall, J. Capturing Hands in Action using Discriminative Salient Points and Physics Simulation International Journal of Computer Vision (IJCV), 118(2):172-193, June 2016 (article)

Website pdf link (url) DOI Project Page [BibTex]

no image
Objective assessment of robotic surgical skill using instrument contact vibrations

Gomez, E. D., Aggarwal, R., McMahan, W., Bark, K., Kuchenbecker, K. J.

Surgical Endoscopy, 30(4):1419-1431, 2016 (article)

hi

[BibTex]

hi Gomez, E. D., Aggarwal, R., McMahan, W., Bark, K., Kuchenbecker, K. J. Objective assessment of robotic surgical skill using instrument contact vibrations Surgical Endoscopy, 30(4):1419-1431, 2016 (article)

[BibTex]

no image
Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery

Pacchierotti, C., Prattichizzo, D., Kuchenbecker, K. J.

IEEE Transactions on Biomedical Engineering, 63(2):278-287, February 2016 (article)

hi

[BibTex]

hi Pacchierotti, C., Prattichizzo, D., Kuchenbecker, K. J. Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery IEEE Transactions on Biomedical Engineering, 63(2):278-287, February 2016 (article)

[BibTex]

no image
Structure modulated electrostatic deformable mirror for focus and geometry control

Nam, S., Park, S., Yun, S., Park, B., Park, S. K., Kyung, K.

Optics Express, 24(1):55-66, OSA, January 2016 (article)

Abstract
We suggest a way to electrostatically control deformed geometry of an electrostatic deformable mirror (EDM) based on geometric modulation of a basement. The EDM is composed of a metal coated elastomeric membrane (active mirror) and a polymeric basement with electrode (ground). When an electrical voltage is applied across the components, the active mirror deforms toward the stationary basement responding to electrostatic attraction force in an air gap. Since the differentiated gap distance can induce change in electrostatic force distribution between the active mirror and the basement, the EDMs are capable of controlling deformed geometry of the active mirror with different basement structures (concave, flat, and protrusive). The modulation of the deformed geometry leads to significant change in the range of the focal length of the EDMs. Even under dynamic operations, the EDM shows fairly consistent and large deformation enough to change focal length in a wide frequency range (1~175 Hz). The geometric modulation of the active mirror with dynamic focus tunability can allow the EDM to be an active mirror lens for optical zoom devices as well as an optical component controlling field of view.

hi

link (url) DOI [BibTex]

hi Nam, S., Park, S., Yun, S., Park, B., Park, S. K., Kyung, K. Structure modulated electrostatic deformable mirror for focus and geometry control Optics Express, 24(1):55-66, OSA, January 2016 (article)

link (url) DOI [BibTex]

Thumb xl teaser web
Human Pose Estimation from Video and IMUs

Marcard, T. V., Pons-Moll, G., Rosenhahn, B.

Transactions on Pattern Analysis and Machine Intelligence PAMI, 38(8):1533-1547, January 2016 (article)

ps

data pdf dataset_documentation [BibTex]

ps Marcard, T. V., Pons-Moll, G., Rosenhahn, B. Human Pose Estimation from Video and IMUs Transactions on Pattern Analysis and Machine Intelligence PAMI, 38(8):1533-1547, January 2016 (article)

data pdf dataset_documentation [BibTex]

Thumb xl both testbed cropped
Moving-horizon Nonlinear Least Squares-based Multirobot Cooperative Perception

Ahmad, A., Bülthoff, H.

Robotics and Autonomous Systems, 83, pages: 275-286, 2016 (article)

Abstract
In this article we present an online estimator for multirobot cooperative localization and target tracking based on nonlinear least squares minimization. Our method not only makes the rigorous optimization-based approach applicable online but also allows the estimator to be stable and convergent. We do so by employing a moving horizon technique to nonlinear least squares minimization and a novel design of the arrival cost function that ensures stability and convergence of the estimator. Through an extensive set of real robot experiments, we demonstrate the robustness of our method as well as the optimality of the arrival cost function. The experiments include comparisons of our method with i) an extended Kalman filter-based online-estimator and ii) an offline-estimator based on full-trajectory nonlinear least squares.

ps

DOI Project Page [BibTex]

ps Ahmad, A., Bülthoff, H. Moving-horizon Nonlinear Least Squares-based Multirobot Cooperative Perception Robotics and Autonomous Systems, 83, pages: 275-286, 2016 (article)

DOI Project Page [BibTex]

Thumb xl siyong
Shape estimation of subcutaneous adipose tissue using an articulated statistical shape model

Yeo, S. Y., Romero, J., Loper, M., Machann, J., Black, M.

Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 0(0):1-8, 2016 (article)

ps

publisher website preprint pdf link (url) DOI Project Page [BibTex]

ps Yeo, S. Y., Romero, J., Loper, M., Machann, J., Black, M. Shape estimation of subcutaneous adipose tissue using an articulated statistical shape model Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 0(0):1-8, 2016 (article)

publisher website preprint pdf link (url) DOI Project Page [BibTex]

no image
Peripheral vs. central determinants of vibrotactile adaptation

Klöcker, A., Gueorguiev, D., Thonnard, J. L., Mouraux, A.

Journal of Neurophysiology, 115(2):685-691, 2016, PMID: 26581868 (article)

Abstract
Long-lasting mechanical vibrations applied to the skin induce a reversible decrease in the perception of vibration at the stimulated skin site. This phenomenon of vibrotactile adaptation has been studied extensively, yet there is still no clear consensus on the mechanisms leading to vibrotactile adaptation. In particular, the respective contributions of 1) changes affecting mechanical skin impedance, 2) peripheral processes, and 3) central processes are largely unknown. Here we used direct electrical stimulation of nerve fibers to bypass mechanical transduction processes and thereby explore the possible contribution of central vs. peripheral processes to vibrotactile adaptation. Three experiments were conducted. In the first, adaptation was induced with mechanical vibration of the fingertip (51- or 251-Hz vibration delivered for 8 min, at 40× detection threshold). In the second, we attempted to induce adaptation with transcutaneous electrical stimulation of the median nerve (51- or 251-Hz constant-current pulses delivered for 8 min, at 1.5× detection threshold). Vibrotactile detection thresholds were measured before and after adaptation. Mechanical stimulation induced a clear increase of vibrotactile detection thresholds. In contrast, thresholds were unaffected by electrical stimulation. In the third experiment, we assessed the effect of mechanical adaptation on the detection thresholds to transcutaneous electrical nerve stimuli, measured before and after adaptation. Electrical detection thresholds were unaffected by the mechanical adaptation. Taken together, our results suggest that vibrotactile adaptation is predominantly the consequence of peripheral mechanoreceptor processes and/or changes in biomechanical properties of the skin.

hi

link (url) DOI [BibTex]

hi Klöcker, A., Gueorguiev, D., Thonnard, J. L., Mouraux, A. Peripheral vs. central determinants of vibrotactile adaptation Journal of Neurophysiology, 115(2):685-691, 2016, PMID: 26581868 (article)

link (url) DOI [BibTex]

no image
On designing an active tail for legged robots: simplifying control via decoupling of control objectives

Heim, S. W., Ajallooeian, M., Eckert, P., Vespignani, M., Ijspeert, A. J.

Industrial Robot: An International Journal, 43, pages: 338-346, Emerald Group Publishing Limited, 2016 (article)

dlg

Preprint [BibTex]

dlg Heim, S. W., Ajallooeian, M., Eckert, P., Vespignani, M., Ijspeert, A. J. On designing an active tail for legged robots: simplifying control via decoupling of control objectives Industrial Robot: An International Journal, 43, pages: 338-346, Emerald Group Publishing Limited, 2016 (article)

Preprint [BibTex]

Thumb xl screen shot 2017 06 14 at 3.04.03 pm
ATRIAS: Design and validation of a tether-free 3D-capable spring-mass bipedal robot

Hubicki, C., Grimes, J., Jones, M., Renjewski, D., Spröwitz, A., Abate, A., Hurst, J.

{The International Journal of Robotics Research}, 35(12):1497-1521, Sage Publications, Inc., Cambridge, MA, 2016 (article)

dlg

DOI Project Page [BibTex]

dlg Hubicki, C., Grimes, J., Jones, M., Renjewski, D., Spröwitz, A., Abate, A., Hurst, J. ATRIAS: Design and validation of a tether-free 3D-capable spring-mass bipedal robot {The International Journal of Robotics Research}, 35(12):1497-1521, Sage Publications, Inc., Cambridge, MA, 2016 (article)

DOI Project Page [BibTex]

no image
Silent Expectations: Dynamic Causal Modeling of Cortical Prediction and Attention to Sounds That Weren’t

Chennu, S., Noreika, V., Gueorguiev, D., Shtyrov, Y., Bekinschtein, T. A., Henson, R.

Journal of Neuroscience, 36(32):8305-8316, Society for Neuroscience, 2016 (article)

Abstract
There is increasing evidence that human perception is realized by a hierarchy of neural processes in which predictions sent backward from higher levels result in prediction errors that are fed forward from lower levels, to update the current model of the environment. Moreover, the precision of prediction errors is thought to be modulated by attention. Much of this evidence comes from paradigms in which a stimulus differs from that predicted by the recent history of other stimuli (generating a so-called {\textquotedblleft}mismatch response{\textquotedblright}). There is less evidence from situations where a prediction is not fulfilled by any sensory input (an {\textquotedblleft}omission{\textquotedblright} response). This situation arguably provides a more direct measure of {\textquotedblleft}top-down{\textquotedblright} predictions in the absence of confounding {\textquotedblleft}bottom-up{\textquotedblright} input. We applied Dynamic Causal Modeling of evoked electromagnetic responses recorded by EEG and MEG to an auditory paradigm in which we factorially crossed the presence versus absence of {\textquotedblleft}bottom-up{\textquotedblright} stimuli with the presence versus absence of {\textquotedblleft}top-down{\textquotedblright} attention. Model comparison revealed that both mismatch and omission responses were mediated by increased forward and backward connections, differing primarily in the driving input. In both responses, modeling results suggested that the presence of attention selectively modulated backward {\textquotedblleft}prediction{\textquotedblright} connections. Our results provide new model-driven evidence of the pure top-down prediction signal posited in theories of hierarchical perception, and highlight the role of attentional precision in strengthening this prediction.SIGNIFICANCE STATEMENT Human auditory perception is thought to be realized by a network of neurons that maintain a model of and predict future stimuli. Much of the evidence for this comes from experiments where a stimulus unexpectedly differs from previous ones, which generates a well-known {\textquotedblleft}mismatch response.{\textquotedblright} But what happens when a stimulus is unexpectedly omitted altogether? By measuring the brain{\textquoteright}s electromagnetic activity, we show that it also generates an {\textquotedblleft}omission response{\textquotedblright} that is contingent on the presence of attention. We model these responses computationally, revealing that mismatch and omission responses only differ in the location of inputs into the same underlying neuronal network. In both cases, we show that attention selectively strengthens the brain{\textquoteright}s prediction of the future.

hi

link (url) DOI [BibTex]

hi Chennu, S., Noreika, V., Gueorguiev, D., Shtyrov, Y., Bekinschtein, T. A., Henson, R. Silent Expectations: Dynamic Causal Modeling of Cortical Prediction and Attention to Sounds That Weren’t Journal of Neuroscience, 36(32):8305-8316, Society for Neuroscience, 2016 (article)

link (url) DOI [BibTex]

no image
Touch uses frictional cues to discriminate flat materials

Gueorguiev, D., Bochereau, S., Mouraux, A., Hayward, V., Thonnard, J.

Scientific reports, 6, pages: 25553, Nature Publishing Group, 2016 (article)

hi

[BibTex]

hi Gueorguiev, D., Bochereau, S., Mouraux, A., Hayward, V., Thonnard, J. Touch uses frictional cues to discriminate flat materials Scientific reports, 6, pages: 25553, Nature Publishing Group, 2016 (article)

[BibTex]

Thumb xl screen shot 2016 02 22 at 11.46.41
The GRASP Taxonomy of Human Grasp Types

Feix, T., Romero, J., Schmiedmayer, H., Dollar, A., Kragic, D.

Human-Machine Systems, IEEE Transactions on, 46(1):66-77, 2016 (article)

ps

publisher website pdf DOI Project Page [BibTex]

ps Feix, T., Romero, J., Schmiedmayer, H., Dollar, A., Kragic, D. The GRASP Taxonomy of Human Grasp Types Human-Machine Systems, IEEE Transactions on, 46(1):66-77, 2016 (article)

publisher website pdf DOI Project Page [BibTex]

Thumb xl pami
Map-Based Probabilistic Visual Self-Localization

Brubaker, M. A., Geiger, A., Urtasun, R.

IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), 2016 (article)

Abstract
Accurate and efficient self-localization is a critical problem for autonomous systems. This paper describes an affordable solution to vehicle self-localization which uses odometry computed from two video cameras and road maps as the sole inputs. The core of the method is a probabilistic model for which an efficient approximate inference algorithm is derived. The inference algorithm is able to utilize distributed computation in order to meet the real-time requirements of autonomous systems in some instances. Because of the probabilistic nature of the model the method is capable of coping with various sources of uncertainty including noise in the visual odometry and inherent ambiguities in the map (e.g., in a Manhattan world). By exploiting freely available, community developed maps and visual odometry measurements, the proposed method is able to localize a vehicle to 4m on average after 52 seconds of driving on maps which contain more than 2,150km of drivable roads.

avg ps

pdf Project Page [BibTex]

avg ps Brubaker, M. A., Geiger, A., Urtasun, R. Map-Based Probabilistic Visual Self-Localization IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), 2016 (article)

pdf Project Page [BibTex]

1998

Thumb xl bildschirmfoto 2012 12 06 um 10.05.20
Summarization of video-taped presentations: Automatic analysis of motion and gesture

Ju, S. X., Black, M. J., Minneman, S., Kimber, D.

IEEE Trans. on Circuits and Systems for Video Technology, 8(5):686-696, September 1998 (article)

Abstract
This paper presents an automatic system for analyzing and annotating video sequences of technical talks. Our method uses a robust motion estimation technique to detect key frames and segment the video sequence into subsequences containing a single overhead slide. The subsequences are stabilized to remove motion that occurs when the speaker adjusts their slides. Any changes remaining between frames in the stabilized sequences may be due to speaker gestures such as pointing or writing, and we use active contours to automatically track these potential gestures. Given the constrained domain, we define a simple set of actions that can be recognized based on the active contour shape and motion. The recognized actions provide an annotation of the sequence that can be used to access a condensed version of the talk from a Web page.

ps

pdf pdf from publisher DOI [BibTex]

1998

ps Ju, S. X., Black, M. J., Minneman, S., Kimber, D. Summarization of video-taped presentations: Automatic analysis of motion and gesture IEEE Trans. on Circuits and Systems for Video Technology, 8(5):686-696, September 1998 (article)

pdf pdf from publisher DOI [BibTex]

Thumb xl bildschirmfoto 2012 12 06 um 12.22.18
Robust anisotropic diffusion

Black, M. J., Sapiro, G., Marimont, D., Heeger, D.

IEEE Transactions on Image Processing, 7(3):421-432, March 1998 (article)

Abstract
Relations between anisotropic diffusion and robust statistics are described in this paper. Specifically, we show that anisotropic diffusion can be seen as a robust estimation procedure that estimates a piecewise smooth image from a noisy input image. The edge-stopping; function in the anisotropic diffusion equation is closely related to the error norm and influence function in the robust estimation framework. This connection leads to a new edge-stopping; function based on Tukey's biweight robust estimator that preserves sharper boundaries than previous formulations and improves the automatic stopping of the diffusion. The robust statistical interpretation also provides a means for detecting the boundaries (edges) between the piecewise smooth regions in an image that has been smoothed with anisotropic diffusion. Additionally, we derive a relationship between anisotropic diffusion and regularization with line processes. Adding constraints on the spatial organization of the line processes allows us to develop new anisotropic diffusion equations that result in a qualitative improvement in the continuity of edges

ps

pdf pdf from publisher [BibTex]

ps Black, M. J., Sapiro, G., Marimont, D., Heeger, D. Robust anisotropic diffusion IEEE Transactions on Image Processing, 7(3):421-432, March 1998 (article)

pdf pdf from publisher [BibTex]

Thumb xl paybotteaser
PLAYBOT: A visually-guided robot for physically disabled children

Tsotsos, J. K., Verghese, G., Dickinson, S., Jenkin, M., Jepson, A., Milios, E., Nuflo, F., Stevenson, S., Black, M., Metaxas, D., Culhane, S., Ye, Y., Mann, R.

Image & Vision Computing, Special Issue on Vision for the Disabled, 16(4):275-292, 1998 (article)

Abstract
This paper overviews the PLAYBOT project, a long-term, large-scale research program whose goal is to provide a directable robot which may enable physically disabled children to access and manipulate toys. This domain is the first test domain, but there is nothing inherent in the design of PLAYBOT that prohibits its extension to other tasks. The research is guided by several important goals: vision is the primary sensor; vision is task directed; the robot must be able to visually search its environment; object and event recognition are basic capabilities; environments must be natural and dynamic; users and environments are assumed to be unpredictable; task direction and reactivity must be smoothly integrated; and safety is of high importance. The emphasis of the research has been on vision for the robot this is the most challenging research aspect and the major bottleneck to the development of intelligent robots. Since the control framework is behavior-based, the visual capabilities of PLAYBOT are described in terms of visual behaviors. Many of the components of PLAYBOT are briefly described and several examples of implemented sub-systems are shown. The paper concludes with a description of the current overall system implementation, and a complete example of PLAYBOT performing a simple task.

ps

pdf pdf from publisher DOI [BibTex]

ps Tsotsos, J. K., Verghese, G., Dickinson, S., Jenkin, M., Jepson, A., Milios, E., Nuflo, F., Stevenson, S., Black, M., Metaxas, D., Culhane, S., Ye, Y., Mann, R. PLAYBOT: A visually-guided robot for physically disabled children Image & Vision Computing, Special Issue on Vision for the Disabled, 16(4):275-292, 1998 (article)

pdf pdf from publisher DOI [BibTex]

Thumb xl bildschirmfoto 2012 12 06 um 12.33.38
EigenTracking: Robust matching and tracking of articulated objects using a view-based representation

Black, M. J., Jepson, A.

International Journal of Computer Vision, 26(1):63-84, 1998 (article)

Abstract
This paper describes an approach for tracking rigid and articulated objects using a view-based representation. The approach builds on and extends work on eigenspace representations, robust estimation techniques, and parameterized optical flow estimation. First, we note that the least-squares image reconstruction of standard eigenspace techniques has a number of problems and we reformulate the reconstruction problem as one of robust estimation. Second we define a “subspace constancy assumption” that allows us to exploit techniques for parameterized optical flow estimation to simultaneously solve for the view of an object and the affine transformation between the eigenspace and the image. To account for large affine transformations between the eigenspace and the image we define a multi-scale eigenspace representation and a coarse-to-fine matching strategy. Finally, we use these techniques to track objects over long image sequences in which the objects simultaneously undergo both affine image motions and changes of view. In particular we use this “EigenTracking” technique to track and recognize the gestures of a moving hand.

ps

pdf pdf from publisher video [BibTex]