Header logo is


2009


Thumb xl foe2009
Fields of Experts

Roth, S., Black, M. J.

International Journal of Computer Vision (IJCV), 82(2):205-29, April 2009 (article)

Abstract
We develop a framework for learning generic, expressive image priors that capture the statistics of natural scenes and can be used for a variety of machine vision tasks. The approach provides a practical method for learning high-order Markov random field (MRF) models with potential functions that extend over large pixel neighborhoods. These clique potentials are modeled using the Product-of-Experts framework that uses non-linear functions of many linear filter responses. In contrast to previous MRF approaches all parameters, including the linear filters themselves, are learned from training data. We demonstrate the capabilities of this Field-of-Experts model with two example applications, image denoising and image inpainting, which are implemented using a simple, approximate inference scheme. While the model is trained on a generic image database and is not tuned toward a specific application, we obtain results that compete with specialized techniques.

ps

pdf pdf from publisher [BibTex]

2009


pdf pdf from publisher [BibTex]


no image
An introduction to Kernel Learning Algorithms

Gehler, P., Schölkopf, B.

In Kernel Methods for Remote Sensing Data Analysis, pages: 25-48, 2, (Editors: Gustavo Camps-Valls and Lorenzo Bruzzone), Wiley, New York, NY, USA, 2009 (inbook)

Abstract
Kernel learning algorithms are currently becoming a standard tool in the area of machine learning and pattern recognition. In this chapter we review the fundamental theory of kernel learning. As the basic building block we introduce the kernel function, which provides an elegant and general way to compare possibly very complex objects. We then review the concept of a reproducing kernel Hilbert space and state the representer theorem. Finally we give an overview of the most prominent algorithms, which are support vector classification and regression, Gaussian Processes and kernel principal analysis. With multiple kernel learning and structured output prediction we also introduce some more recent advancements in the field.

ei ps

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Magnetic mobile micro-robots

Pawashe, C., Floyd, S., Sitti, M.

7eme Journees Nationales de la Recherche en Robotique, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Gecko-Inspired Directional and Controllable Adhesion

Murphy, M. P., Aksak, B., Sitti, M.

Small, 5(2):170-175, WILEY-VCH Verlag, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Multiple magnetic microrobot control using electrostatic anchoring

Pawashe, C., Floyd, S., Sitti, M.

Applied Physics Letters, 94(16):164108, AIP, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Wet self-cleaning of biologically inspired elastomer mushroom shaped microfibrillar adhesives

Kim, S., Cheung, E., Sitti, M.

Langmuir, 25(13):7196-7199, ACS Publications, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Visual Object Discovery

Sinha, P., Balas, B., Ostrovsky, Y., Wulff, J.

In Object Categorization: Computer and Human Vision Perspectives, pages: 301-323, (Editors: S. J. Dickinson, A. Leonardis, B. Schiele, M.J. Tarr), Cambridge University Press, 2009 (inbook)

ps

link (url) [BibTex]

link (url) [BibTex]


no image
Robot ceiling climbers harness new tricks

Marks, Paul

New Scientist, 202(2705):18-19, Reed Business Information, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Biologically-Inspired Patterned and Coated Adhesives for Medical Devices

Glass, P, Chung, H, Lee, C, Tworkoski, E, Washburn, NR, Sitti, M

Journal of Medical Devices, 3(2):027537, American Society of Mechanical Engineers, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Modeling and experimental characterization of an untethered magnetic micro-robot

Pawashe, C., Floyd, S., Sitti, M.

The International Journal of Robotics Research, 28(8):1077-1094, Sage Publications, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Towards automated nanoassembly with the atomic force microscope: A versatile drift compensation procedure

Krohs, F., Onal, C., Sitti, M., Fatikow, S.

Journal of Dynamic Systems, Measurement, and Control, 131(6):061106, American Society of Mechanical Engineers, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Enhanced adhesion by gecko-inspired hierarchical fibrillar adhesives

Murphy, M. P., Kim, S., Sitti, M.

ACS applied materials \& interfaces, 1(4):849-855, American Chemical Society, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Miniature devices: Voyage of the microrobots

Sitti, M.

Nature, 458(7242):1121-1122, Nature Publishing Group, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Dry spinning based spinneret based tunable engineered parameters (STEP) technique for controlled and aligned deposition of polymeric nanofibers

Nain, A. S., Sitti, M., Jacobson, A., Kowalewski, T., Amon, C.

Macromolecular rapid communications, 30(16):1406-1412, WILEY-VCH Verlag, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Two-dimensional contact and noncontact micromanipulation in liquid using an untethered mobile magnetic microrobot

Floyd, S., Pawashe, C., Sitti, M.

IEEE Transactions on Robotics, 25(6):1332-1342, IEEE, 2009 (article)

pi

[BibTex]

[BibTex]


Thumb xl ajp1
Left Ventricular Regional Wall Curvedness and Wall Stress in Patients with Ischemic Dilated Cardiomyopathy

Liang Zhong, Yi Su, Si Yong Yeo, Ru San Tan Dhanjoo Ghista, Ghassan Kassab

American Journal of Physiology – Heart and Circulatory Physiology, 296(3):H573-84, 2009 (article)

Abstract
Geometric remodeling of the left ventricle (LV) after myocardial infarction is associated with changes in myocardial wall stress. The objective of this study was to determine the regional curvatures and wall stress based on three-dimensional (3-D) reconstructions of the LV using MRI. Ten patients with ischemic dilated cardiomyopathy (IDCM) and 10 normal subjects underwent MRI scan. The IDCM patients also underwent delayed gadolinium-enhancement imaging to delineate the extent of myocardial infarct. Regional curvedness, local radii of curvature, and wall thickness were calculated. The percent curvedness change between end diastole and end systole was also calculated. In normal heart, a short- and long-axis two-dimensional analysis showed a 41 +/- 11% and 45 +/- 12% increase of the mean of peak systolic wall stress between basal and apical sections, respectively. However, 3-D analysis showed no significant difference in peak systolic wall stress from basal and apical sections (P = 0.298, ANOVA). LV shape differed between IDCM patients and normal subjects in several ways: LV shape was more spherical (sphericity index = 0.62 +/- 0.08 vs. 0.52 +/- 0.06, P < 0.05), curvedness at end diastole (mean for 16 segments = 0.034 +/- 0.0056 vs. 0.040 +/- 0.0071 mm(-1), P < 0.001) and end systole (mean for 16 segments = 0.037 +/- 0.0068 vs. 0.067 +/- 0.020 mm(-1), P < 0.001) was affected by infarction, and peak systolic wall stress was significantly increased at each segment in IDCM patients. The 3-D quantification of regional wall stress by cardiac MRI provides more precise evaluation of cardiac mechanics. Identification of regional curvedness and wall stresses helps delineate the mechanisms of LV remodeling in IDCM and may help guide therapeutic LV restoration.

ps

[BibTex]

[BibTex]


no image
A scaled bilateral control system for experimental one-dimensional teleoperated nanomanipulation

Onal, C. D., Sitti, M.

The International Journal of Robotics Research, 28(4):484-497, Sage Publications, 2009 (article)

pi

[BibTex]

[BibTex]


no image
A Swallowable Tethered Capsule Endoscope for Diagnosing Barrett’s Esophagus

Glass, P., Sitti, M., Pennathur, A., Appasamy, R.

Gastrointestinal Endoscopy, 69(5):AB106, Mosby, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Adhesion of biologically inspired polymer microfibers on soft surfaces

Cheung, E., Sitti, M.

Langmuir, 25(12):6613-6616, ACS Publications, 2009 (article)

pi

[BibTex]

[BibTex]


no image
Dangling chain elastomers as repeatable fibrillar adhesives

Sitti, M., Cusick, B., Aksak, B., Nese, A., Lee, H., Dong, H., Kowalewski, T., Matyjaszewski, K.

ACS applied materials \& interfaces, 1(10):2277-2287, American Chemical Society, 2009 (article)

pi

[BibTex]

[BibTex]


Thumb xl mbec1
A Curvature-Based Approach for Left Ventricular Shape Analysis from Cardiac Magnetic Resonance Imaging

Si Yong Yeo, Liang Zhong, Yi Su, Ru San Tan, Dhanjoo Ghista

Medical & Biological Engineering & Computing, 47(3):313-322, 2009 (article)

Abstract
It is believed that left ventricular (LV) regional shape is indicative of LV regional function, and cardiac pathologies are often associated with regional alterations in ventricular shape. In this article, we present a set of procedures for evaluating regional LV surface shape from anatomically accurate models reconstructed from cardiac magnetic resonance (MR) images. LV surface curvatures are computed using local surface fitting method, which enables us to assess regional LV shape and its variation. Comparisons are made between normal and diseased hearts. It is illustrated that LV surface curvatures at different regions of the normal heart are higher than those of the diseased heart. Also, the normal heart experiences a larger change in regional curvedness during contraction than the diseased heart. It is believed that with a wide range of dataset being evaluated, this approach will provide a new and efficient way of quantifying LV regional function.

ps

link (url) [BibTex]

link (url) [BibTex]


no image
Reversible dry micro-fibrillar adhesives with thermally controllable adhesion

Kim, S., Sitti, M., Xie, T., Xiao, X.

Soft Matter, 5(19):3689-3693, Royal Society of Chemistry, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Enhanced reversible adhesion of dopamine methacrylamide-coated elastomer microfibrillar structures under wet conditions

Glass, P., Chung, H., Washburn, N. R., Sitti, M.

Langmuir, 25(12):6607-6612, ACS Publications, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]

2007


no image
Learning static Gestalt laws through dynamic experience

Ostrovsky, Y., Wulff, J., Sinha, P.

Journal of Vision, 7(9):315-315, ARVO, June 2007 (article)

Abstract
The Gestalt laws (Wertheimer 1923) are widely regarded as the rules that help us parse the world into objects. However, it is unclear as to how these laws are acquired by an infant's visual system. Classically, these “laws” have been presumed to be innate (Kellman and Spelke 1983). But, more recent work in infant development, showing the protracted time-course over which these grouping principles emerge (e.g., Johnson and Aslin 1995; Craton 1996), suggests that visual experience might play a role in their genesis. Specifically, our studies of patients with late-onset vision (Project Prakash; VSS 2006) and evidence from infant development both point to an early role of common motion cues for object grouping. Here we explore the possibility that the privileged status of motion in the developmental timeline is not happenstance, but rather serves to bootstrap the learning of static Gestalt cues. Our approach involves computational analyses of real-world motion sequences to investigate whether primitive optic flow information is correlated with static figural cues that could eventually come to serve as proxies for grouping in the form of Gestalt principles. We calculated local optic flow maps and then examined how similarity of motion across image patches co-varied with similarity of certain figural properties in static frames. Results indicate that patches with similar motion are much more likely to have similar luminance, color, and orientation as compared to patches with dissimilar motion vectors. This regularity suggests that, in principle, common motion extracted from dynamic visual experience can provide enough information to bootstrap region grouping based on luminance and color and contour continuation mechanisms in static scenes. These observations, coupled with the cited experimental studies, lend credence to the hypothesis that static Gestalt laws might be learned through a bootstrapping process based on early dynamic experience.

ps

link (url) DOI [BibTex]

2007


link (url) DOI [BibTex]


Thumb xl pedestal
Neuromotor prosthesis development

Donoghue, J., Hochberg, L., Nurmikko, A., Black, M., Simeral, J., Friehs, G.

Medicine & Health Rhode Island, 90(1):12-15, January 2007 (article)

Abstract
Article describes a neuromotor prosthesis (NMP), in development at Brown University, that records human brain signals, decodes them, and transforms them into movement commands. An NMP is described as a system consisting of a neural interface, a decoding system, and a user interface, also called an effector; a closed-loop system would be completed by a feedback signal from the effector to the brain. The interface is based on neural spiking, a source of information-rich, rapid, complex control signals from the nervous system. The NMP described, named BrainGate, consists of a match-head sized platform with 100 thread-thin electrodes implanted just into the surface of the motor cortex where commands to move the hand emanate. Neural signals are decoded by a rack of computers that displays the resultant output as the motion of a cursor on a computer monitor. While computer cursor motion represents a form of virtual device control, this same command signal could be routed to a device to command motion of paralyzed muscles or the actions of prosthetic limbs. The researchers’ overall goal is the development of a fully implantable, wireless multi-neuron sensor for broad research, neural prosthetic, and human neurodiagnostic applications.

ps

pdf [BibTex]

pdf [BibTex]


no image
Bacterial flagella-based propulsion and on/off motion control of microscale objects

Behkam, B., Sitti, M.

Applied Physics Letters, 90(2):023902, AIP, 2007 (article)

pi

[BibTex]

[BibTex]


no image
Friction of partially embedded vertically aligned carbon nanofibers inside elastomers

Aksak, B., Sitti, M., Cassell, A., Li, J., Meyyappan, M., Callen, P.

Applied Physics Letters, 91(6):061906, AIP, 2007 (article)

pi

[BibTex]

[BibTex]


no image
Enhanced friction of elastomer microfiber adhesives with spatulate tips

Kim, S., Aksak, B., Sitti, M.

Applied Physics Letters, 91(22):221913, AIP, 2007 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


Thumb xl ijcvflow2
On the spatial statistics of optical flow

Roth, S., Black, M. J.

International Journal of Computer Vision, 74(1):33-50, 2007 (article)

Abstract
We present an analysis of the spatial and temporal statistics of "natural" optical flow fields and a novel flow algorithm that exploits their spatial statistics. Training flow fields are constructed using range images of natural scenes and 3D camera motions recovered from hand-held and car-mounted video sequences. A detailed analysis of optical flow statistics in natural scenes is presented and machine learning methods are developed to learn a Markov random field model of optical flow. The prior probability of a flow field is formulated as a Field-of-Experts model that captures the spatial statistics in overlapping patches and is trained using contrastive divergence. This new optical flow prior is compared with previous robust priors and is incorporated into a recent, accurate algorithm for dense optical flow computation. Experiments with natural and synthetic sequences illustrate how the learned optical flow prior quantitatively improves flow accuracy and how it captures the rich spatial structure found in natural scene motion.

ps

pdf preprint pdf from publisher [BibTex]

pdf preprint pdf from publisher [BibTex]


no image
Microscale and nanoscale robotics systems [grand challenges of robotics]

Sitti, M.

IEEE Robotics \& Automation Magazine, 14(1):53-60, IEEE, 2007 (article)

pi

[BibTex]

[BibTex]


no image
A new biomimetic adhesive for therapeutic capsule endoscope applications in the gastrointestinal tract

Glass, P., Sitti, M., Appasamy, R.

Gastrointestinal Endoscopy, 65(5):AB91, Mosby, 2007 (article)

pi

[BibTex]

[BibTex]


no image
Visual servoing-based autonomous 2-D manipulation of microparticles using a nanoprobe

Onal, C. D., Sitti, M.

IEEE Transactions on control systems technology, 15(5):842-852, IEEE, 2007 (article)

pi

[BibTex]

[BibTex]


Thumb xl arrayhd
Assistive technology and robotic control using MI ensemble-based neural interface systems in humans with tetraplegia

Donoghue, J. P., Nurmikko, A., Black, M. J., Hochberg, L.

Journal of Physiology, Special Issue on Brain Computer Interfaces, 579, pages: 603-611, 2007 (article)

Abstract
This review describes the rationale, early stage development, and initial human application of neural interface systems (NISs) for humans with paralysis. NISs are emerging medical devices designed to allowpersonswith paralysis to operate assistive technologies or to reanimatemuscles based upon a command signal that is obtained directly fromthe brain. Such systems require the development of sensors to detect brain signals, decoders to transformneural activity signals into a useful command, and an interface for the user.We review initial pilot trial results of an NIS that is based on an intracortical microelectrode sensor that derives control signals from the motor cortex.We review recent findings showing, first, that neurons engaged by movement intentions persist in motor cortex years after injury or disease to the motor system, and second, that signals derived from motor cortex can be used by persons with paralysis to operate a range of devices. We suggest that, with further development, this form of NIS holds promise as a useful new neurotechnology for those with limited motor function or communication.We also discuss the additional potential for neural sensors to be used in the diagnosis and management of various neurological conditions and as a new way to learn about human brain function.

ps

pdf preprint pdf from publisher DOI [BibTex]

pdf preprint pdf from publisher DOI [BibTex]


Thumb xl implant
Probabilistically modeling and decoding neural population activity in motor cortex

Black, M. J., Donoghue, J. P.

In Toward Brain-Computer Interfacing, pages: 147-159, (Editors: Dornhege, G. and del R. Millan, J. and Hinterberger, T. and McFarland, D. and Muller, K.-R.), MIT Press, London, 2007 (incollection)

ps

pdf [BibTex]

pdf [BibTex]


no image
Bacteria integrated swimming microrobots

Behkam, B., Sitti, M.

In 50 years of artificial intelligence, pages: 154-163, Springer Berlin Heidelberg, 2007 (incollection)

pi

[BibTex]

[BibTex]


no image
Adhesion of biologically inspired vertical and angled polymer microfiber arrays

Aksak, B., Murphy, M. P., Sitti, M.

Langmuir, 23(6):3322-3332, ACS Publications, 2007 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Waalbot: An agile small-scale wall-climbing robot utilizing dry elastomer adhesives

Murphy, M. P., Sitti, M.

IEEE/ASME transactions on Mechatronics, 12(3):330-338, IEEE, 2007 (article)

pi

[BibTex]

[BibTex]


no image
Subfeature patterning of organic and inorganic materials using robotic assembly

Tafazzoli, A., Cheng, C., Pawashe, C., Sabo, E. K., Trofin, L., Sitti, M., LeDuc, P. R.

Journal of materials research, 22(06):1601-1608, Cambridge University Press, 2007 (article)

pi

[BibTex]

[BibTex]


no image
Effect of backing layer thickness on adhesion of single-level elastomer fiber arrays

Kim, S., Sitti, M., Hui, C., Long, R., Jagota, A.

Applied Physics Letters, 91(16):161905, AIP, 2007 (article)

pi

[BibTex]

[BibTex]


no image
Adhesion and anisotropic friction enhancements of angled heterogeneous micro-fiber arrays with spherical and spatula tips

Murphy, M. P., Aksak, B., Sitti, M.

Journal of Adhesion Science and Technology, 21(12-13):1281-1296, Taylor & Francis Group, 2007 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Surface-tension-driven biologically inspired water strider robots: Theory and experiments

Song, Y. S., Sitti, M.

IEEE Transactions on robotics, 23(3):578-589, IEEE, 2007 (article)

pi

[BibTex]

[BibTex]

2001


no image
Wing transmission for a micromechanical flying insect

Yan, J., Avadhanula, S., Birch, J., Dickinson, M., Sitti, M., Su, T., Fearing, R.

Journal of Micromechatronics, 1(3):221-237, Brill, 2001 (article)

pi

[BibTex]

2001


[BibTex]

2000


Thumb xl ijcv2000teaser
Probabilistic detection and tracking of motion boundaries

Black, M. J., Fleet, D. J.

Int. J. of Computer Vision, 38(3):231-245, July 2000 (article)

Abstract
We propose a Bayesian framework for representing and recognizing local image motion in terms of two basic models: translational motion and motion boundaries. Motion boundaries are represented using a non-linear generative model that explicitly encodes the orientation of the boundary, the velocities on either side, the motion of the occluding edge over time, and the appearance/disappearance of pixels at the boundary. We represent the posterior probability distribution over the model parameters given the image data using discrete samples. This distribution is propagated over time using a particle filtering algorithm. To efficiently represent such a high-dimensional space we initialize samples using the responses of a low-level motion discontinuity detector. The formulation and computational model provide a general probabilistic framework for motion estimation with multiple, non-linear, models.

ps

pdf pdf from publisher Video [BibTex]

2000


pdf pdf from publisher Video [BibTex]


no image
Two-dimensional fine particle positioning under an optical microscope using a piezoresistive cantilever as a manipulator

Sitti, M., Hashimoto, H.

journal of Micromechatronics, 1(1):25-48, Brill, 2000 (article)

pi

[BibTex]


no image
Investigation of Virtual Reality Interface for AFM-based Nano Manipulation

Horiguchi, S., Sitti, M., Hashimoto, H.

IEEJ Transactions on Electronics, Information and Systems, 120(12):1948-1956, The Institute of Electrical Engineers of Japan, 2000 (article)

pi

[BibTex]

[BibTex]


no image
Macro to Nano Tele-Manipulation Towards Nanoelectromec hanical Systems

Sitti, M., Hashimoto, H.

Journal of Robotics and Mechatronics, 12(3):209-217, FUJI TECHNOLOGY PRESS LTD., 2000 (article)

pi

[BibTex]

[BibTex]


Thumb xl bildschirmfoto 2012 12 06 um 09.22.34
Design and use of linear models for image motion analysis

Fleet, D. J., Black, M. J., Yacoob, Y., Jepson, A. D.

Int. J. of Computer Vision, 36(3):171-193, 2000 (article)

Abstract
Linear parameterized models of optical flow, particularly affine models, have become widespread in image motion analysis. The linear model coefficients are straightforward to estimate, and they provide reliable estimates of the optical flow of smooth surfaces. Here we explore the use of parameterized motion models that represent much more varied and complex motions. Our goals are threefold: to construct linear bases for complex motion phenomena; to estimate the coefficients of these linear models; and to recognize or classify image motions from the estimated coefficients. We consider two broad classes of motions: i) generic “motion features” such as motion discontinuities and moving bars; and ii) non-rigid, object-specific, motions such as the motion of human mouths. For motion features we construct a basis of steerable flow fields that approximate the motion features. For object-specific motions we construct basis flow fields from example motions using principal component analysis. In both cases, the model coefficients can be estimated directly from spatiotemporal image derivatives with a robust, multi-resolution scheme. Finally, we show how these model coefficients can be use to detect and recognize specific motions such as occlusion boundaries and facial expressions.

ps

pdf [BibTex]

pdf [BibTex]


no image
Controlled pushing of nanoparticles: modeling and experiments

Sitti, M., Hashimoto, H.

IEEE/ASME transactions on mechatronics, 5(2):199-211, IEEE, 2000 (article)

pi

[BibTex]

[BibTex]


Thumb xl bildschirmfoto 2012 12 06 um 09.48.16
Robustly estimating changes in image appearance

Black, M. J., Fleet, D. J., Yacoob, Y.

Computer Vision and Image Understanding, 78(1):8-31, 2000 (article)

Abstract
We propose a generalized model of image “appearance change” in which brightness variation over time is represented as a probabilistic mixture of different causes. We define four generative models of appearance change due to (1) object or camera motion; (2) illumination phenomena; (3) specular reflections; and (4) “iconic changes” which are specific to the objects being viewed. These iconic changes include complex occlusion events and changes in the material properties of the objects. We develop a robust statistical framework for recovering these appearance changes in image sequences. This approach generalizes previous work on optical flow to provide a richer description of image events and more reliable estimates of image motion in the presence of shadows and specular reflections.

ps

pdf pdf from publisher DOI [BibTex]

pdf pdf from publisher DOI [BibTex]