Header logo is


2016


Thumb xl nonlinear approximate vs exact
A New Perspective and Extension of the Gaussian Filter

Wüthrich, M., Trimpe, S., Garcia Cifuentes, C., Kappler, D., Schaal, S.

The International Journal of Robotics Research, 35(14):1731-1749, December 2016 (article)

Abstract
The Gaussian Filter (GF) is one of the most widely used filtering algorithms; instances are the Extended Kalman Filter, the Unscented Kalman Filter and the Divided Difference Filter. The GF represents the belief of the current state by a Gaussian distribution, whose mean is an affine function of the measurement. We show that this representation can be too restrictive to accurately capture the dependences in systems with nonlinear observation models, and we investigate how the GF can be generalized to alleviate this problem. To this end, we view the GF as the solution to a constrained optimization problem. From this new perspective, the GF is seen as a special case of a much broader class of filters, obtained by relaxing the constraint on the form of the approximate posterior. On this basis, we outline some conditions which potential generalizations have to satisfy in order to maintain the computational efficiency of the GF. We propose one concrete generalization which corresponds to the standard GF using a pseudo measurement instead of the actual measurement. Extending an existing GF implementation in this manner is trivial. Nevertheless, we show that this small change can have a major impact on the estimation accuracy.

am ics

PDF DOI Project Page [BibTex]

2016


PDF DOI Project Page [BibTex]


Thumb xl 1 00000
Bioengineered and biohybrid bacteria-based systems for drug delivery

Hosseinidoust, Z., Mostaghaci, B., Yasa, O., Park, B., Singh, A. V., Sitti, M.

Advanced Drug Delivery Reviews, 106, pages: 27-44, Elsevier, November 2016 (article)

Abstract
The use of bacterial cells as agents of medical therapy has a long history. Research that was ignited over a century ago with the accidental infection of cancer patients has matured into a platform technology that offers the promise of opening up new potential frontiers in medical treatment. Bacterial cells exhibit unique characteristics that make them well-suited as smart drug delivery agents. Our ability to genetically manipulate the molecular machinery of these cells enables the customization of their therapeutic action as well as its precise tuning and spatio-temporal control, allowing for the design of unique, complex therapeutic functions, unmatched by current drug delivery systems. Early results have been promising, but there are still many important challenges that must be addressed. We present a review of promises and challenges of employing bioengineered bacteria in drug delivery systems and introduce the biohybrid design concept as a new additional paradigm in bacteria-based drug delivery.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl psychscience
Creating body shapes from verbal descriptions by linking similarity spaces

Hill, M. Q., Streuber, S., Hahn, C. A., Black, M. J., O’Toole, A. J.

Psychological Science, 27(11):1486-1497, November 2016, (article)

Abstract
Brief verbal descriptions of bodies (e.g. curvy, long-legged) can elicit vivid mental images. The ease with which we create these mental images belies the complexity of three-dimensional body shapes. We explored the relationship between body shapes and body descriptions and show that a small number of words can be used to generate categorically accurate representations of three-dimensional bodies. The dimensions of body shape variation that emerged in a language-based similarity space were related to major dimensions of variation computed directly from three-dimensional laser scans of 2094 bodies. This allowed us to generate three-dimensional models of people in the shape space using only their coordinates on analogous dimensions in the language-based description space. Human descriptions of photographed bodies and their corresponding models matched closely. The natural mapping between the spaces illustrates the role of language as a concise code for body shape, capturing perceptually salient global and local body features.

ps

pdf [BibTex]

pdf [BibTex]


Thumb xl 07293677
A 5-D localization method for a magnetically manipulated untethered robot using a 2-D array of Hall-effect sensors

Son, D., Yim, S., Sitti, M.

IEEE/ASME Transactions on Mechatronics, 21(2):708-716, IEEE, October 2016 (article)

Abstract
This paper introduces a new five-dimensional localization method for an untethered meso-scale magnetic robot, which is manipulated by a computer-controlled electromagnetic system. The developed magnetic localization setup is a two-dimensional array of mono-axial Hall-effect sensors, which measure the perpendicular magnetic fields at their given positions. We introduce two steps for localizing a magnetic robot more accurately. First, the dipole modeled magnetic field of the electromagnet is subtracted from the measured data in order to determine the robot's magnetic field. Secondly, the subtracted magnetic field is twice differentiated in the perpendicular direction of the array, so that the effect of the electromagnetic field in the localization process is minimized. Five variables regarding the position and orientation of the robot are determined by minimizing the error between the measured magnetic field and the modeled magnetic field in an optimization method. The resulting position error is 2.1±0.8 mm and angular error is 6.7±4.3° within the applicable range (5 cm) of magnetic field sensors at 200 Hz. The proposed localization method would be used for the position feedback control of untethered magnetic devices or robots for medical applications in the future.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl nn 2016 05545f 0007
High-Performance Multiresponsive Paper Actuators

Amjadi, M., Sitti, M.

ACS Nano, 10(11):10202-10210, American Chemical Society, October 2016 (article)

Abstract
There is an increasing demand for soft actuators because of their importance in soft robotics, artificial muscles, biomimetic devices, and beyond. However, the development of soft actuators capable of low-voltage operation, powerful actuation, and programmable shape-changing is still challenging. In this work, we propose programmable bilayer actuators that operate based on the large hygroscopic contraction of the copy paper and simultaneously large thermal expansion of the polypropylene film upon increasing the temperature. The electrothermally activated bending actuators can function with low voltages (≤ 8 V), low input electric power per area (P ≤ 0.14 W cm–2), and low temperature changes (≤ 35 °C). They exhibit reversible shape-changing behavior with curvature radii up to 1.07 cm–1 and bending angle of 360°, accompanied by powerful actuation. Besides the electrical activation, they can be powered by humidity or light irradiation. We finally demonstrate the use of our paper actuators as a soft gripper robot and a lightweight paper wing for aerial robotics.

pi

DOI Project Page Project Page [BibTex]

DOI Project Page Project Page [BibTex]


Thumb xl publications toc
Programmable assembly of heterogeneous microparts by an untethered mobile capillary microgripper

Giltinan, J., Diller, E., Sitti, M.

Lab on a Chip, 16(22):4445-4457, Royal Society of Chemistry, October 2016 (article)

Abstract
At the sub-millimeter scale, capillary forces enable robust and reversible adhesion between biological organisms and varied substrates. Current human-engineered mobile untethered micromanipulation systems rely on forces which scale poorly or utilize gripper-part designs that promote manipulation. Capillary forces, alternatively, are dependent upon the surface chemistry (which is scale independent) and contact perimeter, which conforms to the part surface. We report a mobile capillary microgripper that is able to pick and place parts of various materials and geometries, and is thus ideal for microassembly tasks that cannot be accomplished by large tethered manipulators. We achieve the programmable assembly of sub-millimeter parts in an enclosed three-dimensional aqueous environment by creating a capillary bridge between the targeted part and a synthetic, untethered, mobile body. The parts include both hydrophilic and hydrophobic components: hydrogel, kapton, human hair, and biological tissue. The 200 μm untethered system can be controlled with five-degrees-of-freedom and advances progress towards autonomous desktop manufacturing for tissue engineering, complex micromachines, microfluidic devices, and meta-materials.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl 5fc6a94719a2ed61820a6fd031f53c39682a1f157b1c10c35d5d4c88d087d90e
Composition-dependent underwater adhesion of catechol-bearing hydrogels

Wu, H., Sariola, V., Zhao, J., Ding, H., Sitti, M., Bettinger, C. J.

Polymer International, 65(11):1355-1359, John Wiley & Sons, Ltd, September 2016 (article)

Abstract
Interfacial adhesion-mediated transfer printing processes can integrate functional electronic microstructures with polymeric substrates that are bendable and stretchable. Transfer printing has also been extended to catechol-bearing adhesive hydrogels. This study presents indentation adhesion tests between catechol-bearing hydrogel substrates with catechol concentrations varying from 0 to 10% (mol/mol) and thin-film materials commonly used in microelectronic fabrication including polymers, noble metals and oxides. The results indicate that the interfacial adhesion of catechol-bearing hydrogels is positively correlated with the concentration of catechol-bearing monomers as well as the retraction velocity during transfer printing. This study can inform transfer printing processes for microfabricated structures to compliant hydrated substrates such as hygroscopic monomers, mesoporous polymer networks and hydrogels. © 2016 Society of Chemical Industry

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl singh et al 2016 advanced healthcare materials
Bacteria-Driven Particles: Patterned and Specific Attachment of Bacteria on Biohybrid Bacteria-Driven Microswimmers (Adv. Healthcare Mater. 18/2016)

Singh, A. V., Sitti, M.

Advanced Healthcare Materials, 5(18):2306-2306, September 2016 (article)

Abstract
On page 2325, Ajay Vikram Singh and Metin Sitti propose a facile surface patterning technique and a specific, strong biotin–streptavidin bonding of bacteria on patterned surfaces to fabricate Janus particles that are propelled by the attached bacteria. Such bacteria-driven Janus microswimmers could be used for future medicine in targeted drug delivery and environmental remediation.

pi

DOI Project Page [BibTex]


Thumb xl publications toc
The effect of temperature and humidity on adhesion of a gecko-inspired adhesive: implications for the natural system

Stark, A. Y., Klittich, M. R., Sitti, M., Niewiarowski, P. H., Dhinojwala, A.

Scientific Reports, 6, pages: 30936, Nature Publishing Group, August 2016 (article)

Abstract
The adhesive system of geckos has inspired hundreds of synthetic adhesives. While this system has been used relentlessly as a source of inspiration, less work has been done in reverse, where synthetics are used to test questions and hypotheses about the natural system. Here we take such an approach. We tested shear adhesion of a mushroom-tipped synthetic gecko adhesive under conditions that produced perplexing results in the natural adhesive system. Synthetic samples were tested at two temperatures (12 °C and 32 °C) and four different humidity levels (30%, 55%, 70%, and 80% RH). Surprisingly, adhesive performance of the synthetic samples matched that of living geckos, suggesting that uncontrolled parameters in the natural system, such as surface chemistry and material changes, may not be as influential in whole-animal performance as previously thought. There was one difference, however, when comparing natural and synthetic adhesive performance. At 12 °C and 80% RH, adhesion of the synthetic structures was lower than expected based on the natural system’s performance. Our approach highlights a unique opportunity for both biologists and material scientists, where new questions and hypotheses can be fueled by joint comparisons of the natural and synthetic systems, ultimately improving knowledge of both.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl imagetoc
Magnetic propulsion of robotic sperms at low-Reynolds number

Khalil, I. S., Fatih Tabak, A., Klingner, A., Sitti, M.

Applied Physics Letters, 109(3):033701, AIP Publishing, July 2016 (article)

Abstract
We investigate the microswimming behaviour of robotic sperms in viscous fluids. These robotic sperms are fabricated from polystyrene dissolved in dimethyl formamide and iron-oxide nanoparticles. This composition allows the nanoparticles to be concentrated within the bead of the robotic sperm and provide magnetic dipole, whereas the flexibility of the ultra-thin tail enables flagellated locomotion using magnetic fields in millitesla range. We show that these robotic sperms have similar morphology and swimming behaviour to those of sperm cells. Moreover, we show experimentally that our robotic sperms swim controllably at an average speed of approximately one body length per second (around 125 μm s−1), and they are relatively faster than the microswimmers that depend on planar wave propulsion in low-Reynolds number fluids.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl webteaser
Body Talk: Crowdshaping Realistic 3D Avatars with Words

Streuber, S., Quiros-Ramirez, M. A., Hill, M. Q., Hahn, C. A., Zuffi, S., O’Toole, A., Black, M. J.

ACM Trans. Graph. (Proc. SIGGRAPH), 35(4):54:1-54:14, July 2016 (article)

Abstract
Realistic, metrically accurate, 3D human avatars are useful for games, shopping, virtual reality, and health applications. Such avatars are not in wide use because solutions for creating them from high-end scanners, low-cost range cameras, and tailoring measurements all have limitations. Here we propose a simple solution and show that it is surprisingly accurate. We use crowdsourcing to generate attribute ratings of 3D body shapes corresponding to standard linguistic descriptions of 3D shape. We then learn a linear function relating these ratings to 3D human shape parameters. Given an image of a new body, we again turn to the crowd for ratings of the body shape. The collection of linguistic ratings of a photograph provides remarkably strong constraints on the metric 3D shape. We call the process crowdshaping and show that our Body Talk system produces shapes that are perceptually indistinguishable from bodies created from high-resolution scans and that the metric accuracy is sufficient for many tasks. This makes body “scanning” practical without a scanner, opening up new applications including database search, visualization, and extracting avatars from books.

ps

pdf web tool video talk (ppt) [BibTex]

pdf web tool video talk (ppt) [BibTex]


Thumb xl 0278364915583539
Six-degree-of-freedom magnetic actuation for wireless microrobotics

Diller, E., Giltinan, J., Lum, G. Z., Ye, Z., Sitti, M.

The International Journal of Robotics Research, 35(1-3):114-128, SAGE Publications Sage UK: London, England, June 2016 (article)

Abstract
Existing remotely actuated magnetic microrobots exhibit a maximum of only five-degree-of-freedom (DOF) actuation, as creation of a driving torque about the microrobot magnetization axis is not achievable. This lack of full orientation control limits the effectiveness of existing microrobots for precision tasks of object manipulation and orientation for advanced medical, biological and micromanufacturing applications. This paper presents a magnetic actuation method that allows remotely powered microrobots to achieve full six-DOF actuation by considering the case of a non-uniform magnetization profile within the microrobot body. This non-uniform magnetization allows for additional rigid-body torques to be induced from magnetic forces via a moment arm. A general analytical model presents the working principle for continuous and discrete magnetization profiles, which is applied to permanent or non-permanent (soft) magnet bodies. Several discrete-magnetization designs are also presented which possess reduced coupling between magnetic forces and induced rigid-body torques. Design guidelines are introduced which can be followed to ensure that a magnetic microrobot design is capable of six-DOF actuation. A simple permanent-magnet prototype is fabricated and used to quantitatively demonstrate the accuracy of the analytical model in a constrained-DOF environment and qualitatively for free motion in a viscous liquid three-dimensional environment. Results show that desired forces and torques can be created with high precision and limited parasitic actuation, allowing for full six-DOF actuation using limited feedback control

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl ijcv tumb
Capturing Hands in Action using Discriminative Salient Points and Physics Simulation

Tzionas, D., Ballan, L., Srikantha, A., Aponte, P., Pollefeys, M., Gall, J.

International Journal of Computer Vision (IJCV), 118(2):172-193, June 2016 (article)

Abstract
Hand motion capture is a popular research field, recently gaining more attention due to the ubiquity of RGB-D sensors. However, even most recent approaches focus on the case of a single isolated hand. In this work, we focus on hands that interact with other hands or objects and present a framework that successfully captures motion in such interaction scenarios for both rigid and articulated objects. Our framework combines a generative model with discriminatively trained salient points to achieve a low tracking error and with collision detection and physics simulation to achieve physically plausible estimates even in case of occlusions and missing visual data. Since all components are unified in a single objective function which is almost everywhere differentiable, it can be optimized with standard optimization techniques. Our approach works for monocular RGB-D sequences as well as setups with multiple synchronized RGB cameras. For a qualitative and quantitative evaluation, we captured 29 sequences with a large variety of interactions and up to 150 degrees of freedom.

ps

Website pdf link (url) DOI Project Page [BibTex]

Website pdf link (url) DOI Project Page [BibTex]


Thumb xl ye et al 2016 advanced materials
Gallium Adhesion: Phase Change of Gallium Enables Highly Reversible and Switchable Adhesion (Adv. Mater. 25/2016)

Ye, Z., Lum, G. Z., Song, S., Rich, S., Sitti, M.

Advanced Materials, 28(25):5087-5087, May 2016 (article)

Abstract
Gallium exhibits highly reversible and switchable adhesion when it undergoes a solid–liquid phase transition. The robustness of gallium is notable as it exhibits strong performance on a wide range of smooth and rough surfaces, under both dry and wet conditions. Gallium may therefore find numerous applications in transfer printing, robotics, electronic packaging, and biomedicine.

pi

DOI [BibTex]


Thumb xl singh et al 2016 advanced healthcare materials
Patterned and Specific Attachment of Bacteria on Biohybrid Bacteria-Driven Microswimmers

Singh, A. V., Sitti, M.

Advanced Healthcare Materials, 5(18):2325-2331, May 2016 (article)

Abstract
A surface patterning technique and a specific and strong biotin–streptavidin bonding of bacteria on patterned surfaces are proposed to fabricate Janus particles that are propelled by the attached bacteria. Bacteria-driven Janus microswimmers with diameters larger than 3 μm show enhanced mean propulsion speed. Such microswimmers could be used for future applications such as targeted drug delivery and environmental remediation.

pi

DOI [BibTex]


Thumb xl pnas 2016 lum 1608193113 2
Shape-programmable magnetic soft matter

Lum, G. Z., Ye, Z., Dong, X., Marvi, H., Erin, O., Hu, W., Sitti, M.

Proceedings of the National Academy of Sciences, 113(41):E6007–E6015, National Acad Sciences, May 2016 (article)

Abstract
Shape-programmable matter is a class of active materials whose geometry can be controlled to potentially achieve mechanical functionalities beyond those of traditional machines. Among these materials, magnetically actuated matter is particularly promising for achieving complex time-varying shapes at small scale (overall dimensions smaller than 1 cm). However, previous work can only program these materials for limited applications, as they rely solely on human intuition to approximate the required magnetization profile and actuating magnetic fields for their materials. Here, we propose a universal programming methodology that can automatically generate the required magnetization profile and actuating fields for soft matter to achieve new time-varying shapes. The universality of the proposed method can therefore inspire a vast number of miniature soft devices that are critical in robotics, smart engineering surfaces and materials, and biomedical devices. Our proposed method includes theoretical formulations, computational strategies, and fabrication procedures for programming magnetic soft matter. The presented theory and computational method are universal for programming 2D or 3D time-varying shapes, whereas the fabrication technique is generic only for creating planar beams. Based on the proposed programming method, we created a jellyfish-like robot, a spermatozoid-like undulating swimmer, and an artificial cilium that could mimic the complex beating patterns of its biological counterpart.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl inflateble robots
Inflated soft actuators with reversible stable deformations

Hines, L., Petersen, K., Sitti, M.

Advanced Materials, 28(19):3690-3696, March 2016 (article)

Abstract
Most soft robotic systems are currently dependent on bulky compressors or pumps. A soft actuation method is presented combining hyperelastic membranes and dielectric elastomer actuators to switch between stable deformations of sealed chambers. This method is capable of large repeatable deformations, and has a number of stable states proportional to the number of actuatable membranes in the chamber.

pi

DOI Project Page [BibTex]


Thumb xl publications toc
Chemotaxis of bio-hybrid multiple bacteria-driven microswimmers

Zhuang, J., Sitti, M.

Scientific reports, 6, pages: 32135, Nature Publishing Group, March 2016 (article)

Abstract
In this study, in a bio-hybrid microswimmer system driven by multiple Serratia marcescens bacteria, we quantify the chemotactic drift of a large number of microswimmers towards L-serine and elucidate the associated collective chemotaxis behavior by statistical analysis of over a thousand swimming trajectories of the microswimmers. The results show that the microswimmers have a strong heading preference for moving up the L-serine gradient, while their speed does not change considerably when moving up and down the gradient; therefore, the heading bias constitutes the major factor that produces the chemotactic drift. The heading direction of a microswimmer is found to be significantly more persistent when it moves up the L-serine gradient than when it travels down the gradient; this effect causes the apparent heading preference of the microswimmers and is the crucial reason that enables the seemingly cooperative chemotaxis of multiple bacteria on a microswimmer. In addition, we find that their chemotactic drift velocity increases superquadratically with their mean swimming speed, suggesting that chemotaxis of bio-hybrid microsystems can be enhanced by designing and building faster microswimmers. Such bio-hybrid microswimmers with chemotactic steering capability may find future applications in targeted drug delivery, bioengineering, and lab-on-a-chip devices.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl publications toc
Targeted drug delivery and imaging using mobile milli/microrobots: A promising future towards theranostic pharmaceutical design

Vikram Singh, A., Sitti, M.

Current Pharmaceutical Design, 22(11):1418-1428, Bentham Science Publishers, March 2016 (article)

Abstract
Miniature untethered medical robots have been receiving growing attention due to technological advances in microactuation, microsensors, and microfabrication and have significant potential to reduce the invasiveness and improve the accessibility of medical devices into unprecedented small spaces inside the human body. In this review, we discuss therapeutic and diagnostic applications of untethered medical microrobots. Wirelessly controlled milli/microrobots with integrated sensors are revolutionizing micromanipulation based medical interventions and are enabling doctors to perform minimally invasive procedures not possible before. 3D fabrication technologies enabling milli/microrobot fabrication at the single cell scale are empowering high-resolution visual imaging and in vivo manipulation capabilities. Swallowable millirobots and injectabale ocular microrobots allow the gastric ulcer imaging, and performance of vitreoretinal microsurgery at previously inaccessible ocular sites. Many invasive excision and incision based diagnostic biopsy, prostrate, and nephrolgical procedures can be performed minimally or almost noninvasively due to recent advancements in microrobotic technology. Advances in biohybrid microrobot systems are pushing microrobotic systems even smaller, using biological cells as on-board microactuators and microsensors using the chemical energy. Such microrobotic systems could be used for local targeted delivery of imaging contrast agents, drugs, genes, and mRNA, minimally invasive surgery, and cell micromanipulation in the near future.

pi

link (url) [BibTex]


Thumb xl publications toc
Parallel microcracks-based ultrasensitive and highly stretchable strain sensors

Amjadi, M., Turan, M., Clementson, C. P., Sitti, M.

ACS Applied Materials \& Interfaces, 8(8):5618-5626, American Chemical Society, Febuary 2016 (article)

Abstract
There is an increasing demand for flexible, skin-attachable, and wearable strain sensors due to their various potential applications. However, achieving strain sensors with both high sensitivity and high stretchability is still a grand challenge. Here, we propose highly sensitive and stretchable strain sensors based on the reversible microcrack formation in composite thin films. Controllable parallel microcracks are generated in graphite thin films coated on elastomer films. Sensors made of graphite thin films with short microcracks possess high gauge factors (maximum value of 522.6) and stretchability (ε ≥ 50%), whereas sensors with long microcracks show ultrahigh sensitivity (maximum value of 11 344) with limited stretchability (ε ≤ 50%). We demonstrate the high performance strain sensing of our sensors in both small and large strain sensing applications such as human physiological activity recognition, human body large motion capturing, vibration detection, pressure sensing, and soft robotics.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl amjadi et al 2016 advanced functional materials
Stretchable, Skin-Mountable, and Wearable Strain Sensors and Their Potential Applications: A Review

Amjadi, M., Kyung, K., Park, I., Sitti, M.

Advanced Functional Materials, 26, pages: 1678-1698, Febuary 2016 (article)

Abstract
There is a growing demand for flexible and soft electronic devices. In particular, stretchable, skin-mountable, and wearable strain sensors are needed for several potential applications including personalized health-monitoring, human motion detection, human-machine interfaces, soft robotics, and so forth. This Feature Article presents recent advancements in the development of flexible and stretchable strain sensors. The article shows that highly stretchable strain sensors are successfully being developed by new mechanisms such as disconnection between overlapped nanomaterials, crack propagation in thin films, and tunneling effect, different from traditional strain sensing mechanisms. Strain sensing performances of recently reported strain sensors are comprehensively studied and discussed, showing that appropriate choice of composite structures as well as suitable interaction between functional nanomaterials and polymers are essential for the high performance strain sensing. Next, simulation results of piezoresistivity of stretchable strain sensors by computational models are reported. Finally, potential applications of flexible strain sensors are described. This survey reveals that flexible, skin-mountable, and wearable strain sensors have potential in diverse applications while several grand challenges have to be still overcome.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl b 07384529
Size optimization of a magnetic system for drug delivery with capsule robots

Munoz, F., Alici, G., Li, W., Sitti, M.

IEEE Transactions on Magnetics, 52(5):1-11, IEEE, January 2016 (article)

Abstract
In this paper, we present a methodology for the size optimization of an external magnetic system made of arc-shaped permanent magnets (ASMs). This magnetic system is able to remotely actuate a drug-release module embedded in a prototype of a capsule robot. The optimization of the magnetic system is carried out by using an accurate analytical model that is valid for any arbitrary dimensions of the ASMs. By using this analytical model, we perform parametric studies and conduct a statistical analysis [analysis of variance (ANOVA)] to investigate efficient ways to distribute the volume of the ASMs so that the dimensions and volume of the magnetic system are minimized while optimal flux densities and magnetic torques are obtained to actuate the drug delivery system (DDS). The ANOVA results, at 5% significance level, indicate that changes in the angular width followed by changes in the length of the ASMs have the highest impact on the magnetic linkage. Furthermore, our experimental results, which are in agreement with the analytical results, show that the size optimization of the magnetic system is effective for the actuation of the DDS in capsule robots.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl teaser web
Human Pose Estimation from Video and IMUs

Marcard, T. V., Pons-Moll, G., Rosenhahn, B.

Transactions on Pattern Analysis and Machine Intelligence PAMI, 38(8):1533-1547, January 2016 (article)

ps

data pdf dataset_documentation [BibTex]

data pdf dataset_documentation [BibTex]


Thumb xl siyong
Shape estimation of subcutaneous adipose tissue using an articulated statistical shape model

Yeo, S. Y., Romero, J., Loper, M., Machann, J., Black, M.

Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 0(0):1-8, 2016 (article)

ps

publisher website preprint pdf link (url) DOI Project Page [BibTex]

publisher website preprint pdf link (url) DOI Project Page [BibTex]


no image
Event-based Sampling for Reducing Communication Load in Realtime Human Motion Analysis by Wireless Inertial Sensor Networks

Laidig, D., Trimpe, S., Seel, T.

Current Directions in Biomedical Engineering, 2(1):711-714, De Gruyter, 2016 (article)

am ics

PDF DOI [BibTex]

PDF DOI [BibTex]


Thumb xl screen shot 2016 02 22 at 11.46.41
The GRASP Taxonomy of Human Grasp Types

Feix, T., Romero, J., Schmiedmayer, H., Dollar, A., Kragic, D.

Human-Machine Systems, IEEE Transactions on, 46(1):66-77, 2016 (article)

ps

publisher website pdf DOI Project Page [BibTex]

publisher website pdf DOI Project Page [BibTex]


Thumb xl pami
Map-Based Probabilistic Visual Self-Localization

Brubaker, M. A., Geiger, A., Urtasun, R.

IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), 2016 (article)

Abstract
Accurate and efficient self-localization is a critical problem for autonomous systems. This paper describes an affordable solution to vehicle self-localization which uses odometry computed from two video cameras and road maps as the sole inputs. The core of the method is a probabilistic model for which an efficient approximate inference algorithm is derived. The inference algorithm is able to utilize distributed computation in order to meet the real-time requirements of autonomous systems in some instances. Because of the probabilistic nature of the model the method is capable of coping with various sources of uncertainty including noise in the visual odometry and inherent ambiguities in the map (e.g., in a Manhattan world). By exploiting freely available, community developed maps and visual odometry measurements, the proposed method is able to localize a vehicle to 4m on average after 52 seconds of driving on maps which contain more than 2,150km of drivable roads.

avg ps

pdf Project Page [BibTex]

pdf Project Page [BibTex]


no image
Momentum Control with Hierarchical Inverse Dynamics on a Torque-Controlled Humanoid

Herzog, A., Rotella, N., Mason, S., Grimminger, F., Schaal, S., Righetti, L.

Autonomous Robots, 40(3):473-491, 2016 (article)

Abstract
Hierarchical inverse dynamics based on cascades of quadratic programs have been proposed for the control of legged robots. They have important benefits but to the best of our knowledge have never been implemented on a torque controlled humanoid where model inaccuracies, sensor noise and real-time computation requirements can be problematic. Using a reformulation of existing algorithms, we propose a simplification of the problem that allows to achieve real-time control. Momentum-based control is integrated in the task hierarchy and a LQR design approach is used to compute the desired associated closed-loop behavior and improve performance. Extensive experiments on various balancing and tracking tasks show very robust performance in the face of unknown disturbances, even when the humanoid is standing on one foot. Our results demonstrate that hierarchical inverse dynamics together with momentum control can be efficiently used for feedback control under real robot conditions.

am mg

link (url) DOI [BibTex]

2015


Thumb xl grassmanteaser
Scalable Robust Principal Component Analysis using Grassmann Averages

Hauberg, S., Feragen, A., Enficiaud, R., Black, M.

IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI), December 2015 (article)

Abstract
In large datasets, manual data verification is impossible, and we must expect the number of outliers to increase with data size. While principal component analysis (PCA) can reduce data size, and scalable solutions exist, it is well-known that outliers can arbitrarily corrupt the results. Unfortunately, state-of-the-art approaches for robust PCA are not scalable. We note that in a zero-mean dataset, each observation spans a one-dimensional subspace, giving a point on the Grassmann manifold. We show that the average subspace corresponds to the leading principal component for Gaussian data. We provide a simple algorithm for computing this Grassmann Average (GA), and show that the subspace estimate is less sensitive to outliers than PCA for general distributions. Because averages can be efficiently computed, we immediately gain scalability. We exploit robust averaging to formulate the Robust Grassmann Average (RGA) as a form of robust PCA. The resulting Trimmed Grassmann Average (TGA) is appropriate for computer vision because it is robust to pixel outliers. The algorithm has linear computational complexity and minimal memory requirements. We demonstrate TGA for background modeling, video restoration, and shadow removal. We show scalability by performing robust PCA on the entire Star Wars IV movie; a task beyond any current method. Source code is available online.

ps sf

preprint pdf from publisher supplemental Project Page [BibTex]

2015


preprint pdf from publisher supplemental Project Page [BibTex]


Thumb xl splitbodieswebteaser2
SMPL: A Skinned Multi-Person Linear Model

Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., Black, M. J.

ACM Trans. Graphics (Proc. SIGGRAPH Asia), 34(6):248:1-248:16, ACM, New York, NY, October 2015 (article)

Abstract
We present a learned model of human body shape and pose-dependent shape variation that is more accurate than previous models and is compatible with existing graphics pipelines. Our Skinned Multi-Person Linear model (SMPL) is a skinned vertex-based model that accurately represents a wide variety of body shapes in natural human poses. The parameters of the model are learned from data including the rest pose template, blend weights, pose-dependent blend shapes, identity-dependent blend shapes, and a regressor from vertices to joint locations. Unlike previous models, the pose-dependent blend shapes are a linear function of the elements of the pose rotation matrices. This simple formulation enables training the entire model from a relatively large number of aligned 3D meshes of different people in different poses. We quantitatively evaluate variants of SMPL using linear or dual-quaternion blend skinning and show that both are more accurate than a Blend-SCAPE model trained on the same data. We also extend SMPL to realistically model dynamic soft-tissue deformations. Because it is based on blend skinning, SMPL is compatible with existing rendering engines and we make it available for research purposes.

ps

pdf video code/model errata DOI Project Page Project Page [BibTex]

pdf video code/model errata DOI Project Page Project Page [BibTex]


Thumb xl publications toc
Experimental investigation of optimal adhesion of mushroomlike elastomer microfibrillar adhesives

Marvi, H., Song, S., Sitti, M.

Langmuir, 31(37):10119-10124, American Chemical Society, August 2015 (article)

Abstract
Optimal fiber designs for the maximal pull-off force have been indispensable for increasing the attachment performance of recently introduced gecko-inspired reversible micro/nanofibrillar adhesives. There are several theoretical studies on such optimal designs; however, due to the lack of three-dimensional (3D) fabrication techniques that can fabricate such optimal designs in 3D, there have not been many experimental investigations on this challenge. In this study, we benefitted from recent advances in two-photon lithography techniques to fabricate mushroomlike polyurethane elastomer fibers with different aspect ratios of tip to stalk diameter (β) and tip wedge angles (θ) to investigate the effect of these two parameters on the pull-off force. We found similar trends to those predicted theoretically. We found that β has an impact on the slope of the force-displacement curve while both β and θ play a role in the stress distribution and crack propagation. We found that these effects are coupled and the optimal set of parameters also depends on the fiber material. This is the first experimental verification of such optimal designs proposed for mushroomlike microfibers. This experimental approach could be used to evaluate a wide range of complex microstructured adhesive designs suggested in the literature and optimize them.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl dynateaser
Dyna: A Model of Dynamic Human Shape in Motion

Pons-Moll, G., Romero, J., Mahmood, N., Black, M. J.

ACM Transactions on Graphics, (Proc. SIGGRAPH), 34(4):120:1-120:14, ACM, August 2015 (article)

Abstract
To look human, digital full-body avatars need to have soft tissue deformations like those of real people. We learn a model of soft-tissue deformations from examples using a high-resolution 4D capture system and a method that accurately registers a template mesh to sequences of 3D scans. Using over 40,000 scans of ten subjects, we learn how soft tissue motion causes mesh triangles to deform relative to a base 3D body model. Our Dyna model uses a low-dimensional linear subspace to approximate soft-tissue deformation and relates the subspace coefficients to the changing pose of the body. Dyna uses a second-order auto-regressive model that predicts soft-tissue deformations based on previous deformations, the velocity and acceleration of the body, and the angular velocities and accelerations of the limbs. Dyna also models how deformations vary with a person’s body mass index (BMI), producing different deformations for people with different shapes. Dyna realistically represents the dynamics of soft tissue for previously unseen subjects and motions. We provide tools for animators to modify the deformations and apply them to new stylized characters.

ps

pdf preprint video data DOI Project Page Project Page [BibTex]

pdf preprint video data DOI Project Page Project Page [BibTex]


Thumb xl objs2acts
Linking Objects to Actions: Encoding of Target Object and Grasping Strategy in Primate Ventral Premotor Cortex

Vargas-Irwin, C. E., Franquemont, L., Black, M. J., Donoghue, J. P.

Journal of Neuroscience, 35(30):10888-10897, July 2015 (article)

Abstract
Neural activity in ventral premotor cortex (PMv) has been associated with the process of matching perceived objects with the motor commands needed to grasp them. It remains unclear how PMv networks can flexibly link percepts of objects affording multiple grasp options into a final desired hand action. Here, we use a relational encoding approach to track the functional state of PMv neuronal ensembles in macaque monkeys through the process of passive viewing, grip planning, and grasping movement execution. We used objects affording multiple possible grip strategies. The task included separate instructed delay periods for object presentation and grip instruction. This approach allowed us to distinguish responses elicited by the visual presentation of the objects from those associated with selecting a given motor plan for grasping. We show that PMv continuously incorporates information related to object shape and grip strategy as it becomes available, revealing a transition from a set of ensemble states initially most closely related to objects, to a new set of ensemble patterns reflecting unique object-grip combinations. These results suggest that PMv dynamically combines percepts, gradually navigating toward activity patterns associated with specific volitional actions, rather than directly mapping perceptual object properties onto categorical grip representations. Our results support the idea that PMv is part of a network that dynamically computes motor plans from perceptual information. Significance Statement: The present work demonstrates that the activity of groups of neurons in primate ventral premotor cortex reflects information related to visually presented objects, as well as the motor strategy used to grasp them, linking individual objects to multiple possible grips. PMv could provide useful control signals for neuroprosthetic assistive devices designed to interact with objects in a flexible way.

ps

publisher link DOI Project Page [BibTex]

publisher link DOI Project Page [BibTex]


Thumb xl publications toc
pH-taxis of biohybrid microsystems

Zhuang, J., Carlsen, R. W., Sitti, M.

Scientific reports, 5, Nature Publishing Group, June 2015 (article)

Abstract
The last decade has seen an increasing number of studies developing bacteria and other cell-integrated biohybrid microsystems. However, the highly stochastic motion of these microsystems severely limits their potential use. Here, we present a method that exploits the pH sensing of flagellated bacteria to realize robust drift control of multi-bacteria propelled microrobots. Under three specifically configured pH gradients, we demonstrate that the microrobots exhibit both unidirectional and bidirectional pH-tactic behaviors, which are also observed in free-swimming bacteria. From trajectory analysis, we find that the swimming direction and speed biases are two major factors that contribute to their tactic drift motion. The motion analysis of microrobots also sheds light on the propulsion dynamics of the flagellated bacteria as bioactuators. It is expected that similar driving mechanisms are shared among pH-taxis, chemotaxis, and thermotaxis. By identifying the mechanism that drives the tactic behavior of bacteria-propelled microsystems, this study opens up an avenue towards improving the control of biohybrid microsystems. Furthermore, assuming that it is possible to tune the preferred pH of bioactuators by genetic engineering, these biohybrid microsystems could potentially be applied to sense the pH gradient induced by cancerous cells in stagnant fluids inside human body and realize targeted drug delivery.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl 1 s2.0 s0141635915000938 main
Structural optimization for flexure-based parallel mechanisms–Towards achieving optimal dynamic and stiffness properties

Lum, G. Z., Teo, T. J., Yeo, S. H., Yang, G., Sitti, M.

Precision Engineering, 42, pages: 195-207, Elsevier, May 2015 (article)

Abstract
Flexure-based parallel mechanisms (FPMs) are a type of compliant mechanisms that consist of a rigid end-effector that is articulated by several parallel, flexible limbs (a.k.a. sub-chains). Existing design methods can enhance the FPMs’ dynamic and stiffness properties by conducting a size optimization on their sub-chains. A similar optimization process, however, was not performed for their sub-chains’ topology, and this may severely limit the benefits of a size optimization. Thus, this paper proposes to use a structural optimization approach to synthesize and optimize the topology, shape and size of the FPMs’ sub-chains. The benefits of this approach are demonstrated via the design and development of a planar X − Y − θz FPM. A prototype of this FPM was evaluated experimentally to have a large workspace of 1.2 mm × 1.2 mm × 6°, a fundamental natural frequency of 102 Hz, and stiffness ratios that are greater than 120. The achieved properties show significant improvement over existing 3-degrees-of-freedom compliant mechanisms that can deflect more than 0.5 mm and 0.5°. These compliant mechanisms typically have stiffness ratios that are less than 60 and a fundamental natural frequency that is less than 45 Hz.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl 1 s2.0 s0142961215003683 main
Controlled surface topography regulates collective 3D migration by epithelial–mesenchymal composite embryonic tissues

Song, J., Shawky, J. H., Kim, Y., Hazar, M., LeDuc, P. R., Sitti, M., Davidson, L. A.

Biomaterials, 58, pages: 1-9, Elsevier, April 2015 (article)

Abstract
Cells in tissues encounter a range of physical cues as they migrate. Probing single cell and collective migratory responses to physically defined three-dimensional (3D) microenvironments and the factors that modulate those responses are critical to understanding how tissue migration is regulated during development, regeneration, and cancer. One key physical factor that regulates cell migration is topography. Most studies on surface topography and cell mechanics have been carried out with single migratory cells, yet little is known about the spreading and motility response of 3D complex multi-cellular tissues to topographical cues. Here, we examine the response to complex topographical cues of microsurgically isolated tissue explants composed of epithelial and mesenchymal cell layers from naturally 3D organized embryos of the aquatic frog Xenopus laevis. We control topography using fabricated micropost arrays (MPAs) and investigate the collective 3D migration of these multi-cellular systems in these MPAs. We find that the topography regulates both collective and individual cell migration and that dense MPAs reduce but do not eliminate tissue spreading. By modulating cell size through the cell cycle inhibitor Mitomycin C or the spacing of the MPAs we uncover how 3D topographical cues disrupt collective cell migration. We find surface topography can direct both single cell motility and tissue spreading, altering tissue-scale processes that enable efficient conversion of single cell motility into collective movement.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl publications toc
Transfer Printing of Metallic Microstructures on Adhesion-Promoting Hydrogel Substrates

Wu, H., Sariola, V., Zhu, C., Zhao, J., Sitti, M., Bettinger, C. J.

Advanced Materials, 27(22):3398-3404, April 2015 (article)

Abstract
Fabrication schemes that integrate inorganic microstructures with hydrogel substrates are essential for advancing flexible electronics. A transfer printing process that is made possible through the design and synthesis of adhesion-promoting hydrogels as target substrates is reported. This fabrication technique may advance ultracompliant electronics by melding microfabricated structures with swollen hydrogel substrates.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl publications toc
Biomedical applications of untethered mobile milli/microrobots

Sitti, M., Ceylan, H., Hu, W., Giltinan, J., Turan, M., Yim, S., Diller, E.

Proceedings of the IEEE, 103(2):205-224, IEEE, March 2015 (article)

Abstract
Untethered robots miniaturized to the length scale of millimeter and below attract growing attention for the prospect of transforming many aspects of health care and bioengineering. As the robot size goes down to the order of a single cell, previously inaccessible body sites would become available for high-resolution in situ and in vivo manipulations. This unprecedented direct access would enable an extensive range of minimally invasive medical operations. Here, we provide a comprehensive review of the current advances in biomedical untethered mobile milli/microrobots. We put a special emphasis on the potential impacts of biomedical microrobots in the near future. Finally, we discuss the existing challenges and emerging concepts associated with designing such a miniaturized robot for operation inside a biological environment for biomedical applications.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl screen shot 2015 10 14 at 08.57.57
Multi-view and 3D Deformable Part Models

Pepik, B., Stark, M., Gehler, P., Schiele, B.

Pattern Analysis and Machine Intelligence, 37(11):14, IEEE, March 2015 (article)

Abstract
As objects are inherently 3-dimensional, they have been modeled in 3D in the early days of computer vision. Due to the ambiguities arising from mapping 2D features to 3D models, 3D object representations have been neglected and 2D feature-based models are the predominant paradigm in object detection nowadays. While such models have achieved outstanding bounding box detection performance, they come with limited expressiveness, as they are clearly limited in their capability of reasoning about 3D shape or viewpoints. In this work, we bring the worlds of 3D and 2D object representations closer, by building an object detector which leverages the expressive power of 3D object representations while at the same time can be robustly matched to image evidence. To that end, we gradually extend the successful deformable part model [1] to include viewpoint information and part-level 3D geometry information, resulting in several different models with different level of expressiveness. We end up with a 3D object model, consisting of multiple object parts represented in 3D and a continuous appearance model. We experimentally verify that our models, while providing richer object hypotheses than the 2D object models, provide consistently better joint object localization and viewpoint estimation than the state-of-the-art multi-view and 3D object detectors on various benchmarks (KITTI [2], 3D object classes [3], Pascal3D+ [4], Pascal VOC 2007 [5], EPFL multi-view cars [6]).

ps

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl publications toc
Collective 3D Migration of Embryonic Epithelial Mesenchymal Composite Tissues are Regulated by Surface Topology

Song, J., Shawky, J., Kim, Y. T., Hazar, M., Sitti, M., LeDuc, P. R., Davidson, L. A.

Biophysical Journal, 108(2):455a, Elsevier, January 2015 (article)

Abstract
Cells in tissues encounter a range of physical cues as they migrate. Probing single cell and collective migratory responses to physically defined three-dimensional (3D) microenvironments and the factors that modulate those responses are critical to understanding how tissue migration is regulated during development, regeneration, and cancer. One key physical factor that regulates cell migration is topology. Most studies on surface topology and cell mechanics have been carried out with single migratory cells, yet little is known about the spreading and motility response of 3D complex multicellular tissues to topological cues. Here, we examine the behaviors of microsurgically isolated tissue explants composed of epithelial and mesenchymal cell layers from naturally 3D organized embryos of the aquatic frog Xenopus laevis to complex topological cues. We control topology using fabricated micropost arrays (MPAs) with different diameters (e.g., different spacing gaps) and investigate the collective 3D migration of these multicellular systems in these MPAs. Our topographical controlled approach for cellular application enables us to achieve a high degree of control over micropost positioning and geometry via simple, accurate, and repeatable microfabrication processes. We find that the topology regulates both collective and individual cell migration and that dense MPAs reduce but do not eliminate tissue spreading. By modulating cell size through the cell cycle inhibitor Mitomycin C or the spacing within MPAs we discover a role for topology in disrupting collective enhancement of cell migration. We find 3D topological cues can direct both single cell motility and tissue spreading, altering tissue-scale processes that enable efficient conversion of single cell motility into collective movement.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl publications toc
Three-dimensional heterogeneous assembly of coded microgels using an untethered mobile microgripper

Chung, S. E., Dong, X., Sitti, M.

Lab on a Chip, 15(7):1667-1676, Royal Society of Chemistry, January 2015 (article)

Abstract
Three-dimensional (3D) heterogeneous assembly of coded microgels in enclosed aquatic environments is demonstrated using a remotely actuated and controlled magnetic microgripper by a customized electromagnetic coil system. The microgripper uses different ‘stick–slip’ and ‘rolling’ locomotion in 2D and also levitation in 3D by magnetic gradient-based pulling force. This enables the microrobot to precisely manipulate each microgel by controlling its position and orientation in all x–y–z directions. Our microrobotic assembly method broke the barrier of limitation on the number of assembled microgel layers, because it enabled precise 3D levitation of the microgripper. We used the gripper to assemble microgels that had been coded with different colours and shapes onto prefabricated polymeric microposts. This eliminates the need for extra secondary cross-linking to fix the final construct. We demonstrated assembly of microgels on a single micropost up to ten layers. By increasing the number and changing the distribution of the posts, complex heterogeneous microsystems were possible to construct in 3D.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl publications toc
Integrating mechanism synthesis and topological optimization technique for stiffness-oriented design of a three degrees-of-freedom flexure-based parallel mechanism

Lum, G. Z., Teo, T. J., Yang, G., Yeo, S. H., Sitti, M.

Precision Engineering, 39, pages: 125-133, Elsevier, January 2015 (article)

Abstract
This paper introduces a new design approach to synthesize multiple degrees-of-freedom (DOF) flexure-based parallel mechanism (FPM). Termed as an integrated design approach, it is a systematic design methodology, which integrates both classical mechanism synthesis and modern topology optimization technique, to deliver an optimized multi-DOF FPM. This design approach is separated into two levels. At sub-chain level, a novel topology optimization technique, which uses the classical linkage mechanisms as DNA seeds, is used to synthesize the compliant joints or limbs. At configuration level, the optimal compliant joints are used to form the parallel limbs of the multi-DOF FPM and another stage of optimization was conducted to determine the optimal space distribution between these compliant joints so as to generate a multi-DOF FPM with optimized stiffness characteristic. In this paper, the design of a 3-DOF planar motion FPM was used to demonstrate the effectiveness and accuracy of this proposed design approach.

pi

DOI [BibTex]


Thumb xl publications toc
Actively controlled fibrillar friction surfaces

Marvi, H, Han, Y, Sitti, M

Applied Physics Letters, 106(5):051602, AIP Publishing, January 2015 (article)

Abstract
In this letter, we propose a technique by which we can actively adjust frictional properties of elastic fibrillar structures in different directions. Using a mesh attached to a two degree-of-freedom linear stage, we controlled the active length and the tilt angle of fibers, independently. Thus, we were able to achieve desired levels of friction forces in different directions and significantly improve passive friction anisotropies observed in the same fiber arrays. The proposed technique would allow us to readily control the friction anisotropy and the friction magnitude of fibrillar structures in any planar direction.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl ssimssmall
Spike train SIMilarity Space (SSIMS): A framework for single neuron and ensemble data analysis

Vargas-Irwin, C. E., Brandman, D. M., Zimmermann, J. B., Donoghue, J. P., Black, M. J.

Neural Computation, 27(1):1-31, MIT Press, January 2015 (article)

Abstract
We present a method to evaluate the relative similarity of neural spiking patterns by combining spike train distance metrics with dimensionality reduction. Spike train distance metrics provide an estimate of similarity between activity patterns at multiple temporal resolutions. Vectors of pair-wise distances are used to represent the intrinsic relationships between multiple activity patterns at the level of single units or neuronal ensembles. Dimensionality reduction is then used to project the data into concise representations suitable for clustering analysis as well as exploratory visualization. Algorithm performance and robustness are evaluated using multielectrode ensemble activity data recorded in behaving primates. We demonstrate how Spike train SIMilarity Space (SSIMS) analysis captures the relationship between goal directions for an 8-directional reaching task and successfully segregates grasp types in a 3D grasping task in the absence of kinematic information. The algorithm enables exploration of virtually any type of neural spiking (time series) data, providing similarity-based clustering of neural activity states with minimal assumptions about potential information encoding models.

ps

pdf: publisher site pdf: author's proof DOI Project Page [BibTex]

pdf: publisher site pdf: author's proof DOI Project Page [BibTex]


Thumb xl thumb teaser mrg
Metric Regression Forests for Correspondence Estimation

Pons-Moll, G., Taylor, J., Shotton, J., Hertzmann, A., Fitzgibbon, A.

International Journal of Computer Vision, pages: 1-13, 2015 (article)

ps

springer PDF Project Page [BibTex]

springer PDF Project Page [BibTex]


Thumb xl screen shot 2017 06 14 at 3.05.52 pm
Exciting Engineered Passive Dynamics in a Bipedal Robot

Renjewski, D., Spröwitz, A., Peekema, A., Jones, M., Hurst, J.

{IEEE Transactions on Robotics and Automation}, 31(5):1244-1251, IEEE, New York, NY, 2015 (article)

Abstract
A common approach in designing legged robots is to build fully actuated machines and control the machine dynamics entirely in soft- ware, carefully avoiding impacts and expending a lot of energy. However, these machines are outperformed by their human and animal counterparts. Animals achieve their impressive agility, efficiency, and robustness through a close integration of passive dynamics, implemented through mechanical components, and neural control. Robots can benefit from this same integrated approach, but a strong theoretical framework is required to design the passive dynamics of a machine and exploit them for control. For this framework, we use a bipedal spring–mass model, which has been shown to approximate the dynamics of human locomotion. This paper reports the first implementation of spring–mass walking on a bipedal robot. We present the use of template dynamics as a control objective exploiting the engineered passive spring–mass dynamics of the ATRIAS robot. The results highlight the benefits of combining passive dynamics with dynamics-based control and open up a library of spring–mass model-based control strategies for dynamic gait control of robots.

dlg

link (url) DOI Project Page [BibTex]

link (url) DOI Project Page [BibTex]


no image
Kinematic and gait similarities between crawling human infants and other quadruped mammals

Righetti, L., Nylen, A., Rosander, K., Ijspeert, A.

Frontiers in Neurology, 6(17), February 2015 (article)

Abstract
Crawling on hands and knees is an early pattern of human infant locomotion, which offers an interesting way of studying quadrupedalism in one of its simplest form. We investigate how crawling human infants compare to other quadruped mammals, especially primates. We present quantitative data on both the gait and kinematics of seven 10-month-old crawling infants. Body movements were measured with an optoelectronic system giving precise data on 3-dimensional limb movements. Crawling on hands and knees is very similar to the locomotion of non-human primates in terms of the quite protracted arm at touch-down, the coordination between the spine movements in the lateral plane and the limbs, the relatively extended limbs during locomotion and the strong correlation between stance duration and speed of locomotion. However, there are important differences compared to primates, such as the choice of a lateral-sequence walking gait, which is similar to most non-primate mammals and the relatively stiff elbows during stance as opposed to the quite compliant gaits of primates. These finding raise the question of the role of both the mechanical structure of the body and neural control on the determination of these characteristics.

mg

link (url) DOI [BibTex]

link (url) DOI [BibTex]

2009


no image
Magnetic mobile micro-robots

Pawashe, C., Floyd, S., Sitti, M.

7eme Journees Nationales de la Recherche en Robotique, 2009 (article)

pi

[BibTex]

2009


[BibTex]


no image
Gecko-Inspired Directional and Controllable Adhesion

Murphy, M. P., Aksak, B., Sitti, M.

Small, 5(2):170-175, WILEY-VCH Verlag, 2009 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Multiple magnetic microrobot control using electrostatic anchoring

Pawashe, C., Floyd, S., Sitti, M.

Applied Physics Letters, 94(16):164108, AIP, 2009 (article)

pi

[BibTex]

[BibTex]