Header logo is


2013


Thumb xl multi modal
3-D Object Reconstruction of Symmetric Objects by Fusing Visual and Tactile Sensing

Illonen, J., Bohg, J., Kyrki, V.

The International Journal of Robotics Research, 33(2):321-341, Sage, October 2013 (article)

Abstract
In this work, we propose to reconstruct a complete 3-D model of an unknown object by fusion of visual and tactile information while the object is grasped. Assuming the object is symmetric, a first hypothesis of its complete 3-D shape is generated. A grasp is executed on the object with a robotic manipulator equipped with tactile sensors. Given the detected contacts between the fingers and the object, the initial full object model including the symmetry parameters can be refined. This refined model will then allow the planning of more complex manipulation tasks. The main contribution of this work is an optimal estimation approach for the fusion of visual and tactile data applying the constraint of object symmetry. The fusion is formulated as a state estimation problem and solved with an iterative extended Kalman filter. The approach is validated experimentally using both artificial and real data from two different robotic platforms.

am

Web DOI Project Page [BibTex]

2013


Web DOI Project Page [BibTex]


Thumb xl thumb hennigk2012 2
Quasi-Newton Methods: A New Direction

Hennig, P., Kiefel, M.

Journal of Machine Learning Research, 14(1):843-865, March 2013 (article)

Abstract
Four decades after their invention, quasi-Newton methods are still state of the art in unconstrained numerical optimization. Although not usually interpreted thus, these are learning algorithms that fit a local quadratic approximation to the objective function. We show that many, including the most popular, quasi-Newton methods can be interpreted as approximations of Bayesian linear regression under varying prior assumptions. This new notion elucidates some shortcomings of classical algorithms, and lights the way to a novel nonparametric quasi-Newton method, which is able to make more efficient use of available information at computational cost similar to its predecessors.

ei ps pn

website+code pdf link (url) [BibTex]

website+code pdf link (url) [BibTex]


no image
Analytical probabilistic modeling for radiation therapy treatment planning

Bangert, M., Hennig, P., Oelfke, U.

Physics in Medicine and Biology, 58(16):5401-5419, 2013 (article)

ei pn

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Optimal control of reaching includes kinematic constraints

Mistry, M., Theodorou, E., Schaal, S., Kawato, M.

Journal of Neurophysiology, 2013, clmc (article)

Abstract
We investigate adaptation under a reaching task with an acceleration-based force field perturbation designed to alter the nominal straight hand trajectory in a potentially benign manner:pushing the hand of course in one direction before subsequently restoring towards the target. In this particular task, an explicit strategy to reduce motor effort requires a distinct deviation from the nominal rectilinear hand trajectory. Rather, our results display a clear directional preference during learning, as subjects adapted perturbed curved trajectories towards their initial baselines. We model this behavior using the framework of stochastic optimal control theory and an objective function that trades-of the discordant requirements of 1) target accuracy, 2) motor effort, and 3) desired trajectory. Our work addresses the underlying objective of a reaching movement, and we suggest that robustness, particularly against internal model uncertainly, is as essential to the reaching task as terminal accuracy and energy effciency.

am

PDF [BibTex]

PDF [BibTex]


no image
Magnetoelastic coupling in epitaxial cobalt ferrite/barium titanate heterostructures

Gräfe, J., Welke, M., Bern, F., Ziese, M., Denecke, R.

Journal of Magnetism and Magnetic Materials, 339, pages: 84-88, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors

Ijspeert, A., Nakanishi, J., Pastor, P., Hoffmann, H., Schaal, S.

Neural Computation, (25):328-373, 2013, clmc (article)

Abstract
Nonlinear dynamical systems have been used in many disciplines to model complex behaviors, including biological motor control, robotics, perception, economics, traffic prediction, and neuroscience. While often the unexpected emergent behavior of nonlinear systems is the focus of investigations, it is of equal importance to create goal-directed behavior (e.g., stable locomotion from a system of coupled oscillators under perceptual guidance). Modeling goal-directed behavior with nonlinear systems is, however, rather difficult due to the parameter sensitivity of these systems, their complex phase transitions in response to subtle parameter changes, and the difficulty of analyzing and predicting their long-term behavior; intuition and time-consuming parameter tuning play a major role. This letter presents and reviews dynamical movement primitives, a line of research for modeling attractor behaviors of autonomous nonlinear dynamical systems with the help of statistical learning techniques. The essence of our approach is to start with a simple dynamical system, such as a set of linear differential equations, and transform those into a weakly nonlinear system with prescribed attractor dynamics by meansof a learnable autonomous forcing term. Both point attractors and limit cycle attractors of almost arbitrary complexity can be generated. We explain the design principle of our approach and evaluate its properties in several example applications in motor control and robotics.

am

link (url) [BibTex]

link (url) [BibTex]


no image
Quantum cryo-sieving for hydrogen isotope separation in microporous frameworks: an experimental study on the correlation between effective quantum sieving and pore size

Oh, H., Park, K. S., Kalidindi, S. B., Fischer, R. A., Hirscher, M.

{Journal of Materials Chemistry A}, 1, pages: 3244-3248, Royal Society of Chemistry, Cambridge, UK, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Gold nanocrystals in high-temperature superconducting films: creation of pinning patterns of choice

Katzer, C., Stahl, C., Michalowski, P., Treiber, S., Schmidl, F., Seidel, P., Albrecht, J., Schütz, G.

{New Journal of Physics}, 15(11), Institute of Physics Pub., Bristol, UK, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Theory of scattering of crystal electrons at magnons

Haag, Michael, Illg, C., Fähnle, M.

{Physical Review B}, Published by the American Physical Society through the American Institute of Physics, Woodbury, NYAmerican Institute of Physics, Woodbury, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
The effect of magnetocrystalline anisotropy on the domain structure of patterned Fe2CrSi Heusler alloy thin films

Miyawaki, T., Foerster, M., Finizio, S., Vaz, C. A. F., Mawass, M.-A., Inagaki, K., Fukatani, N., Le Guyader, L., Nolting, F., Ueda, K., Asano, H., Kläui, M.

{Journal of Applied Physcis}, 114(7), American Institute of Physics, New York, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Ion beam lithography for Fresnel zone plates in X-ray microscopy

Keskinbora, K., Grévent, C., Bechtel, M., Weigand, M., Goering, E., Nadzeyka, A., Lloyd, P., Rehbein, S., Schneider, G., Follath, R., Vila-Comamala, J., Yan, H., Schütz, G.

{Optics Express}, 21(10):11747-11756, Optical Society of America, Washington, DC, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Is the angular momentum of a ferromagnetic sample after exposure to a fs laser pulse conserved?

Fähnle, M., Haag, M., Illg, C.

{Journal of Magnetism and Magnetic Materials}, 347, pages: 45-46, North-Holland, Amsterdam, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Grain boundaries as the controlling factor for the ferromagnetic behaviour of Co-doped ZnO

Straumal, B. B., Mazilkin, A. A., Protasova, S. G., Straumal, P. B., Myatiev, A. A., Schütz, G., Goering, E. J., Tietze, T., Baretzky, B.

{Philosophical Magazine}, 93(10-12):1371-1383, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetic properties of electrochemically prepared crystalline films of Prussian blue-based molecular magnets Kj CrIIk [CrIII(CN)6] l \mbox⋅ mH2O

Bhatt, P., Yusuf, S. M., Bhatt, R., Schütz, G.

{Journal of Solid State Electrochemistry}, 17, pages: 1285-1293, Springer-Verlag Germany, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
H2/D2 adsorption and desorption studies on carbon molecular sieves with different pore structures

Krkljus, I., Steriotis, T., Charalambopoulou, G., Gotzias, A., Hirscher, M.

{Carbon}, 57, pages: 239-247, Elsevier Science, Amsterdam [u.a.], 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
X-ray magnetic circular dichroism strongly influenced by non-magnetic cover layers

Zafar, K., Audehm, P., Schütz, G., Goering, E., Pathak, M., Chetry, K. B., LeClair, P. R., Gupta, A.

{Journal of Electron Spectroscopy and Related Phenomena}, 191, pages: 1-6, Elsevier, Amsterdam, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Exchange bias in La0.7Sr0.3MnO3 / SrMnO3 / La0.7Sr0.3MnO3 trilayers

Jungbauer, M., Hühn, S., Michelmann, M., Goering, E., Moshnyaga, V.

{Journal of Applied Physcis}, 113(17), American Institute of Physics, New York, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
General decoupling procedure for expectation values of four-operator products in electron-phonon quantum kinetics

Teeny, N., Fähnle, M.

{Journal of Physics A: Mathematical and Theoretical}, 46(38), IOP Pub., London, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
SPD-induced changes of structure and magnetic properties in the Cu-Co alloys

Straumal, B. B., Protasova, S. G., Mazilkin, A. A., Kogtenkova, O. A., Kurmanaeva, L., Baretzky, B., Schütz, G., Korneva, A., Zieba, P.

{Materials Letters}, 98, pages: 217-221, Elsevier, Amsterdam, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Ferromagnetic behaviour of Fe-doped ZnO nanograined films

Straumal, B. B., Protasova, S. G., Mazilkin, A. A., Tietze, T., Goering, E., Schütz, G., Straumal, P. B., Baretzky, B.

{Beilstein Journal of Nanotechnology}, 4, pages: 361-369, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
The effect of magnetic anisotropy on the spin configurations of patterned La0.7Sr0.3MnO3 elements

Wohlhüter, P., Rhensius, J., Vaz, C. A. F., Heidler, J., Körner, H. S., Bisig, A., Foerster, M., Méchin, L., Gaucher, F., Locatelli, A., Niño, M. A., El Moussaoui, S., Nolting, F., Goering, E., Heyderman, L. J., Kläui, M.

{Journal of Physics: Condensed Matter}, 25, IOP Pub., Bristol, UK, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
The avalanche process in gold covered MgB2 films

Stahl, C., Treiber, S., Schütz, G., Albrecht, J.

{Superconductor Science and Technology}, 26, IOP Pub., Bristol, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
MFU-4 - A metal-organic framework for highly effective H2/D2 separation

Teufel, J., Oh, H., Hirscher, M., Wahiduzzaman, M., Zhechkov, L., Kuc, A., Heine, T., Denysenko, D., Volkmer, D.

{Advanced Materials}, 25(4):635-639, Wiley-VCH Verlag, Weinheim, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Delayed magnetic vortex core reversal

Kammerer, M., Sproll, M., Stoll, H., Noske, M., Weigand, M., Illg, C., Fähnle, M., Schütz, G.

{Applied Physics Letters}, 102, American Institute of Physics, Melville, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Self-organized state formation in magnonic vortex crystals

Adolff, C. F., Hänze, M., Vogel, A., Weigand, M., Martens, M., Meier, G.

{Physical Review B}, 88(22), American Physical Society, Woodbury, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Erratum: Generalized Gilbert equation including inertial damping: Derivation from an extended breathing Fermi surface model [Phys. Rev. B 84, 172403 (2011)]

Fähnle, M., Steiauf, D., Illg, C.

{Physical Review B}, 88, American Physical Society, Woodbury, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Strain and composition dependence of orbital polarization in nickel oxide superlattices

Wu, M., Benckiser, E., Haverkort, M. W., Franco, A., Lu, J., Nwankwo, U., Brück, S., Audehm, P., Goering, E., Macke, S., Hinkov, V., Wochner, P., Christiani, G., Heinze, S., Logvenov, G., Habermeier, H., Keimer, B.

{Physical Review B}, 88, Published by the American Physical Society through the American Institute of Physics, Woodbury, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Efficient focusing of 8 keV X-rays with multilayer Fresnel zone plates fabricated by atomic layer deposition and focused ion beam milling

Mayer, M., Keskinbora, K., Grévent, C., Szeghalmi, A., Knez, M., Weigand, M., Snigirev, A., Snigereva, I., Schütz, G.

{Journal of Synchrotron Radiation}, 20, pages: 433-440, Published for the International Union of Crystallography by Munksgaard, Copenhagen, Denmark, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Rapid prototyping of Fresnel zone plates via direct Ga+ ion beam lithography for high-resolution x-ray imaging

Keskinbora, K., Grévent, C., Eigenthaler, U., Weigand, M., Schütz, G.

{ACS Nano}, 7(11):9788-9797, American Chemical Society, Washington, DC, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Eine kryoflexible kovalente organische Gerüststruktur für die effiziente Trennung von Wasserstoffisotopien durch Quantensieben

Oh, H., Kalidindi, S. B., Um, Y., Bureekaew, S., Schmid, R., Fischer, R. A., Hirscher, M.

{Angewandte Chemie}, 125(50):13461-13464, Wiley-VCH Verl., Weinheim, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Ultrafast demagnetization after laser irradiation in transition metals: Ab initio calculations of the spin-flip electron-phonon scattering with reduced exchange splitting

Illg, C., Haag, M., Fähnle, M.

{Physical Review B}, 88, American Physical Society, Woodbury, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Phase diagram for magnetic vortex core switching studied by ferromagnetic absorption spectroscopy and time-resolved transmission x-ray microscopy

Martens, M., Kamionka, T., Weigand, M., Stoll, H., Tyliszczak, T., Meier, G.

{Physical Review B}, 87, Published by the American Physical Society through the American Institute of Physics, Woodbury, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Optimal distribution of contact forces with inverse-dynamics control

Righetti, L., Buchli, J., Mistry, M., Kalakrishnan, M., Schaal, S.

The International Journal of Robotics Research, 32(3):280-298, March 2013 (article)

Abstract
The development of legged robots for complex environments requires controllers that guarantee both high tracking performance and compliance with the environment. More specifically the control of the contact interaction with the environment is of crucial importance to ensure stable, robust and safe motions. In this contribution we develop an inverse-dynamics controller for floating-base robots under contact constraints that can minimize any combination of linear and quadratic costs in the contact constraints and the commands. Our main result is the exact analytical derivation of the controller. Such a result is particularly relevant for legged robots as it allows us to use torque redundancy to directly optimize contact interactions. For example, given a desired locomotion behavior, we can guarantee the minimization of contact forces to reduce slipping on difficult terrains while ensuring high tracking performance of the desired motion. The main advantages of the controller are its simplicity, computational efficiency and robustness to model inaccuracies. We present detailed experimental results on simulated humanoid and quadruped robots as well as a real quadruped robot. The experiments demonstrate that the controller can greatly improve the robustness of locomotion of the robots.1

am mg

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Switching modes in easy and hard axis magnetic reversal in a self-assembled antidot array

Haering, F., Wiedwald, U., Nothelfer, S., Koslowski, B., Ziemann, P., Lechner, L., Wallucks, A., Lebecki, K., Nowak, U., Gräfe, J., Goering, E., Schütz, G.

{Nanotechnology}, 24, IOP Pub., Bristol, UK, 2013 (article)

mms

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Time-resolved imaging of nonlinear magnetic domain-wall dynamics in ferromagnetic nanowires

Stein, F.-U., Bocklage, L., Weigand, M., Meier, G.

{Scientific Reports}, 3, Nature Publishing Group, London, UK, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
A cryogenically flexible covalent organic framework for efficient hydrogen isotrope separation by quantum sieving

Oh, H., Kalidindi, S. B., Um, Y., Bureekaew, S., Schmid, R., Fischer, R. A., Hirscher, M.

{Angewandte Chemie International Edition in English}, 52(50):13219-13222, Wiley-VCH Verlag GmbH & Co. KGaA, D-69451 Weinheim, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Unexpected room-temperature ferromagnetism in bulk ZnO

Chen, Y., Goering, E., Jeurgens, L., Wang, Z., Phillipp, F., Baier, J., Tietze, T., Schütz, G.

{Applied Physics Letters}, (103), American Institute of Physics, Melville, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Large-area hard magnetic L10-FePt and composite L10-FePt based nanopatterns

Goll, D., Bublat, T.

{Physica Status Solidi A-Applications and Materials Science}, 210(7):1261-1271, Wiley-VCH, Weinheim, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Wave modes of collective vortex gyration in dipolar-coupled-dot-array magnonic crystals

Han, D., Vogel, A., Jung, H., Lee, K., Weigand, M., Stoll, H., Schütz, G., Fischer, P., Meier, G., Kim, S.

{Scientific Reports}, 3, Nature Publishing Group, London, UK, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Ferromagnetism of zinc oxide nanograined films

Straumal, B. B., Protasova, S. G., Mazilkin, A. A., Schütz, G., Goering, E., Baretzky, B., Straumal, P. B.

{Journal of Experimental and Theoretical Physics Letters}, 97(6):367-377, Pleiades Publishing, Inc., 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Hydrogen adsorption properties of platinum decorated hierarchically structured templated carbons

Oh, H., Gennett, T., Atanassov, P., Kurttepeli, M., Bals, S., Hurst, K. E., Hirscher, M.

{Microporous and Mesoporous Materials}, pages: 66-74, Elsevier, Amsterdam, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Extended s-d models for the dynamics of noncollinear magnetization: Short review of two different approaches

Fähnle, M., Zhang, S.

{Journal of Magnetism and Magnetic Materials}, 326, pages: 232-234, NH, Elsevier, Amsterdam, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Correlation between spin structure oscillations and domain wall velocities

Bisig, A., Stärk, M., Mawass, M., Moutafis, C., Rhensius, J., Heidler, J., Büttner, F., Noske, M., Weigand, M., Eisebitt, S., Tyliszczak, T., Van Wayenberge, B., Stoll, H., Schütz, G., Kläui, M.

{Nature Communications}, 4, Nature Publishing Group, London, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Recent advances in use of atomic layer deposition and focused ion beams for fabrication of Fresnel zone plates for hard x-rays

Keskinbora, K., Robisch, A., Mayer, M., Grévent, C., Szeghalmi, A. V., Knez, M., Weigand, M., Snigireva, I., Snigirev, A., Salditt, T., Schütz, G.

{Proceedings of SPIE (The International Society for Optical Engineering)}, 8851, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetic states in low-pinning high-anisotropy material nanostructures suitable for dynamic imaging

Büttner, F., Moutafis, C., Bisig, A., Wohlhüter, P., Günther, C. M., Mohanty, J., Geilhufe, J., Schneider, M., v. Korff Schmising, C., Schaffert, S., Pfau, B., Hantschmann, M., Riemeier, M., Emmel, M., Finizio, S., Jakob, G., Weigand, M., Rhensius, J., Franken, J. H., Lavrijsen, R., Swagten, H. J. M., Stoll, H., Eisebitt, S., Kläui, M.

{Physical Review B}, 87, Published by the American Physical Society through the American Institute of Physics, Woodbury, NY, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Experimental and theoretical study of D2/H2 quantum sieving in a carbon molecular sieve

Gotzias, A., Charalambopoulou, G., Ampoumogli, A., Krkljus, I., Hirscher, M., Steriotis, T.

{Adsorption}, 19(2-4):373-379, Springer Science+Business Media, New York, 2013 (article)

mms

DOI [BibTex]

DOI [BibTex]

2011


no image
Learning, planning, and control for quadruped locomotion over challenging terrain

Kalakrishnan, Mrinal, Buchli, Jonas, Pastor, Peter, Mistry, Michael, Schaal, S.

International Journal of Robotics Research, 30(2):236-258, February 2011 (article)

am

[BibTex]

2011


[BibTex]


no image
Bayesian robot system identification with input and output noise

Ting, J., D’Souza, A., Schaal, S.

Neural Networks, 24(1):99-108, 2011, clmc (article)

Abstract
For complex robots such as humanoids, model-based control is highly beneficial for accurate tracking while keeping negative feedback gains low for compliance. However, in such multi degree-of-freedom lightweight systems, conventional identification of rigid body dynamics models using CAD data and actuator models is inaccurate due to unknown nonlinear robot dynamic effects. An alternative method is data-driven parameter estimation, but significant noise in measured and inferred variables affects it adversely. Moreover, standard estimation procedures may give physically inconsistent results due to unmodeled nonlinearities or insufficiently rich data. This paper addresses these problems, proposing a Bayesian system identification technique for linear or piecewise linear systems. Inspired by Factor Analysis regression, we develop a computationally efficient variational Bayesian regression algorithm that is robust to ill-conditioned data, automatically detects relevant features, and identifies input and output noise. We evaluate our approach on rigid body parameter estimation for various robotic systems, achieving an error of up to three times lower than other state-of-the-art machine learning methods

am

link (url) [BibTex]

link (url) [BibTex]


no image
The Oxidation of Fe(111)

Davies, R., Edwards, D., Gräfe, J., Gilbert, L., Davies, P., Hutchings, G., Bowker, M.

Surface Science, 605(17-18):1754-1762, 2011 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Learning variable impedance control

Buchli, J., Stulp, F., Theodorou, E., Schaal, S.

International Journal of Robotics Research, 2011, clmc (article)

Abstract
One of the hallmarks of the performance, versatility, and robustness of biological motor control is the ability to adapt the impedance of the overall biomechanical system to different task requirements and stochastic disturbances. A transfer of this principle to robotics is desirable, for instance to enable robots to work robustly and safely in everyday human environments. It is, however, not trivial to derive variable impedance controllers for practical high degree-of-freedom (DOF) robotic tasks. In this contribution, we accomplish such variable impedance control with the reinforcement learning (RL) algorithm PISq ({f P}olicy {f I}mprovement with {f P}ath {f I}ntegrals). PISq is a model-free, sampling based learning method derived from first principles of stochastic optimal control. The PISq algorithm requires no tuning of algorithmic parameters besides the exploration noise. The designer can thus fully focus on cost function design to specify the task. From the viewpoint of robotics, a particular useful property of PISq is that it can scale to problems of many DOFs, so that reinforcement learning on real robotic systems becomes feasible. We sketch the PISq algorithm and its theoretical properties, and how it is applied to gain scheduling for variable impedance control. We evaluate our approach by presenting results on several simulated and real robots. We consider tasks involving accurate tracking through via-points, and manipulation tasks requiring physical contact with the environment. In these tasks, the optimal strategy requires both tuning of a reference trajectory emph{and} the impedance of the end-effector. The results show that we can use path integral based reinforcement learning not only for planning but also to derive variable gain feedback controllers in realistic scenarios. Thus, the power of variable impedance control is made available to a wide variety of robotic systems and practical applications.

am

link (url) [BibTex]

link (url) [BibTex]