Header logo is


2019


Soft-magnetic coatings as possible sensors for magnetic imaging of superconductors
Soft-magnetic coatings as possible sensors for magnetic imaging of superconductors

Ionescu, A., Simmendinger, J., Bihler, M., Miksch, C., Fischer, P., Soltan, S., Schütz, G., Albrecht, J.

Supercond. Sci. and Tech., 33, pages: 015002, IOP, December 2019 (article)

Abstract
Magnetic imaging of superconductors typically requires a soft-magnetic material placed on top of the superconductor to probe local magnetic fields. For reasonable results the influence of the magnet onto the superconductor has to be small. Thin YBCO films with soft-magnetic coatings are investigated using SQUID magnetometry. Detailed measurements of the magnetic moment as a function of temperature, magnetic field and time have been performed for different heterostructures. It is found that the modification of the superconducting transport in these heterostructures strongly depends on the magnetic and structural properties of the soft-magnetic material. This effect is especially pronounced for an inhomogeneous coating consisting of ferromagnetic nanoparticles.

pf mms

link (url) DOI [BibTex]

2019


link (url) DOI [BibTex]


no image
On the Transfer of Inductive Bias from Simulation to the Real World: a New Disentanglement Dataset

Gondal, M. W., Wuthrich, M., Miladinovic, D., Locatello, F., Breidt, M., Volchkov, V., Akpo, J., Bachem, O., Schölkopf, B., Bauer, S.

Advances in Neural Information Processing Systems 32, pages: 15714-15725, (Editors: H. Wallach and H. Larochelle and A. Beygelzimer and F. d’Alché-Buc and E. Fox and R. Garnett), Curran Associates, Inc., 33rd Annual Conference on Neural Information Processing Systems, December 2019 (conference)

ei sf am

link (url) [BibTex]

link (url) [BibTex]


EM-Fusion: Dynamic Object-Level SLAM With Probabilistic Data Association
EM-Fusion: Dynamic Object-Level SLAM With Probabilistic Data Association

Strecke, M., Stückler, J.

In International Conference on Computer Vision, October 2019, arXiv:1904.11781 (inproceedings)

ev

preprint Project page Poster [BibTex]

preprint Project page Poster [BibTex]


Accurate Vision-based Manipulation through Contact Reasoning
Accurate Vision-based Manipulation through Contact Reasoning

Kloss, A., Bauza, M., Wu, J., Tenenbaum, J. B., Rodriguez, A., Bohg, J.

In International Conference on Robotics and Automation, May 2019 (inproceedings) Accepted

Abstract
Planning contact interactions is one of the core challenges of many robotic tasks. Optimizing contact locations while taking dynamics into account is computationally costly and in only partially observed environments, executing contact-based tasks often suffers from low accuracy. We present an approach that addresses these two challenges for the problem of vision-based manipulation. First, we propose to disentangle contact from motion optimization. Thereby, we improve planning efficiency by focusing computation on promising contact locations. Second, we use a hybrid approach for perception and state estimation that combines neural networks with a physically meaningful state representation. In simulation and real-world experiments on the task of planar pushing, we show that our method is more efficient and achieves a higher manipulation accuracy than previous vision-based approaches.

am

Video link (url) [BibTex]

Video link (url) [BibTex]


Learning Latent Space Dynamics for Tactile Servoing
Learning Latent Space Dynamics for Tactile Servoing

Sutanto, G., Ratliff, N., Sundaralingam, B., Chebotar, Y., Su, Z., Handa, A., Fox, D.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2019, IEEE, International Conference on Robotics and Automation, May 2019 (inproceedings) Accepted

am

pdf video [BibTex]

pdf video [BibTex]


Leveraging Contact Forces for Learning to Grasp
Leveraging Contact Forces for Learning to Grasp

Merzic, H., Bogdanovic, M., Kappler, D., Righetti, L., Bohg, J.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2019, IEEE, International Conference on Robotics and Automation, May 2019 (inproceedings)

Abstract
Grasping objects under uncertainty remains an open problem in robotics research. This uncertainty is often due to noisy or partial observations of the object pose or shape. To enable a robot to react appropriately to unforeseen effects, it is crucial that it continuously takes sensor feedback into account. While visual feedback is important for inferring a grasp pose and reaching for an object, contact feedback offers valuable information during manipulation and grasp acquisition. In this paper, we use model-free deep reinforcement learning to synthesize control policies that exploit contact sensing to generate robust grasping under uncertainty. We demonstrate our approach on a multi-fingered hand that exhibits more complex finger coordination than the commonly used two- fingered grippers. We conduct extensive experiments in order to assess the performance of the learned policies, with and without contact sensing. While it is possible to learn grasping policies without contact sensing, our results suggest that contact feedback allows for a significant improvement of grasping robustness under object pose uncertainty and for objects with a complex shape.

am mg

video arXiv [BibTex]

video arXiv [BibTex]


no image
X-ray Optics Fabrication Using Unorthodox Approaches

Sanli, U., Baluktsian, M., Ceylan, H., Sitti, M., Weigand, M., Schütz, G., Keskinbora, K.

Bulletin of the American Physical Society, APS, 2019 (article)

mms pi

[BibTex]

[BibTex]


no image
Nanoscale detection of spin wave deflection angles in permalloy

Gross, F., Träger, N., Förster, J., Weigand, M., Schütz, G., Gräfe, J.

{Applied Physics Letters}, 114(1), American Institute of Physics, Melville, NY, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Generation of switchable singular beams with dynamic metasurfaces

Yu, P., Li, J., Li, X., Schütz, G., Hirscher, M., Zhang, S., Liu, N.

{ACS Nano}, 13(6):7100-7106, American Chemical Society, Washington, DC, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Extracting the dynamic magnetic contrast in time-resolved X-ray transmission microscopy

Schaffers, T., Feggeler, T., Pile, S., Meckenstock, R., Buchner, M., Spoddig, D., Ney, V., Farle, M., Wende, H., Wintz, S., Weigand, M., Ohldag, H., Ollefs, K, Ney, A.

{Nanomaterials}, 9(7), MDPI, Basel, Schweiz, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
gFORC: A graphics processing unit accelerated first-order reversal-curve calculator

Groß, F., Mart\’\inez-Garc\’\ia, J. C., Ilse, S. E., Schütz, G., Goering, E., Rivas, M., Gräfe, J.

{Journal of Applied Physics}, 126(16), AIP Publishing, New York, NY, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Piezo-electrical control of gyration dynamics of magnetic vortices

Filianina, M., Baldrati, L., Hajiri, T., Litzius, K., Foerster, M., Aballe, L., Kläui, M.

{Applied Physics Letters}, 115(6), American Institute of Physics, Melville, NY, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Barely porous organic cages for hydrogen isotrope separation

Liu, M., Zhang, L., Little, M. A., Kapil, V., Ceriotti, M., Yang, S., Ding, L., Holden, D. L., Balderas-Xicohténcatl, R., He, D., Clowes, R., Chong, S. Y., Schütz, G., Chen, L., Hirscher, M., Cooper, A. I.

{Science}, 366(6465):613-620, American Association for the Advancement of Science, Washington, D.C., 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Direct observation of coherent magnons with suboptical wavelengths in a single-crystalline ferrimagnetic insulator

Förster, J., Gräfe, J., Bailey, J., Finizio, S., Träger, N., Groß, F., Mayr, S., Stoll, H., Dubs, C., Surzhenko, O., Liebing, N., Woltersdorf, G., Raabe, J., Weigand, M., Schütz, G., Wintz, S.

{Physical Review B}, 100(21), American Physical Society, Woodbury, NY, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetically induced anisotropy of flux penetration into strong-pinning superconductor/ferromagnet bilayers

Simmendinger, J., Hänisch, J., Bihler, M., Ionescu, A. M., Weigand, M., Sieger, M., Hühne, R., Rijckaert, H., van Driessche, I., Schütz, G., Albrecht, J.

{New Journal of Physics}, 21, IOP Publishing, Bristol, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
X-ray microscopic characterization of high-Tc-supercoductors using image processing

Bihler, M.

Universität Stuttgart, Stuttgart, 2019 (mastersthesis)

mms

[BibTex]


no image
Coherent excitation of heterosymmetric spin waves with ultrashort wavelengths

Dieterle, G., Förster, J., Stoll, H., Semisalova, A. S., Finizio, S., Gangwar, A., Weigand, M., Noske, M., Fähnle, M., Bykova, I., Gräfe, J., Bozhko, D. A., Musiienko-Shmarova, H. Y., Tiberkevich, V., Slavin, A. N., Back, C. H., Raabe, J., Schütz, G., Wintz, S.

{Physical Review Letters}, 122(11), American Physical Society, Woodbury, N.Y., 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Reprogrammability and Scalability of Magnonic Fibonacci Quasicrystals

Lisiecki, F., Rychły, J., Kuświk, P., Głowiński, H., Kłos, J. W., Groß, F., Bykova, I., Weigand, M., Zelent, M., Goering, E. J., Schütz, G., Gubbiotti, G., Krawczyk, M., Stobiecki, F., Dubowik, J., Gräfe, J.

Physical Review Applied, 11, pages: 054003, 2019 (article)

Abstract
Magnonic crystals are systems that can be used to design and tune the dynamic properties of magnetization. Here, we focus on one-dimensional Fibonacci magnonic quasicrystals. We confirm the existence of collective spin waves propagating through the structure as well as dispersionless modes; the reprogammability of the resonance frequencies, dependent on the magnetization order; and dynamic spin-wave interactions. With the fundamental understanding of these properties, we lay a foundation for the scalable and advanced design of spin-wave band structures for spintronic, microwave, and magnonic applications.

mms

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Coordinated molecule-modulated magnetic phase with metamagnetism in metal-organic frameworks

Son, K., Kim, J. Y., Schütz, G., Kang, S. G., Moon, H. R., Oh, H.

{Inorganic Chemistry}, 58(14):8895-8899, American Chemical Society, Washington, DC, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Novel X-ray lenses for direct and coherent imaging

Sanli, U. T.

Universität Stuttgart, Stuttgart, 2019 (phdthesis)

mms

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Scaling of intrinsic domain wall magnetoresistance with confinement in electromigrated nanocontacts

Reeve, R. M., Loescher, A., Kazemi, H., Dupé, B., Mawass, M., Winkler, T., Schönke, D., Miao, J., Litzius, K., Sedlmayr, N., Schneider, I., Sinova, J., Eggert, S., Kläui, M.

{Physical Review B}, 99(21), American Physical Society, Woodbury, NY, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnons in a Quasicrystal: Propagation, Extinction, and Localization of Spin Waves in Fibonacci Structures

Lisiecki, F., Rychły, J., Kuświk, P., Głowiński, H., Kłos, J. W., Groß, F., Träger, N., Bykova, I., Weigand, M., Zelent, M., Goering, E. J., Schütz, G., Krawczyk, M., Stobiecki, F., Dubowik, J., Gräfe, J.

Physical Review Applied, 11, pages: 054061, 2019 (article)

Abstract
Magnonic quasicrystals exceed the possibilities of spin-wave (SW) manipulation offered by regular magnonic crystals, because of their more complex SW spectra with fractal characteristics. Here, we report the direct x-ray microscopic observation of propagating SWs in a magnonic quasicrystal, consisting of dipolar coupled permalloy nanowires arranged in a one-dimensional Fibonacci sequence. SWs from the first and second band as well as evanescent waves from the band gap between them are imaged. Moreover, additional mini band gaps in the spectrum are demonstrated, directly indicating an influence of the quasiperiodicity of the system. Finally, the localization of SW modes within the Fibonacci crystal is shown. The experimental results are interpreted using numerical calculations and we deduce a simple model to estimate the frequency position of the magnonic gaps in quasiperiodic structures. The demonstrated features of SW spectra in one-dimensional magnonic quasicrystals allow utilizing this class of metamaterials for magnonics and make them an ideal basis for future applications.

mms

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Structural and magnetic properties of FePt-Tb alloy thin films

Schmidt, N. Y., Laureti, S., Radu, F., Ryll, H., Luo, C., d\textquotesingleAcapito, F., Tripathi, S., Goering, E., Weller, D., Albrecht, M.

{Physical Review B}, 100(6), American Physical Society, Woodbury, NY, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Tunable perpendicular exchange bias in oxide heterostructures

Kim, G., Khaydukov, Y., Bluschke, M., Suyolcu, Y. E., Christiani, G., Son, K., Dietl, C., Keller, T., Weschke, E., van Aken, P. A., Logvenov, G., Keimer, B.

{Physical Review Materials}, 3(8), American Physical Society, College Park, MD, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Tailoring of an unusual oxidation state in a lanthanum tantalum(IV) oxynitride via precursor microstructure design

Bubeck, C., Widenmeyer, M., Richter, G., Coduri, M., Goering, E., Yoon, S., Weidenkaff, A.

{Communications Chemistry}, 2, Springer Nature, London, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


Automated Generation of Reactive Programs from Human Demonstration for Orchestration of Robot Behaviors
Automated Generation of Reactive Programs from Human Demonstration for Orchestration of Robot Behaviors

Berenz, V., Bjelic, A., Mainprice, J.

ArXiv, 2019 (article)

Abstract
Social robots or collaborative robots that have to interact with people in a reactive way are difficult to program. This difficulty stems from the different skills required by the programmer: to provide an engaging user experience the behavior must include a sense of aesthetics while robustly operating in a continuously changing environment. The Playful framework allows composing such dynamic behaviors using a basic set of action and perception primitives. Within this framework, a behavior is encoded as a list of declarative statements corresponding to high-level sensory-motor couplings. To facilitate non-expert users to program such behaviors, we propose a Learning from Demonstration (LfD) technique that maps motion capture of humans directly to a Playful script. The approach proceeds by identifying the sensory-motor couplings that are active at each step using the Viterbi path in a Hidden Markov Model (HMM). Given these activation patterns, binary classifiers called evaluations are trained to associate activations to sensory data. Modularity is increased by clustering the sensory-motor couplings, leading to a hierarchical tree structure. The novelty of the proposed approach is that the learned behavior is encoded not in terms of trajectories in a task space, but as couplings between sensory information and high-level motor actions. This provides advantages in terms of behavioral generalization and reactivity displayed by the robot.

am

Support Video link (url) [BibTex]


no image
Interpreting first-order reversal curves beyond the Preisach model: An experimental permalloy microarray investigation

Groß, F., Ilse, S. E., Schütz, G., Gräfe, J., Goering, E.

{Physical Review B}, 99(6), American Physical Society, Woodbury, NY, 2019 (article)

mms

DOI [BibTex]


no image
Bistability of magnetic states in Fe-Pd nanocap arrays

Aravind, P. B., Heigl, M., Fix, M., Groß, F., Gräfe, J., Mary, A., Rajgowrav, C. R., Krupiński, M., Marszałek, M., Thomas, S., Anantharaman, M. R., Albrecht, M.

Nanotechnology, 30, pages: 405705, 2019 (article)

Abstract
Magnetic bistability between vortex and single domain states in nanostructures are of great interest from both fundamental and technological perspectives. In soft magnetic nanostructures, the transition from a uniform collinear magnetic state to a vortex state (or vice versa) induced by a magnetic field involves an energy barrier. If the thermal energy is large enough for overcoming this energy barrier, magnetic bistability with a hysteresis-free switching occurs between the two magnetic states. In this work, we tune this energy barrier by tailoring the composition of FePd alloys, which were deposited onto self-assembled particle arrays forming magnetic vortex structures on top of the particles. The bifurcation temperature, where a hysteresis-free transition occurs, was extracted from the temperature dependence of the annihilation and nucleation field which increases almost linearly with Fe content of the magnetic alloy. This study provides insights into the magnetization reversal process associated with magnetic bistability, which allows adjusting the bifurcation temperature range by the material properties of the nanosystem.

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Learning to Disentangle Latent Physical Factors for Video Prediction

Zhu, D., Munderloh, M., Rosenhahn, B., Stückler, J.

In German Conference on Pattern Recognition (GCPR), 2019, to appear (inproceedings)

ev

dataset & evaluation code video preprint [BibTex]

dataset & evaluation code video preprint [BibTex]


no image
An international laboratory comparison study of volumetric and gravimetric hydrogen adsorption measurements

Hurst, K. E., Gennett, T., Adams, J., Allendorf, M. D., Balderas-Xicohténcatl, R., Bielewski, M., Edwards, B., Espinal, L., Fultz, B., Hirscher, M., Hudson, M. S. L., Hulvey, Z., Latroche, M., Liu, D., Kapelewski, M., Napolitano, E., Perry, Z. T., Purewal, J., Stavila, V., Veenstra, M., White, J. L., Yuan, Y., Zhou, H., Zlotea, C., Parilla, P.

{ChemPhysChem}, 20(15):1997-2009, Wiley-VCH, Weinheim, Germany, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Superior magnetic performance in FePt L10 nanomaterials

Son, K., Ryu, G. H., Jeong, H., Fink, L., Merz, M., Nagel, P., Schuppler, S., Richter, G., Goering, E., Schütz, G.

{Small}, 15(34), Wiley, Weinheim, Germany, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Vizualizing nanoscale spin waves using MAXYMUS

Gräfe, J., Weigand, M., Van Waeyenberge, B., Gangwar, A., Groß, F., Lisiecki, F., Rychly, J., Stoll, H., Träger, N., Förster, J., Stobiecki, F., Dubowik, J., Klos, H., Krwaczyk, M., Back, C. H., Goering, E. J., Schütz, G.

{Proceedings of SPIE}, 11090, SPIE, Bellingham, Washington, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Niobium near-surface composition during nitrogen infusion relevant for superconducting radio-frequency cavities

Semione, G. D. L., Dangwal Pandey, A., Tober, S., Pfrommer, J., Poulain, A., Drnec, J., Schütz, G., Keller, T. F., Noei, H., Vonk, V., Foster, B., Stierle, A.

{Physical Review Accelerators and Beams}, 22(10), American Physical Society, Ridge, NY, USA, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
3D Birds-Eye-View Instance Segmentation

Elich, C., Engelmann, F., Kontogianni, T., Leibe, B.

In German Conference on Pattern Recognition (GCPR), 2019, arXiv:1904.02199, to appear (inproceedings)

ev

[BibTex]

[BibTex]


no image
Systematic experimental study on quantum sieving of hydrogen isotopes in metal-amide-imidazolate frameworks with narrow 1-D channels

Mondal, S. S., Kreuzer, A., Behrens, K., Schütz, G., Holdt, H., Hirscher, M.

{ChemPhysChem}, 20(10):1311-1315, Wiley-VCH, Weinheim, Germany, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
The route to supercurrent transparent ferromagnetic barriers in superconducting matrix

Ivanov, Y. P., Soltan, S., Albrecht, J., Goering, E., Schütz, G., Zhang, Z., Chuvilin, A.

{ACS Nano}, 13(5):5655-5661, American Chemical Society, Washington, DC, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Exploiting dynamic opening of apertures in a partially fluorinated MOF for enhancing H2 desorption temperature and isotope separation

Zhang, L., Jee, S., Park, J., Jung, M., Wallcher, D., Franz, A., Lee, W., Yoon, M., Choi, K., Hirscher, M., Oh, H.

{Journal of the American Chemical Society}, 141(50):19850-19858, American Chemical Society, Washington, DC, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Speeding up the extended Kalman filter approach for denoising XMCD movies of fast magnetization dynamics

Fähnle, M., Schütz, G.

{Ultramicroscopy}, 206, North-Holland, Amsterdam, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Artifacts from manganese reduction in rock samples prepared by focused ion beam (FIB) slicing for X-ray microspectroscopy

Macholdt, D. S., Förster, J., Müller, M., Weber, B., Kappl, M., Kilcoyne, A. L. D., Weigand, M., Leitner, J., Jochum, K. P., Pöhlker, C., Andreae, M. O.

{Geoscientific instrumentation, methods and data systems}, 8(1):97-111, Copernicus Publ., Göttingen, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetic field dependence of mangetotransport properties of MgB2/CrO2 bilayer thin films

Alzayed, N. S., Shahabuddin, M., Ramey, S. M., Soltan, S.

{Journal of Superconductivity and Novel Magnetism}, 32(8):2447-2455, Springer Science + Business Media B.V., New York, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Mixed-state magnetotransport properties of MgB2 thin film prepared by pulsed laser deposition on an Al2O3 substrate

Alzayed, N. S., Shahabuddin, M., Ramey, S. M., Soltan, S.

{Journal of Materials Science: Materials in Electronics}, 30(2):1547-1552, Springer, Norwell, MA, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Comparison of theories of fast and ultrafast magnetization dynamics

Fähnle, M.

{Journal of Magnetism and Magnetic Materials}, 469, pages: 28-29, NH, Elsevier, Amsterdam, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Concepts for improving hydrogen storage in nanoporous materials

Broom, D. P., Webb, C. J., Fanourgakis, G. S., Froudakis, G. E., Trikalitis, P. N., Hirscher, M.

{International Journal of Hydrogen Energy}, 44(15):7768-7779, Elsevier, Amsterdam, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Controlling dislocation nucleation-mediatd plasticity in nanostructures via surface modification

Shin, J., Chen, L. Y., Sanli, U. T., Richter, G., Labat, S., Richard, M., Cornelius, T., Thomas, O., Gianola, D. S.

{Acta Materialia}, 166, pages: 572-586, Elsevier Science, Kidlington, 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Reprogrammability and scalability of magnonic Fibonacci quasicrystals

Lisiecki, F., Rychly, J., Kuswik, P., Glowinski, H., Klos, J. W., Groß, F., Bykova, I., Weigand, M., Zelent, M., Goering, E. J., Schütz, G., Gubbiotti, G., Krawczyk, M., Stobiecki, F., Dubowik, J., Gräfe, J.

{Physical Review Applied}, 11(5), American Physical Society, College Park, Md. [u.a.], 2019 (article)

mms

DOI [BibTex]

DOI [BibTex]

2017


Multi-Modal Imitation Learning from Unstructured Demonstrations using Generative Adversarial Nets
Multi-Modal Imitation Learning from Unstructured Demonstrations using Generative Adversarial Nets

Hausman, K., Chebotar, Y., Schaal, S., Sukhatme, G., Lim, J.

In Proceedings from the conference "Neural Information Processing Systems 2017., (Editors: Guyon I. and Luxburg U.v. and Bengio S. and Wallach H. and Fergus R. and Vishwanathan S. and Garnett R.), Curran Associates, Inc., Advances in Neural Information Processing Systems 30 (NIPS), December 2017 (inproceedings)

am

pdf video [BibTex]

2017


pdf video [BibTex]


On the Design of {LQR} Kernels for Efficient Controller Learning
On the Design of LQR Kernels for Efficient Controller Learning

Marco, A., Hennig, P., Schaal, S., Trimpe, S.

Proceedings of the 56th IEEE Annual Conference on Decision and Control (CDC), pages: 5193-5200, IEEE, IEEE Conference on Decision and Control, December 2017 (conference)

Abstract
Finding optimal feedback controllers for nonlinear dynamic systems from data is hard. Recently, Bayesian optimization (BO) has been proposed as a powerful framework for direct controller tuning from experimental trials. For selecting the next query point and finding the global optimum, BO relies on a probabilistic description of the latent objective function, typically a Gaussian process (GP). As is shown herein, GPs with a common kernel choice can, however, lead to poor learning outcomes on standard quadratic control problems. For a first-order system, we construct two kernels that specifically leverage the structure of the well-known Linear Quadratic Regulator (LQR), yet retain the flexibility of Bayesian nonparametric learning. Simulations of uncertain linear and nonlinear systems demonstrate that the LQR kernels yield superior learning performance.

am ics pn

arXiv PDF On the Design of LQR Kernels for Efficient Controller Learning - CDC presentation DOI Project Page [BibTex]

arXiv PDF On the Design of LQR Kernels for Efficient Controller Learning - CDC presentation DOI Project Page [BibTex]


Interactive Perception: Leveraging Action in Perception and Perception in Action
Interactive Perception: Leveraging Action in Perception and Perception in Action

Bohg, J., Hausman, K., Sankaran, B., Brock, O., Kragic, D., Schaal, S., Sukhatme, G.

IEEE Transactions on Robotics, 33, pages: 1273-1291, December 2017 (article)

Abstract
Recent approaches in robotics follow the insight that perception is facilitated by interactivity with the environment. These approaches are subsumed under the term of Interactive Perception (IP). We argue that IP provides the following benefits: (i) any type of forceful interaction with the environment creates a new type of informative sensory signal that would otherwise not be present and (ii) any prior knowledge about the nature of the interaction supports the interpretation of the signal. This is facilitated by knowledge of the regularity in the combined space of sensory information and action parameters. The goal of this survey is to postulate this as a principle and collect evidence in support by analyzing and categorizing existing work in this area. We also provide an overview of the most important applications of Interactive Perception. We close this survey by discussing the remaining open questions. Thereby, we hope to define a field and inspire future work.

am

arXiv DOI Project Page [BibTex]

arXiv DOI Project Page [BibTex]


Optimizing Long-term Predictions for Model-based Policy Search
Optimizing Long-term Predictions for Model-based Policy Search

Doerr, A., Daniel, C., Nguyen-Tuong, D., Marco, A., Schaal, S., Toussaint, M., Trimpe, S.

Proceedings of 1st Annual Conference on Robot Learning (CoRL), 78, pages: 227-238, (Editors: Sergey Levine and Vincent Vanhoucke and Ken Goldberg), 1st Annual Conference on Robot Learning, November 2017 (conference)

Abstract
We propose a novel long-term optimization criterion to improve the robustness of model-based reinforcement learning in real-world scenarios. Learning a dynamics model to derive a solution promises much greater data-efficiency and reusability compared to model-free alternatives. In practice, however, modelbased RL suffers from various imperfections such as noisy input and output data, delays and unmeasured (latent) states. To achieve higher resilience against such effects, we propose to optimize a generative long-term prediction model directly with respect to the likelihood of observed trajectories as opposed to the common approach of optimizing a dynamics model for one-step-ahead predictions. We evaluate the proposed method on several artificial and real-world benchmark problems and compare it to PILCO, a model-based RL framework, in experiments on a manipulation robot. The results show that the proposed method is competitive compared to state-of-the-art model learning methods. In contrast to these more involved models, our model can directly be employed for policy search and outperforms a baseline method in the robot experiment.

am ics

PDF Project Page [BibTex]

PDF Project Page [BibTex]


Acquiring Target Stacking Skills by Goal-Parameterized Deep Reinforcement Learning
Acquiring Target Stacking Skills by Goal-Parameterized Deep Reinforcement Learning

Li, W., Bohg, J., Fritz, M.

arXiv, November 2017 (article) Submitted

Abstract
Understanding physical phenomena is a key component of human intelligence and enables physical interaction with previously unseen environments. In this paper, we study how an artificial agent can autonomously acquire this intuition through interaction with the environment. We created a synthetic block stacking environment with physics simulation in which the agent can learn a policy end-to-end through trial and error. Thereby, we bypass to explicitly model physical knowledge within the policy. We are specifically interested in tasks that require the agent to reach a given goal state that may be different for every new trial. To this end, we propose a deep reinforcement learning framework that learns policies which are parametrized by a goal. We validated the model on a toy example navigating in a grid world with different target positions and in a block stacking task with different target structures of the final tower. In contrast to prior work, our policies show better generalization across different goals.

am

arXiv [BibTex]