Header logo is de


2018


Deep Reinforcement Learning for Event-Triggered Control
Deep Reinforcement Learning for Event-Triggered Control

Baumann, D., Zhu, J., Martius, G., Trimpe, S.

In Proceedings of the 57th IEEE International Conference on Decision and Control (CDC), pages: 943-950, 57th IEEE International Conference on Decision and Control (CDC), December 2018 (inproceedings)

al ics

arXiv PDF DOI Project Page Project Page [BibTex]

2018


arXiv PDF DOI Project Page Project Page [BibTex]


no image
L4: Practical loss-based stepsize adaptation for deep learning

Rolinek, M., Martius, G.

In Advances in Neural Information Processing Systems 31 (NeurIPS 2018), pages: 6434-6444, (Editors: S. Bengio and H. Wallach and H. Larochelle and K. Grauman and N. Cesa-Bianchi and R. Garnett), Curran Associates, Inc., 2018 (inproceedings)

al

Github link (url) Project Page [BibTex]

Github link (url) Project Page [BibTex]


Systematic self-exploration of behaviors for robots in a dynamical systems framework
Systematic self-exploration of behaviors for robots in a dynamical systems framework

Pinneri, C., Martius, G.

In Proc. Artificial Life XI, pages: 319-326, MIT Press, Cambridge, MA, 2018 (inproceedings)

Abstract
One of the challenges of this century is to understand the neural mechanisms behind cognitive control and learning. Recent investigations propose biologically plausible synaptic mechanisms for self-organizing controllers, in the spirit of Hebbian learning. In particular, differential extrinsic plasticity (DEP) [Der and Martius, PNAS 2015], has proven to enable embodied agents to self-organize their individual sensorimotor development, and generate highly coordinated behaviors during their interaction with the environment. These behaviors are attractors of a dynamical system. In this paper, we use the DEP rule to generate attractors and we combine it with a “repelling potential” which allows the system to actively explore all its attractor behaviors in a systematic way. With a view to a self-determined exploration of goal-free behaviors, our framework enables switching between different motion patterns in an autonomous and sequential fashion. Our algorithm is able to recover all the attractor behaviors in a toy system and it is also effective in two simulated environments. A spherical robot discovers all its major rolling modes and a hexapod robot learns to locomote in 50 different ways in 30min.

al

link (url) DOI Project Page [BibTex]

link (url) DOI Project Page [BibTex]


Learning equations for extrapolation and control
Learning equations for extrapolation and control

Sahoo, S. S., Lampert, C. H., Martius, G.

In Proc. 35th International Conference on Machine Learning, ICML 2018, Stockholm, Sweden, 2018, 80, pages: 4442-4450, http://proceedings.mlr.press/v80/sahoo18a/sahoo18a.pdf, (Editors: Dy, Jennifer and Krause, Andreas), PMLR, 2018 (inproceedings)

Abstract
We present an approach to identify concise equations from data using a shallow neural network approach. In contrast to ordinary black-box regression, this approach allows understanding functional relations and generalizing them from observed data to unseen parts of the parameter space. We show how to extend the class of learnable equations for a recently proposed equation learning network to include divisions, and we improve the learning and model selection strategy to be useful for challenging real-world data. For systems governed by analytical expressions, our method can in many cases identify the true underlying equation and extrapolate to unseen domains. We demonstrate its effectiveness by experiments on a cart-pendulum system, where only 2 random rollouts are required to learn the forward dynamics and successfully achieve the swing-up task.

al

Code Arxiv Poster Slides link (url) Project Page [BibTex]

Code Arxiv Poster Slides link (url) Project Page [BibTex]


Robust Affordable 3D Haptic Sensation via Learning Deformation Patterns
Robust Affordable 3D Haptic Sensation via Learning Deformation Patterns

Sun, H., Martius, G.

Proceedings International Conference on Humanoid Robots, pages: 846-853, IEEE, New York, NY, USA, 2018 IEEE-RAS International Conference on Humanoid Robots, 2018, Oral Presentation (conference)

Abstract
Haptic sensation is an important modality for interacting with the real world. This paper proposes a general framework of inferring haptic forces on the surface of a 3D structure from internal deformations using a small number of physical sensors instead of employing dense sensor arrays. Using machine learning techniques, we optimize the sensor number and their placement and are able to obtain high-precision force inference for a robotic limb using as few as 9 sensors. For the optimal and sparse placement of the measurement units (strain gauges), we employ data-driven methods based on data obtained by finite element simulation. We compare data-driven approaches with model-based methods relying on geometric distance and information criteria such as Entropy and Mutual Information. We validate our approach on a modified limb of the “Poppy” robot [1] and obtain 8 mm localization precision.

al

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Direct observations of sub-100 nm spin wave propagation in magnonic wave-guides

Träger, N., Gruszecki, P., Lisiecki, F., Förster, J., Weigand, M., Kuswik, P., Dubowik, J., Schütz, G., Krawczyk, M., Gräfe, J.

In 2018 IEEE International Magnetics Conference (INTERMAG 2018), IEEE, Singapore, 2018 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Interpreting FORC diagrams beyond the Preisach model: an experimental permalloy micro array investigation

Gross, F., Ilse, S., Schütz, G., Gräfe, J., Goering, E.

In 2018 IEEE International Magnetics Conference (INTERMAG 2018), IEEE, Singapore, 2018 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]

2014


no image
Increasing the sensor performance using Au modified high temperature superconducting YBa2Cu3O7-delta thin films

Katzer, C., Stahl, C., Michalowski, P., Treiber, S., Westernhausen, M., Schmidl, F., Seidel, P., Schütz, G., Albrecht, J.

In 507, IOP Pub., Genova, Italy, 2014 (inproceedings)

mms

DOI [BibTex]

2014


DOI [BibTex]


no image
Self-Exploration of the Stumpy Robot with Predictive Information Maximization

Martius, G., Jahn, L., Hauser, H., V. Hafner, V.

In Proc. From Animals to Animats, SAB 2014, 8575, pages: 32-42, LNCS, Springer, 2014 (inproceedings)

al

[BibTex]

[BibTex]

2005


no image
Magnetization reversal behavior of nanogranular CoCrPt alloy thin films studied with magnetic transmission X-ray microscopy

Fischer, P., Im, M., Eimüller, T., Schütz, G., Shin, S.

In 286, pages: 311-314, Boulder, CO, USA, 2005 (inproceedings)

mms

[BibTex]

2005


[BibTex]


no image
Defects distribution of Pr2Fe14B hard magnetic magnet from amorphous to nanostructures characterized by positron annihilation spectroscopy

Wu, Y. C., Sprengel, W., Reimann, K., Reichle, K. J., Goll, D., Würschum, R., Schaefer, H. E.

In PRICM 5. Proceedings of the Fifth Pacific RIM International Conference on Advanced Materials and Processing, 475-479, pages: 2123-2126, Materials Science Forum, Trans Tech, Beijing, China, 2005 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Implementing sub-ns time resolution into magnetic X-ray microscopies

Puzic, A., Stoll, H., Fischer, P., Van Waeyenberge, B., Raabe, J., Denbeaux, G., Haug, T., Weiss, D., Schütz, G.

In T115, pages: 1029-1031, Malmö/Lund, Sweden, 2005 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Learning to Feel the Physics of a Body

Der, R., Hesse, F., Martius, G.

In Computational Intelligence for Modelling, Control and Automation, CIMCA 2005 , 2, pages: 252-257, Washington, DC, USA, 2005 (inproceedings)

Abstract
Despite the tremendous progress in robotic hardware and in both sensorial and computing efficiencies the performance of contemporary autonomous robots is still far below that of simple animals. This has triggered an intensive search for alternative approaches to the control of robots. The present paper exemplifies a general approach to the self-organization of behavior which has been developed and tested in various examples in recent years. We apply this approach to an underactuated snake like artifact with a complex physical behavior which is not known to the controller. Due to the weak forces available, the controller so to say has to develop a kind of feeling for the body which is seen to emerge from our approach in a natural way with meandering and rotational collective modes being observed in computer simulation experiments.

al

[BibTex]

[BibTex]

2004


no image
High-speed dynamics of magnetization processes in hard magnetic particles and thin platelets

Goll, D., Kronmüller, H.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 465-469, Laboratoire de Cristallographie/Laboratoire Louis Neel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

2004


[BibTex]


no image
High-speed dynamics of magnetization processes in hard magnetic particles and thin platelets

Goll, D., Kronmüller, H.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 465-469, Laboratoire de Cristallographie/Laboratoire Louis Neel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Modern nanocrystalline/nanostructured hard magnetic materials

Kronmüller, H., Goll, D.

In 272-276, pages: e319-e320, Rome [Italy], 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Modern nanostructured high-temperature permanent magnets

Goll, D., Kronmüller, H., Stadelmaier, H. H.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 578-583, Laboratoire de Cristallographie/Laboratoire Louis Néel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Imaging sub-ns spin dynamics in magnetic nanostructures with magnetic transmission X-ray microscopy

Fischer, P., Stoll, H., Puzic, A., Van Waeyenberge, B., Raabe, J., Haug, T., Denbeaux, G., Pearson, A., Höllinger, R., Back, C. H., Weiss, D., Schütz, G.

In Synchrotron Radiation Instrumentation, 705, pages: 1291-1294, AIP Conference Proceedings, American Institute of Physics, San Francisco, California (USA), 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Modern nanostructured high-temperature permanent magnets

Goll, D., Kronmüller, H., Stadelmaier, H. H.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 578-583, Laboratoire de Cristallographie/Laboratoire Louis Néel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Existence of transient temperature spike induced by SHI: evidence by ion beam analysis

Avasthi, D. K., Ghosh, S., Srivastava, S. K., Assmann, W.

In 219-220, pages: 206-214, Albuquerque, NM [USA], 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Hard magnetic hollow nanospheres

Goll, D., Berkowitz, A. E., Bertram, H. N.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 704-707, Laboratoire de Cristallographie/Laboratoire Louis Neel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]