Header logo is


2017


Thumb xl fig toyex lqr1kernel 1
On the Design of LQR Kernels for Efficient Controller Learning

Marco, A., Hennig, P., Schaal, S., Trimpe, S.

Proceedings of the 56th IEEE Annual Conference on Decision and Control (CDC), pages: 5193-5200, IEEE, IEEE Conference on Decision and Control, December 2017 (conference)

Abstract
Finding optimal feedback controllers for nonlinear dynamic systems from data is hard. Recently, Bayesian optimization (BO) has been proposed as a powerful framework for direct controller tuning from experimental trials. For selecting the next query point and finding the global optimum, BO relies on a probabilistic description of the latent objective function, typically a Gaussian process (GP). As is shown herein, GPs with a common kernel choice can, however, lead to poor learning outcomes on standard quadratic control problems. For a first-order system, we construct two kernels that specifically leverage the structure of the well-known Linear Quadratic Regulator (LQR), yet retain the flexibility of Bayesian nonparametric learning. Simulations of uncertain linear and nonlinear systems demonstrate that the LQR kernels yield superior learning performance.

am ics pn

arXiv PDF On the Design of LQR Kernels for Efficient Controller Learning - CDC presentation DOI Project Page [BibTex]

2017


arXiv PDF On the Design of LQR Kernels for Efficient Controller Learning - CDC presentation DOI Project Page [BibTex]


Thumb xl teaser
Coupling Adaptive Batch Sizes with Learning Rates

Balles, L., Romero, J., Hennig, P.

In Proceedings Conference on Uncertainty in Artificial Intelligence (UAI) 2017, pages: 410-419, (Editors: Gal Elidan and Kristian Kersting), Association for Uncertainty in Artificial Intelligence (AUAI), Conference on Uncertainty in Artificial Intelligence (UAI), August 2017 (inproceedings)

Abstract
Mini-batch stochastic gradient descent and variants thereof have become standard for large-scale empirical risk minimization like the training of neural networks. These methods are usually used with a constant batch size chosen by simple empirical inspection. The batch size significantly influences the behavior of the stochastic optimization algorithm, though, since it determines the variance of the gradient estimates. This variance also changes over the optimization process; when using a constant batch size, stability and convergence is thus often enforced by means of a (manually tuned) decreasing learning rate schedule. We propose a practical method for dynamic batch size adaptation. It estimates the variance of the stochastic gradients and adapts the batch size to decrease the variance proportionally to the value of the objective function, removing the need for the aforementioned learning rate decrease. In contrast to recent related work, our algorithm couples the batch size to the learning rate, directly reflecting the known relationship between the two. On three image classification benchmarks, our batch size adaptation yields faster optimization convergence, while simultaneously simplifying learning rate tuning. A TensorFlow implementation is available.

ps pn

Code link (url) Project Page [BibTex]

Code link (url) Project Page [BibTex]


no image
Dynamic Time-of-Flight

Schober, M., Adam, A., Yair, O., Mazor, S., Nowozin, S.

Proceedings IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017, pages: 170-179, IEEE, Piscataway, NJ, USA, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017 (conference)

ei pn

DOI [BibTex]

DOI [BibTex]


Thumb xl this one
Virtual vs. Real: Trading Off Simulations and Physical Experiments in Reinforcement Learning with Bayesian Optimization

Marco, A., Berkenkamp, F., Hennig, P., Schoellig, A. P., Krause, A., Schaal, S., Trimpe, S.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pages: 1557-1563, IEEE, Piscataway, NJ, USA, IEEE International Conference on Robotics and Automation (ICRA), May 2017 (inproceedings)

am ics pn

PDF arXiv ICRA 2017 Spotlight presentation Virtual vs. Real - Video explanation DOI Project Page [BibTex]

PDF arXiv ICRA 2017 Spotlight presentation Virtual vs. Real - Video explanation DOI Project Page [BibTex]


Thumb xl screen shot 2017 07 20 at 12.31.00 pm
Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasets

Klein, A., Falkner, S., Bartels, S., Hennig, P., Hutter, F.

Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS 2017), 54, pages: 528-536, Proceedings of Machine Learning Research, (Editors: Sign, Aarti and Zhu, Jerry), PMLR, April 2017 (conference)

pn

pdf link (url) Project Page [BibTex]

pdf link (url) Project Page [BibTex]


no image
Understanding FORC using synthetic micro-structured systems with variable coupling- and coercivefield distributions

Groß, Felix

Universität Stuttgart, Stuttgart, 2017 (mastersthesis)

mms

[BibTex]


no image
Adsorption von Wasserstoffmolekülen in nanoporösen Gerüststrukturen

Kotzur, Nadine

Universität Stuttgart, Stuttgart, 2017 (mastersthesis)

mms

[BibTex]

[BibTex]

2008


no image
Ab-initio Elektronentheorie der magnetischen Anisotropie im System FePt mit der Clusterentwicklungsmethode

Subkow, S.

Universität Stuttgart, Stuttgart, 2008 (mastersthesis)

mms

[BibTex]

2008



no image
Magnetism of amorphous and highly anisotropic multilayer systems on flat substrates and nanospheres

Amaladass, E. P.

Universität Stuttgart, Stuttgart, 2008 (phdthesis)

mms

link (url) [BibTex]


no image
Wetting and premelting of triple junctions and grain boundaries in the Al-Zn alloys

Straumal, B., Kogtenkova, O., Protasova, S., Mazilkin, A., Zieba, P., Czeppe, T., Wojewoda-Budka, J., Faryna, M.

In 495, pages: 126-131, Alicante, Spain, 2008 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Bose-Theorie der Dämpfung der Bewegung einer magnetischen Domänenwand

Hähnel, D.

Universität Stuttgart, Stuttgart, 2008 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
GdFe-Multilagen zur Vergrö\sserung des magnetischen Vortexkerns

Sackmann, V.

Universität Stuttgart, Stuttgart, 2008 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Dissipative Magnetisierungsdynamik: Ein Zugang über die ab-initio Elektronentheorie

Steiauf, D.

Universität Stuttgart, Stuttgart, 2008 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Röntgenzirkulardichroische Untersuchungen XMCD an FePt und Ferrit Nanopartikeln

Nolle, D.

Universität Stuttgart, Stuttgart, 2008 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Nanostructured biointerfaces for investigating cellular adhesion and differentiation

Gojak, C.

Universität Heidelberg, Heidelberg, 2008 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Study of the intermixing of Fe\textendashPt multilayers by analytical and high-resolution transmission electron microscopy

Sigle, W., Kaiser, T., Goll, D., Goo, N. H., Srot, V., van Aken, P. A., Detemple, E., Jäger, W.

In EMC2008, 14th European Microscopy Congress, Vol. 2: Materials Science, pages: 109-110, Springer, Aachen, Germany, 2008 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]

2005


no image
Untersuchung über die Grenzflächenmagnetisierung an (FM) Kobalt- und (AFM) Eisen-Mangan-Schichten

Harlander, M.

Stuttgart, Universität Stuttgart, 2005 (mastersthesis)

mms

[BibTex]

2005


[BibTex]


no image
Magnetization reversal behavior of nanogranular CoCrPt alloy thin films studied with magnetic transmission X-ray microscopy

Fischer, P., Im, M., Eimüller, T., Schütz, G., Shin, S.

In 286, pages: 311-314, Boulder, CO, USA, 2005 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Defects distribution of Pr2Fe14B hard magnetic magnet from amorphous to nanostructures characterized by positron annihilation spectroscopy

Wu, Y. C., Sprengel, W., Reimann, K., Reichle, K. J., Goll, D., Würschum, R., Schaefer, H. E.

In PRICM 5. Proceedings of the Fifth Pacific RIM International Conference on Advanced Materials and Processing, 475-479, pages: 2123-2126, Materials Science Forum, Trans Tech, Beijing, China, 2005 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Implementing sub-ns time resolution into magnetic X-ray microscopies

Puzic, A., Stoll, H., Fischer, P., Van Waeyenberge, B., Raabe, J., Denbeaux, G., Haug, T., Weiss, D., Schütz, G.

In T115, pages: 1029-1031, Malmö/Lund, Sweden, 2005 (inproceedings)

mms

[BibTex]

[BibTex]

2002


no image
Pressure Isotherms of Hydrogen Adsorption in Carbon Nanostructures

Chen, X., Dettlaff-Weglikowska, U., Haluska, M., Hulman, M., Roth, S., Hirscher, M., Becher, M.

In Making Functional Materials with Nanotubes, pages: Z9.11.1-Z9.11.6, Materials Research Society Symposium Proceedings, MRS, Boston [Mass.], 2002 (inproceedings)

mms

[BibTex]

2002


[BibTex]


no image
Untersuchungen zur Spindynamik in nanostrukturierten ferromagnetischen Schichtsystemen

Puzic, A.

Universität Stuttgart, Stuttgart, 2002 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Hydrogen Storage in Carbon SWNTs: Atomic or Molecular?

Haluska, M., Hirscher, M., Becher, M., Dettlaff-Weglikowska, U., Chen, X., Roth, S.

In Structural and Electronic Properties of Molecular Nanostructures, pages: 601-605, AIP Conference Proceedings, AIP, Kirchberg, Tirol [Austria], 2002 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Magnetic Imaging of Nanostructured Systems with Transmission X-Ray Microscopy

Eimüller, T.

Bayrische Julius-Maximilians-Universität Würzburg, Würzburg, 2002 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Ab-initio Berechnung der Spinwellenspektren von Eisen, Kobalt und Nickel

Grotheer, O.

Universität Stuttgart, Stuttgart, 2002 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Kernspinresonanzuntersuchungen zur Diffusion von Wasserstoff in kubischen Lavesphasen

Eberle, U.

Universität Stuttgart, Stuttgart, 2002 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Hydrogen Storage in Nanostructured Carbon Materials at Room Temperature

Chen, X., Dettlaff-Weglikowska, U., Haluska, M., Hirscher, M., Becher, M., Roth, S.

In Structural and Electronic Properties of Molecular Nanostructures, pages: 597-600, AIP Conference Proceedings, AIP, Kirchberg, Tirol [Austria], 2002 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Micromagnetism and the microstructure of the cell walls in Sm2Co17 based permanent magnets

Goll, D., Hadjipanayis, G. C., Kronmüller, H.

In Proceedings of the 17th International Workshop on Rare-Earth Magnets and their Applications, pages: 696-703, Rinton Press, Newark, Delaware, USA, 2002 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Ab-initio study of the influence of epitaxial strain on magnetoelastic properties

Komelj, M., Fähnle, M.

In Atomistic Aspects of Epitaxial Growth, pages: 439-447, NATO Science series: Series 2, Mathematics, Physics, and Chemistry, Kluwer Academic Publishers, Dassia, Corfu [Greece], 2002 (inproceedings)

mms

[BibTex]

[BibTex]