Header logo is


2018


no image
Kernel Recursive ABC: Point Estimation with Intractable Likelihood

Kajihara, T., Kanagawa, M., Yamazaki, K., Fukumizu, K.

Proceedings of the 35th International Conference on Machine Learning, pages: 2405-2414, PMLR, July 2018 (conference)

Abstract
We propose a novel approach to parameter estimation for simulator-based statistical models with intractable likelihood. Our proposed method involves recursive application of kernel ABC and kernel herding to the same observed data. We provide a theoretical explanation regarding why the approach works, showing (for the population setting) that, under a certain assumption, point estimates obtained with this method converge to the true parameter, as recursion proceeds. We have conducted a variety of numerical experiments, including parameter estimation for a real-world pedestrian flow simulator, and show that in most cases our method outperforms existing approaches.

pn

Paper [BibTex]

2018


Paper [BibTex]


no image
Counterfactual Mean Embedding: A Kernel Method for Nonparametric Causal Inference

Muandet, K., Kanagawa, M., Saengkyongam, S., Marukata, S.

Workshop on Machine Learning for Causal Inference, Counterfactual Prediction, and Autonomous Action (CausalML) at ICML, July 2018 (conference)

ei pn

[BibTex]

[BibTex]


Dissecting Adam: The Sign, Magnitude and Variance of Stochastic Gradients
Dissecting Adam: The Sign, Magnitude and Variance of Stochastic Gradients

Balles, L., Hennig, P.

In Proceedings of the 35th International Conference on Machine Learning (ICML), 2018 (inproceedings) Accepted

Abstract
The ADAM optimizer is exceedingly popular in the deep learning community. Often it works very well, sometimes it doesn't. Why? We interpret ADAM as a combination of two aspects: for each weight, the update direction is determined by the sign of stochastic gradients, whereas the update magnitude is determined by an estimate of their relative variance. We disentangle these two aspects and analyze them in isolation, gaining insight into the mechanisms underlying ADAM. This analysis also extends recent results on adverse effects of ADAM on generalization, isolating the sign aspect as the problematic one. Transferring the variance adaptation to SGD gives rise to a novel method, completing the practitioner's toolbox for problems where ADAM fails.

pn

link (url) Project Page [BibTex]

link (url) Project Page [BibTex]


no image
Direct observations of sub-100 nm spin wave propagation in magnonic wave-guides

Träger, N., Gruszecki, P., Lisiecki, F., Förster, J., Weigand, M., Kuswik, P., Dubowik, J., Schütz, G., Krawczyk, M., Gräfe, J.

In 2018 IEEE International Magnetics Conference (INTERMAG 2018), IEEE, Singapore, 2018 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Interpreting FORC diagrams beyond the Preisach model: an experimental permalloy micro array investigation

Gross, F., Ilse, S., Schütz, G., Gräfe, J., Goering, E.

In 2018 IEEE International Magnetics Conference (INTERMAG 2018), IEEE, Singapore, 2018 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]

2012


Quasi-Newton Methods: A New Direction
Quasi-Newton Methods: A New Direction

Hennig, P., Kiefel, M.

In Proceedings of the 29th International Conference on Machine Learning, pages: 25-32, ICML ’12, (Editors: John Langford and Joelle Pineau), Omnipress, New York, NY, USA, ICML, July 2012 (inproceedings)

Abstract
Four decades after their invention, quasi- Newton methods are still state of the art in unconstrained numerical optimization. Although not usually interpreted thus, these are learning algorithms that fit a local quadratic approximation to the objective function. We show that many, including the most popular, quasi-Newton methods can be interpreted as approximations of Bayesian linear regression under varying prior assumptions. This new notion elucidates some shortcomings of classical algorithms, and lights the way to a novel nonparametric quasi-Newton method, which is able to make more efficient use of available information at computational cost similar to its predecessors.

ei ps pn

website+code pdf link (url) [BibTex]

2012


website+code pdf link (url) [BibTex]


no image
Learning Tracking Control with Forward Models

Bócsi, B., Hennig, P., Csató, L., Peters, J.

In pages: 259 -264, IEEE International Conference on Robotics and Automation (ICRA), May 2012 (inproceedings)

Abstract
Performing task-space tracking control on redundant robot manipulators is a difficult problem. When the physical model of the robot is too complex or not available, standard methods fail and machine learning algorithms can have advantages. We propose an adaptive learning algorithm for tracking control of underactuated or non-rigid robots where the physical model of the robot is unavailable. The control method is based on the fact that forward models are relatively straightforward to learn and local inversions can be obtained via local optimization. We use sparse online Gaussian process inference to obtain a flexible probabilistic forward model and second order optimization to find the inverse mapping. Physical experiments indicate that this approach can outperform state-of-the-art tracking control algorithms in this context.

ei pn

PDF Web DOI [BibTex]

PDF Web DOI [BibTex]


no image
Approximate Gaussian Integration using Expectation Propagation

Cunningham, J., Hennig, P., Lacoste-Julien, S.

In pages: 1-11, -, January 2012 (inproceedings) Submitted

Abstract
While Gaussian probability densities are omnipresent in applied mathematics, Gaussian cumulative probabilities are hard to calculate in any but the univariate case. We offer here an empirical study of the utility of Expectation Propagation (EP) as an approximate integration method for this problem. For rectangular integration regions, the approximation is highly accurate. We also extend the derivations to the more general case of polyhedral integration regions. However, we find that in this polyhedral case, EP's answer, though often accurate, can be almost arbitrarily wrong. These unexpected results elucidate an interesting and non-obvious feature of EP not yet studied in detail, both for the problem of Gaussian probabilities and for EP more generally.

ei pn

Web [BibTex]

Web [BibTex]


no image
Kernel Topic Models

Hennig, P., Stern, D., Herbrich, R., Graepel, T.

In Fifteenth International Conference on Artificial Intelligence and Statistics, 22, pages: 511-519, JMLR Proceedings, (Editors: Lawrence, N. D. and Girolami, M.), JMLR.org, AISTATS , 2012 (inproceedings)

Abstract
Latent Dirichlet Allocation models discrete data as a mixture of discrete distributions, using Dirichlet beliefs over the mixture weights. We study a variation of this concept, in which the documents' mixture weight beliefs are replaced with squashed Gaussian distributions. This allows documents to be associated with elements of a Hilbert space, admitting kernel topic models (KTM), modelling temporal, spatial, hierarchical, social and other structure between documents. The main challenge is efficient approximate inference on the latent Gaussian. We present an approximate algorithm cast around a Laplace approximation in a transformed basis. The KTM can also be interpreted as a type of Gaussian process latent variable model, or as a topic model conditional on document features, uncovering links between earlier work in these areas.

ei pn

PDF Web [BibTex]

PDF Web [BibTex]


no image
Spin wave mediated magnetic vortex core reversal

Stoll, H.

In 8461, San Diego, California, USA, 2012 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]

2005


no image
Magnetization reversal behavior of nanogranular CoCrPt alloy thin films studied with magnetic transmission X-ray microscopy

Fischer, P., Im, M., Eimüller, T., Schütz, G., Shin, S.

In 286, pages: 311-314, Boulder, CO, USA, 2005 (inproceedings)

mms

[BibTex]

2005


[BibTex]


no image
Defects distribution of Pr2Fe14B hard magnetic magnet from amorphous to nanostructures characterized by positron annihilation spectroscopy

Wu, Y. C., Sprengel, W., Reimann, K., Reichle, K. J., Goll, D., Würschum, R., Schaefer, H. E.

In PRICM 5. Proceedings of the Fifth Pacific RIM International Conference on Advanced Materials and Processing, 475-479, pages: 2123-2126, Materials Science Forum, Trans Tech, Beijing, China, 2005 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Implementing sub-ns time resolution into magnetic X-ray microscopies

Puzic, A., Stoll, H., Fischer, P., Van Waeyenberge, B., Raabe, J., Denbeaux, G., Haug, T., Weiss, D., Schütz, G.

In T115, pages: 1029-1031, Malmö/Lund, Sweden, 2005 (inproceedings)

mms

[BibTex]

[BibTex]

2002


no image
Pressure Isotherms of Hydrogen Adsorption in Carbon Nanostructures

Chen, X., Dettlaff-Weglikowska, U., Haluska, M., Hulman, M., Roth, S., Hirscher, M., Becher, M.

In Making Functional Materials with Nanotubes, pages: Z9.11.1-Z9.11.6, Materials Research Society Symposium Proceedings, MRS, Boston [Mass.], 2002 (inproceedings)

mms

[BibTex]

2002


[BibTex]


no image
Hydrogen Storage in Carbon SWNTs: Atomic or Molecular?

Haluska, M., Hirscher, M., Becher, M., Dettlaff-Weglikowska, U., Chen, X., Roth, S.

In Structural and Electronic Properties of Molecular Nanostructures, pages: 601-605, AIP Conference Proceedings, AIP, Kirchberg, Tirol [Austria], 2002 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Hydrogen Storage in Nanostructured Carbon Materials at Room Temperature

Chen, X., Dettlaff-Weglikowska, U., Haluska, M., Hirscher, M., Becher, M., Roth, S.

In Structural and Electronic Properties of Molecular Nanostructures, pages: 597-600, AIP Conference Proceedings, AIP, Kirchberg, Tirol [Austria], 2002 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Micromagnetism and the microstructure of the cell walls in Sm2Co17 based permanent magnets

Goll, D., Hadjipanayis, G. C., Kronmüller, H.

In Proceedings of the 17th International Workshop on Rare-Earth Magnets and their Applications, pages: 696-703, Rinton Press, Newark, Delaware, USA, 2002 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Ab-initio study of the influence of epitaxial strain on magnetoelastic properties

Komelj, M., Fähnle, M.

In Atomistic Aspects of Epitaxial Growth, pages: 439-447, NATO Science series: Series 2, Mathematics, Physics, and Chemistry, Kluwer Academic Publishers, Dassia, Corfu [Greece], 2002 (inproceedings)

mms

[BibTex]

[BibTex]

2001


no image
Computational micromagnetism of magnetic structures and magnetization processes in thin plantelets and small particles

Kronmüller, H., Hertel, R.

In Magnetic Storage Sstems Beyond 2000, 41, pages: 345-362, Nato Science Series II: Mathematics, Physics and Chemistry, Kluwer Academic Publishers, Rhodos, Greece, 2001 (inproceedings)

mms

[BibTex]

2001


[BibTex]


no image
Hydrogen storage in mechanically treated single wall carbon nanotrubes

Haluska, M., Hulman, M., Hirscher, M., Becher, M., Roth, S., Stepanek, I., Bernier, P.

In Electronic Properties of Molecular Nanostructures: XV International Winterschool/Euroconference, 591, pages: 603-608, American Institute of Physics Conference Proceedings, AIP, Kirchberg [Austria], 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Isotopic mass and lattice constant of Si and Ge: X-Ray standing wave measurements

Zegenhagen, J., Kazimirov, A., Cao, L. X., Konuma, M., Sozontov, E., Plachke, D., Carstanjen, H. D., Bilger, G., Haller, E., Kohn, V., Cardona, M.

In Proceedings of the 25th Conference on the Physics of Semiconductors, 87, pages: 125-127, Springer proceedings in physics, Springer, Osaka, Japan, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Positron Annihilation Studies on Stable and Undercooled Metal Melts at the Stuttgart Pelletron

Stoll, H., Siegle, A., Major, J.

In Application of Accelerators in Research and Industry, 576, pages: 749-752, AIP Conference Proceedings, Denton, Texas, USA, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Submicrometer spatially resolved measurements of mechanical properties and correlation to microstructure and composition

Kunert, M., Baretzky, B., Baker, S. P., Mittemeijer, E. J.

In Fundamentals of Nanoindentation and Nanotribology II, 649, pages: Q3.2.1-Q3.2.6, Materials Research Society Symposium Proceedings, MRS, Boston, MA, USA, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
The six-jump diffusion cycles in B2-compounds

Drautz, R., Meyer, B., Fähnle, M.

In Proceedings of DIMAT 2000, the Fifth International Conference on Diffusion in Materials, pages: 417-422, Defect and Diffusion Forum, Scitec Publications Ltd., Paris, France, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Ionic nitriding of austenitic and ferritic steel with the aid of a high aperture hall current accelerator

Straumal, B. B., Vershinin, N. F., Friesel, M., Ishenko, S. A., Gust, W.

In Diffusion in Materials DIMAT2000, 194, pages: 1457-1462, Defect and Diffusion Forum, Trans Tech, Paris, France, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
First proof of slow trapping of positronium in polymers by an Age-Momentum-Correlation (AMOC) experiment

Dauwe, C., Balcaen, N., van Waeyenberge, B., van Petegem, S., Stoll, H.

In Positron Annihilation. Proceedings of the 12th International Conference on Positron Annihilation, 363/365, pages: 254-256, Materials Science Forum, Trans Tech Publications Ltd., München, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Positron-age-momentum correlation

Stoll, H., Bandzuch, P., Siegle, A.

In Positron Annihilation: Proceedings of the 12th International Conference on Positron Annihilation, 363-365, pages: 547-551, Materials Science Forum, Trans Tech Publications Ltd., München, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Nanocrystalline and nanostructured high-performance permanent magnets

Goll, D., Hadjipanayis, G. C., Kronmüller, H.

In Applications of Ferromagnetic and Optical Materials, Storage and Magnetoelectronics, 674, pages: U2.4.1-U2.4.12, Materials Research Society Symposium Proceedings, MRS, San Francisco, Calif., 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Ion beam analysis with monolayer depth resolution using the electrostatic spectrometer at the MPI Stuttgart

Plachke, D., Blohm, G., Fischer, T., Khellaf, A., Kruse, O., Stoll, H., Carstanjen, H. D.

In Proceedings of the 16th International Conference on Applications of Accelerators in Research and Industry, 576, pages: 458-462, American Institute of Physics Conference Proceedings, AIP, Denton, Texas, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
From the electronic structure to the macroscopiy behavior: A multi-scale analysis of plasticity in intermetallic compounds

Fähnle, M., Kohlhammer, S., Bester, G.

In Influences of Interface and Dislocation Behavior on Microstructure Evolution, 652, pages: Y4.5.1.-Y4.5.12, Materials Research Society Symposium Proceedings, MRS, Boston, Mass., USA, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Influence of the microstructure on the magnetic properties of giant-magnetostrictive TbDyFe films

Hirscher, M., Winzek, B., Fischer, S. F., Kronmüller, H.

In Smart Materials. Proceedings of the 1st Caesarium, pages: 23-37, Springer, Bonn, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Materials analysis with monolayer depth resolution using MeV ion beams

Carstanjen, H. D.

In 117, Las Vegas, USA, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Flux-line pinning in low-angle grain boundaries.

Albrecht, J., Leonhardt, S., Kronmüller, H.

In Proceedings 10th International Workshop on Critical Currents (IWCC 2001), pages: 41-43, Göttingen, Germany, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Measurement of the low-temperature self-diffusivity of lithium by elastic recoil detection analysis

Wieland, O., Carstanjen, H. D.

In Proceedings of DIMAT 2000, the Fifth International Conference on Diffusion in Materials, 194/199, pages: 35-41, Defect and Diffusion Forum, Scitec Publications Ltd., Paris, France, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
From the electronic structure to the macroscopic behaviour: a multi-scale analysis of plasticity in intermetallic compounds

Fähnle, M., Kohlhammer, S., Bester, G.

In Influences of Interface and Dislocation Behavior on Microstructure Evolution, 652, pages: Y.4.5.1-Y.4.5.12, Materials Research Society Symposium Proceedings, MRS, Boston, Mass., 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Enhancement of the critical current density of YBa2Cu3O7-8-films by substracte irradiation

Leonhardt, S., Albrecht, J., Warthmann, R., Kronmüller, H.

In High-Tc Superconductors and Related Applications: Materials Science, Fundamental Properties, and Some Future Electronic Applications. Proceedings of the NATO Advanced Study Institute, 86, pages: 529-534, NATO Science Series 3. High Technology, Kluwer Academic Publishers, Albena, Bulgaria, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
AMOC studies of positronium in fine MgO powder

van Waeyenberge, B., Dauwe, C., Stoll, H.

In Positron Annihilation. Proceedings of the 12th International Conference on Positron Annihilation, 363/365, pages: 401-403, Materials Science Forum, Trans Tech Publications Ltd., München, 2001 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Atomic defects and electronic structure of B2-FeAl, CoAl and NiAl

Fähnle, M., Meyer, B., Bester, G., Majer, J., Börnsen, N.

In Proceedings of DIMAT 2000, the Fifth International Conference on Diffusion in Materials, 194/199, pages: 279-285, Defect and Diffusion Forum, Scitec Publications Ltd., Paris, France, 2001 (inproceedings)

mms

[BibTex]

[BibTex]