Publications | Max Planck Institute for Intelligent Systems

269 results (View BibTeX file of all listed publications)

2016

Decision-Making under Ambiguity Is Modulated by Visual Framing, but Not by Motor vs. Non-Motor Context: Experiments and an Information-Theoretic Ambiguity Model

Grau-Moya, J, Ortega, PA, Braun, DA

PLoS ONE, 11(4):1-21, April 2016 (article)

Abstract

A number of recent studies have investigated differences in human choice behavior depending on task framing, especially comparing economic decision-making to choice behavior in equivalent sensorimotor tasks. Here we test whether decision-making under ambiguity exhibits effects of task framing in motor vs. non-motor context. In a first experiment, we designed an experience-based urn task with varying degrees of ambiguity and an equivalent motor task where subjects chose between hitting partially occluded targets. In a second experiment, we controlled for the different stimulus design in the two tasks by introducing an urn task with bar stimuli matching those in the motor task. We found ambiguity attitudes to be mainly influenced by stimulus design. In particular, we found that the same subjects tended to be ambiguity-preferring when choosing between ambiguous bar stimuli, but ambiguity-avoiding when choosing between ambiguous urn sample stimuli. In contrast, subjects’ choice pattern was not affected by changing from a target hitting task to a non-motor context when keeping the stimulus design unchanged. In both tasks subjects’ choice behavior was continuously modulated by the degree of ambiguity. We show that this modulation of behavior can be explained by an information-theoretic model of ambiguity that generalizes Bayes-optimal decision-making by combining Bayesian inference with robust decision-making under model uncertainty. Our results demonstrate the benefits of information-theoretic models of decision-making under varying degrees of ambiguity for a given context, but also demonstrate the sensitivity of ambiguity attitudes across contexts that theoretical models struggle to explain.

DOI [BibTex]

2016

ei Grau-Moya, J, Ortega, PA, Braun, DA Decision-Making under Ambiguity Is Modulated by Visual Framing, but Not by Motor vs. Non-Motor Context: Experiments and an Information-Theoretic Ambiguity Model PLoS ONE, 11(4):1-21, April 2016 (article)

DOI [BibTex]

Austauschgekoppelte Moden in magnetischen Vortexstrukturen

Dieterle, G.

Universität Stuttgart, Stuttgart, 2016 (phdthesis)

mms

[BibTex]

mms Dieterle, G. Austauschgekoppelte Moden in magnetischen Vortexstrukturen Universität Stuttgart, Stuttgart, 2016 (phdthesis)

[BibTex]

Density matrix calculations for the ultrafast demagnetization after femtosecond laser pulses

Weng, Weikai

Universität Stuttgart, Stuttgart, 2016 (mastersthesis)

mms

[BibTex]

mms Weng, Weikai Density matrix calculations for the ultrafast demagnetization after femtosecond laser pulses Universität Stuttgart, Stuttgart, 2016 (mastersthesis)

[BibTex]

Electric field manipulation of perpendicular magnetic anisotropy in microstructured Cobalt-Iron-Boron Magnesium Oxide thin film systems

Bauch, J.

Universität Stuttgart, Stuttgart, 2016 (mastersthesis)

mms

[BibTex]

mms Bauch, J. Electric field manipulation of perpendicular magnetic anisotropy in microstructured Cobalt-Iron-Boron Magnesium Oxide thin film systems Universität Stuttgart, Stuttgart, 2016 (mastersthesis)

[BibTex]

Outlook and challenges for hydrogen storage in nanoporous materials

Broom, D. P., Webb, C. J., Hurst, K. E., Parilla, P. A., Gennett, T., Brown, C. M., Zacharia, R., Tylianakis, E., Klontzas, E., Froudakis, G. E., Steriotis, T. A., Trikalitis, P. N., Anton, D. L., Hardy, B., Tamburello, D., Corgnale, C., van Hassel, B. A., Cossement, D., Chahine, R., Hirscher, M.

{Applied Physics A}, 122(3), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

mms

DOI [BibTex]

mms Broom, D. P., Webb, C. J., Hurst, K. E., Parilla, P. A., Gennett, T., Brown, C. M., Zacharia, R., Tylianakis, E., Klontzas, E., Froudakis, G. E., Steriotis, T. A., Trikalitis, P. N., Anton, D. L., Hardy, B., Tamburello, D., Corgnale, C., van Hassel, B. A., Cossement, D., Chahine, R., Hirscher, M. Outlook and challenges for hydrogen storage in nanoporous materials {Applied Physics A}, 122(3), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

DOI [BibTex]

Quantum sieving for separation of hydrogen isotopes using MOFs

Oh, H., Hirscher, M.

{European Journal of Inorganic Chemistry}, 2016(27):4278-4289, Wiley-VCH, Weinheim, Germany, 2016 (article)

mms

DOI [BibTex]

mms Oh, H., Hirscher, M. Quantum sieving for separation of hydrogen isotopes using MOFs {European Journal of Inorganic Chemistry}, 2016(27):4278-4289, Wiley-VCH, Weinheim, Germany, 2016 (article)

DOI [BibTex]

Direct patterning of vortex generators on a fiber tip using a focused ion beam

Vayalamkuzhi, P., Bhattacharya, S., Eigenthaler, U., Keskinbora, K., Salman, C. T., Hirscher, M., Spatz, J. P., Viswanathan, N. K.

{Optics Letters}, 41(10):2133-2136, Optical Society of America, Washington, 2016 (article)

mms

DOI [BibTex]

mms Vayalamkuzhi, P., Bhattacharya, S., Eigenthaler, U., Keskinbora, K., Salman, C. T., Hirscher, M., Spatz, J. P., Viswanathan, N. K. Direct patterning of vortex generators on a fiber tip using a focused ion beam {Optics Letters}, 41(10):2133-2136, Optical Society of America, Washington, 2016 (article)

DOI [BibTex]

Two-body problem of core-region coupled magnetic vortex stacks

Hänze, M., Adolff, C. F., Velten, S., Weigand, M., Meier, G.

{Physical Review B}, 93(5), American Physical Society, Woodbury, NY, 2016 (article)

mms

DOI [BibTex]

mms Hänze, M., Adolff, C. F., Velten, S., Weigand, M., Meier, G. Two-body problem of core-region coupled magnetic vortex stacks {Physical Review B}, 93(5), American Physical Society, Woodbury, NY, 2016 (article)

DOI [BibTex]

Irreproducibility in hydrogen storage material research

Broom, D. P., Hirscher, M.

{Energy \& Environmental Science}, 9(11):3368-3380, Royal Society of Chemistry, Cambridge, UK, 2016 (article)

mms

DOI [BibTex]

mms Broom, D. P., Hirscher, M. Irreproducibility in hydrogen storage material research {Energy \& Environmental Science}, 9(11):3368-3380, Royal Society of Chemistry, Cambridge, UK, 2016 (article)

DOI [BibTex]

Effect of surface configurations on the room-temperature magnetism of pure ZnO

Chen, Y., Wang, Z., Leineweber, A., Baier, J., Tietze, T., Phillipp, F., Schütz, G., Goering, E.

{Journal of Materials Chemistry C}, 4(19):4166-4175, Royal Society of Chemistry, London, UK, 2016 (article)

mms

DOI [BibTex]

mms Chen, Y., Wang, Z., Leineweber, A., Baier, J., Tietze, T., Phillipp, F., Schütz, G., Goering, E. Effect of surface configurations on the room-temperature magnetism of pure ZnO {Journal of Materials Chemistry C}, 4(19):4166-4175, Royal Society of Chemistry, London, UK, 2016 (article)

DOI [BibTex]

On the synthesis and microstructure analysis of high performance MnBi

Chen, Y., Sawatzki, S., Ener, S., Sepehri-Amin, H., Leineweber, A., Gregori, G., Qu, F., Muralidhar, S., Ohkubo, T., Hono, K., Gutfleisch, O., Kronmüller, H., Schütz, G., Goering, E.

{AIP Advances}, 6(12), 2016 (article)

mms

DOI [BibTex]

mms Chen, Y., Sawatzki, S., Ener, S., Sepehri-Amin, H., Leineweber, A., Gregori, G., Qu, F., Muralidhar, S., Ohkubo, T., Hono, K., Gutfleisch, O., Kronmüller, H., Schütz, G., Goering, E. On the synthesis and microstructure analysis of high performance MnBi {AIP Advances}, 6(12), 2016 (article)

DOI [BibTex]

Deep Learning for Diabetic Retinopathy Diagnostics

Balles, Lukas

Heidelberg University, 2016 (mastersthesis)

[BibTex]

Balles, Lukas Deep Learning for Diabetic Retinopathy Diagnostics Heidelberg University, 2016 (mastersthesis)

[BibTex]

The role of individual defects on the magnetic screening of HTSC films

Ruoß, S., Stahl, C., Weigand, M., Zahn, P., Bayer, J., Schütz, G., Albrecht, J.

{New Journal of Physics}, 18(10), IOP Publishing, Bristol, 2016 (article)

mms

DOI [BibTex]

mms Ruoß, S., Stahl, C., Weigand, M., Zahn, P., Bayer, J., Schütz, G., Albrecht, J. The role of individual defects on the magnetic screening of HTSC films {New Journal of Physics}, 18(10), IOP Publishing, Bristol, 2016 (article)

DOI [BibTex]

Magnetic switching of nanoscale antidot lattices

Wiedwald, U., Gräfe, J., Lebecki, K. M., Skripnik, M., Haering, F., Schütz, G., Ziemann, P., Goering, E., Nowak, U.

{Beilstein Journal of Nanotechnology}, 7, pages: 733-750, Beilstein-Institut, Frankfurt am Main, 2016 (article)

mms

DOI Project Page [BibTex]

mms Wiedwald, U., Gräfe, J., Lebecki, K. M., Skripnik, M., Haering, F., Schütz, G., Ziemann, P., Goering, E., Nowak, U. Magnetic switching of nanoscale antidot lattices {Beilstein Journal of Nanotechnology}, 7, pages: 733-750, Beilstein-Institut, Frankfurt am Main, 2016 (article)

DOI Project Page [BibTex]

Hydrogen-based energy storage (IEA-HIA Task 32)

Buckley, C. E., Chen, P., van Hassel, B. A., Hirscher, M.

{Applied Physics A}, 122(2), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

mms

DOI [BibTex]

mms Buckley, C. E., Chen, P., van Hassel, B. A., Hirscher, M. Hydrogen-based energy storage (IEA-HIA Task 32) {Applied Physics A}, 122(2), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

DOI [BibTex]

Local domain-wall velocity engineering via tailored potential landscapes in ferromagnetic rings

Richter, K., Krone, A., Mawass, M., Krüger, B., Weigand, M., Stoll, H., Schütz, G., Kläui, M.

{Physical Review Applied}, 5(2), American Physical Society, College Park, Md. [u.a.], 2016 (article)

mms

DOI [BibTex]

mms Richter, K., Krone, A., Mawass, M., Krüger, B., Weigand, M., Stoll, H., Schütz, G., Kläui, M. Local domain-wall velocity engineering via tailored potential landscapes in ferromagnetic rings {Physical Review Applied}, 5(2), American Physical Society, College Park, Md. [u.a.], 2016 (article)

DOI [BibTex]

Geometric control of the magnetization reversal in antidot lattices with perpendicular magnetic anisotropy

Gräfe, J., Weigand, M., Träger, N., Schütz, G., Goering, E. J., Skripnik, M., Nowak, U., Haering, F., Ziemann, P., Wiedwald, U.

{Physical Review B}, 93(10), American Physical Society, Woodbury, NY, 2016 (article)

mms

DOI Project Page Project Page [BibTex]

mms Gräfe, J., Weigand, M., Träger, N., Schütz, G., Goering, E. J., Skripnik, M., Nowak, U., Haering, F., Ziemann, P., Wiedwald, U. Geometric control of the magnetization reversal in antidot lattices with perpendicular magnetic anisotropy {Physical Review B}, 93(10), American Physical Society, Woodbury, NY, 2016 (article)

DOI Project Page Project Page [BibTex]

Growth and characterizationof large weak topological insulator Bi2Tel single crystal by Bismuth self-flux method

Ryu, G., Son, K., Schütz, G.

{Journal of Crystal Growth}, 440, pages: 26-30, North-Holland, Amsterdam, 2016 (article)

mms

DOI [BibTex]

mms Ryu, G., Son, K., Schütz, G. Growth and characterizationof large weak topological insulator Bi2Tel single crystal by Bismuth self-flux method {Journal of Crystal Growth}, 440, pages: 26-30, North-Holland, Amsterdam, 2016 (article)

DOI [BibTex]

Additive interfacial chiral interaction in multilayers for stabilization of small individual skyrmions at room temperature

Moreau-Luchaire, C., Moutafis, C., Reyren, N., Sampaio, J., Vaz, C. A. F., Van Horne, N., Bouzehouane, K., Garcia, K., Deranlot, C., Warnicke, P., Wohlhüter, P., George, J.-M., Weigand, M., Raabe, J., Cros, V., Fert, A.

{Nature Nanotechnology}, 11(5):444-448, Nature Publishing Group, London, 2016 (article)

mms

DOI [BibTex]

mms Moreau-Luchaire, C., Moutafis, C., Reyren, N., Sampaio, J., Vaz, C. A. F., Van Horne, N., Bouzehouane, K., Garcia, K., Deranlot, C., Warnicke, P., Wohlhüter, P., George, J.-M., Weigand, M., Raabe, J., Cros, V., Fert, A. Additive interfacial chiral interaction in multilayers for stabilization of small individual skyrmions at room temperature {Nature Nanotechnology}, 11(5):444-448, Nature Publishing Group, London, 2016 (article)

DOI [BibTex]

Surface defect free growth of a spin dimer TlCuCl3 compound crystals and investigations on its optical and magnetic properties

Ryu, G., Son, K.

{Journal of Solid State Chemistry}, 237, pages: 358-363, Academic Press, Orlando, Fla., 2016 (article)

mms

DOI [BibTex]

mms Ryu, G., Son, K. Surface defect free growth of a spin dimer TlCuCl3 compound crystals and investigations on its optical and magnetic properties {Journal of Solid State Chemistry}, 237, pages: 358-363, Academic Press, Orlando, Fla., 2016 (article)

DOI [BibTex]

Physical and mathematical justification of the numerical Brillouin zone integration of the Boltzmann rate equation by Gaussian smearing

Illg, C., Haag, M., Teeny, N., Wirth, J., Fähnle, M.

{Journal of Theoretical and Applied Physics}, 10(1):1-6, Springer, Berlin, Heidelberg, Tehran, 2016 (article)

mms

DOI [BibTex]

mms Illg, C., Haag, M., Teeny, N., Wirth, J., Fähnle, M. Physical and mathematical justification of the numerical Brillouin zone integration of the Boltzmann rate equation by Gaussian smearing {Journal of Theoretical and Applied Physics}, 10(1):1-6, Springer, Berlin, Heidelberg, Tehran, 2016 (article)

DOI [BibTex]

Helium und Hydrogen Isotope Adsorption and Separation in Metal-Organic Frameworks

Zaiser, Ingrid

Universität Stuttgart, Stuttgart (und Cuvillier Verlag, Göttingen), 2016 (phdthesis)

mms

[BibTex]

mms Zaiser, Ingrid Helium und Hydrogen Isotope Adsorption and Separation in Metal-Organic Frameworks Universität Stuttgart, Stuttgart (und Cuvillier Verlag, Göttingen), 2016 (phdthesis)

[BibTex]

Pinned orbital moments - A new contribution to magnetic anisotropy

Audehm, P., Schmidt, M., Brück, S., Tietze, T., Gräfe, J., Macke, S., Schütz, G., Goering, E.

{Scientific Reports}, 6, Nature Publishing Group, London, UK, 2016 (article)

mms

DOI [BibTex]

mms Audehm, P., Schmidt, M., Brück, S., Tietze, T., Gräfe, J., Macke, S., Schütz, G., Goering, E. Pinned orbital moments - A new contribution to magnetic anisotropy {Scientific Reports}, 6, Nature Publishing Group, London, UK, 2016 (article)

DOI [BibTex]

Comparative study of ALD SiO2 thin films for optical applications

Pfeiffer, K., Shestaeva, S., Bingel, A., Munzert, P., Ghazaryan, L., van Helvoirt, C., Kessels, W. M. M., Sanli, U. T., Grévent, C., Schütz, G., Putkonen, M., Buchanan, I., Jensen, L., Ristau, D., Tünnermann, A., Szeghalmi, A.

{Optical materials express}, 6(2):660-670, OSA, Washington, DC, 2016 (article)

mms

DOI [BibTex]

mms Pfeiffer, K., Shestaeva, S., Bingel, A., Munzert, P., Ghazaryan, L., van Helvoirt, C., Kessels, W. M. M., Sanli, U. T., Grévent, C., Schütz, G., Putkonen, M., Buchanan, I., Jensen, L., Ristau, D., Tünnermann, A., Szeghalmi, A. Comparative study of ALD SiO2 thin films for optical applications {Optical materials express}, 6(2):660-670, OSA, Washington, DC, 2016 (article)

DOI [BibTex]

Combined first-order reversal curve and x-ray microscopy investigation of magnetization reversal mechanisms in hexagonal antidot lattices

Gräfe, J., Weigand, M., Stahl, C., Träger, N., Kopp, M., Schütz, G., Goering, E. J., Haering, F., Ziemann, P., Wiedwald, U.

{Physical Review B}, 93(1), American Physical Society, Woodbury, NY, 2016 (article)

mms

DOI Project Page Project Page [BibTex]

mms Gräfe, J., Weigand, M., Stahl, C., Träger, N., Kopp, M., Schütz, G., Goering, E. J., Haering, F., Ziemann, P., Wiedwald, U. Combined first-order reversal curve and x-ray microscopy investigation of magnetization reversal mechanisms in hexagonal antidot lattices {Physical Review B}, 93(1), American Physical Society, Woodbury, NY, 2016 (article)

DOI Project Page Project Page [BibTex]

Switching probabilities of magnetic vortex core reversal studied by table top magneto optic Kerr microscopy

Dieterle, G., Gangwar, A., Gräfe, J., Noske, M., Förster, J., Woltersdorf, G., Stoll, H., Back, C. H., Schütz, G.

{Applied Physics Letters}, 108(2), American Institute of Physics, Melville, NY, 2016 (article)

mms

DOI [BibTex]

mms Dieterle, G., Gangwar, A., Gräfe, J., Noske, M., Förster, J., Woltersdorf, G., Stoll, H., Back, C. H., Schütz, G. Switching probabilities of magnetic vortex core reversal studied by table top magneto optic Kerr microscopy {Applied Physics Letters}, 108(2), American Institute of Physics, Melville, NY, 2016 (article)

DOI [BibTex]

Ultrafast demagnetization after femtosecond laser pulses: Transfer of angular momentum from the electronic system to magnetoelastic spin-phonon modes

Tsatsoulis, T., Illg, C., Haag, M., Müller, B. Y., Zhang, L., Fähnle, M.

{Physical Review B}, 93(13), American Physical Society, Woodbury, NY, 2016 (article)

mms

DOI [BibTex]

mms Tsatsoulis, T., Illg, C., Haag, M., Müller, B. Y., Zhang, L., Fähnle, M. Ultrafast demagnetization after femtosecond laser pulses: Transfer of angular momentum from the electronic system to magnetoelastic spin-phonon modes {Physical Review B}, 93(13), American Physical Society, Woodbury, NY, 2016 (article)

DOI [BibTex]

Developments in the Ni-Nb-Zr amorphous alloy membranes

Sarker, S., Chandra, D., Hirscher, M., Dolan, M., Isheim, D., Wermer, J., Viano, D., Baricco, M., Udovic, T. J., Grant, D., Palumbo, O., Paolone, A., Cantelli, R.

{Applied Physics A}, 122(3), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

mms

DOI [BibTex]

mms Sarker, S., Chandra, D., Hirscher, M., Dolan, M., Isheim, D., Wermer, J., Viano, D., Baricco, M., Udovic, T. J., Grant, D., Palumbo, O., Paolone, A., Cantelli, R. Developments in the Ni-Nb-Zr amorphous alloy membranes {Applied Physics A}, 122(3), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

DOI [BibTex]

Resistance to the transport of H2 through the external surface of as-made and modified silicalite-1 (MFI)

Kalantzopoulos, G. N., Policicchio, A., Maccallini, E., Krkljus, I., Ciuchi, F., Hirscher, M., Agostino, R. G., Golemme, G.

{Microporous and Mesoporous Materials}, 220, pages: 290-297, Elsevier, Amsterdam, 2016 (article)

mms

DOI [BibTex]

mms Kalantzopoulos, G. N., Policicchio, A., Maccallini, E., Krkljus, I., Ciuchi, F., Hirscher, M., Agostino, R. G., Golemme, G. Resistance to the transport of H2 through the external surface of as-made and modified silicalite-1 (MFI) {Microporous and Mesoporous Materials}, 220, pages: 290-297, Elsevier, Amsterdam, 2016 (article)

DOI [BibTex]

Observation of pseudopartial grain boundary wetting in the NdFeB-based alloy

Straumal, B. B., Mazilkin, A. A., Protasova, S. G., Schütz, G., Straumal, A. B., Baretzky, B.

{Journal of Materials Engineering and Performance}, 25(8):3303-3309, 2016 (article)

mms

DOI [BibTex]

mms Straumal, B. B., Mazilkin, A. A., Protasova, S. G., Schütz, G., Straumal, A. B., Baretzky, B. Observation of pseudopartial grain boundary wetting in the NdFeB-based alloy {Journal of Materials Engineering and Performance}, 25(8):3303-3309, 2016 (article)

DOI [BibTex]

2009

Efficient Subwindow Search: A Branch and Bound Framework for Object Localization

Lampert, C., Blaschko, M., Hofmann, T.

IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(12):2129-2142, December 2009 (article)

Abstract

Most successful object recognition systems rely on binary classification, deciding only if an object is present or not, but not providing information on the actual object location. To estimate the object‘s location, one can take a sliding window approach, but this strongly increases the computational cost because the classifier or similarity function has to be evaluated over a large set of candidate subwindows. In this paper, we propose a simple yet powerful branch and bound scheme that allows efficient maximization of a large class of quality functions over all possible subimages. It converges to a globally optimal solution typically in linear or even sublinear time, in contrast to the quadratic scaling of exhaustive or sliding window search. We show how our method is applicable to different object detection and image retrieval scenarios. The achieved speedup allows the use of classifiers for localization that formerly were considered too slow for this task, such as SVMs with a spatial pyramid kernel or nearest-neighbor classifiers based on the chi^2 distance. We demonstrate state-of-the-art localization performance of the resulting systems on the UIUC Cars data set, the PASCAL VOC 2006 data set, and in the PASCAL VOC 2007 competition.

PDF Web DOI [BibTex]

2009

ei Lampert, C., Blaschko, M., Hofmann, T. Efficient Subwindow Search: A Branch and Bound Framework for Object Localization IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(12):2129-2142, December 2009 (article)

PDF Web DOI [BibTex]

Generation of three-dimensional random rotations in fitting and matching problems

Habeck, M.

Computational Statistics, 24(4):719-731, December 2009 (article)

Abstract

An algorithm is developed to generate random rotations in three-dimensional space that follow a probability distribution arising in fitting and matching problems. The rotation matrices are orthogonally transformed into an optimal basis and then parameterized using Euler angles. The conditional distributions of the three Euler angles have a very simple form: the two azimuthal angles can be decoupled by sampling their sum and difference from a von Mises distribution; the cosine of the polar angle is exponentially distributed and thus straighforward to generate. Simulation results are shown and demonstrate the effectiveness of the method. The algorithm is compared to other methods for generating random rotations such as a random walk Metropolis scheme and a Gibbs sampling algorithm recently introduced by Green and Mardia. Finally, the algorithm is applied to a probabilistic version of the Procrustes problem of fitting two point sets and applied in the context of protein structure superposition.

PDF DOI [BibTex]

ei Habeck, M. Generation of three-dimensional random rotations in fitting and matching problems Computational Statistics, 24(4):719-731, December 2009 (article)

PDF DOI [BibTex]

Adaptive Importance Sampling for Value Function Approximation in Off-policy Reinforcement Learning

Hachiya, H., Akiyama, T., Sugiyama, M., Peters, J.

Neural Networks, 22(10):1399-1410, December 2009 (article)

Abstract

Off-policy reinforcement learning is aimed at efficiently using data samples gathered from a policy that is different from the currently optimized policy. A common approach is to use importance sampling techniques for compensating for the bias of value function estimators caused by the difference between the data-sampling policy and the target policy. However, existing off-policy methods often do not take the variance of the value function estimators explicitly into account and therefore their performance tends to be unstable. To cope with this problem, we propose using an adaptive importance sampling technique which allows us to actively control the trade-off between bias and variance. We further provide a method for optimally determining the trade-off parameter based on a variant of cross-validation. We demonstrate the usefulness of the proposed approach through simulations.

PDF Web DOI [BibTex]

ei Hachiya, H., Akiyama, T., Sugiyama, M., Peters, J. Adaptive Importance Sampling for Value Function Approximation in Off-policy Reinforcement Learning Neural Networks, 22(10):1399-1410, December 2009 (article)

PDF Web DOI [BibTex]

Guest editorial: special issue on structured prediction

Parker, C., Altun, Y., Tadepalli, P.

Machine Learning, 77(2-3):161-164, December 2009 (article)

PDF DOI [BibTex]

ei Parker, C., Altun, Y., Tadepalli, P. Guest editorial: special issue on structured prediction Machine Learning, 77(2-3):161-164, December 2009 (article)

PDF DOI [BibTex]

Structured prediction by joint kernel support estimation

Lampert, CH., Blaschko, MB.

Machine Learning, 77(2-3):249-269, December 2009 (article)

PDF DOI [BibTex]

ei Lampert, CH., Blaschko, MB. Structured prediction by joint kernel support estimation Machine Learning, 77(2-3):249-269, December 2009 (article)

PDF DOI [BibTex]

A note on ethical aspects of BCI

Haselager, P., Vlek, R., Hill, J., Nijboer, F.

Neural Networks, 22(9):1352-1357, November 2009 (article)

Abstract

This paper focuses on ethical aspects of BCI, as a research and a clinical tool, that are challenging for practitioners currently working in the field. Specifically, the difficulties involved in acquiring informed consent from locked-in patients are investigated, in combination with an analysis of the shared moral responsibility in BCI teams, and the complications encountered in establishing effective communication with media.

Web DOI [BibTex]

ei Haselager, P., Vlek, R., Hill, J., Nijboer, F. A note on ethical aspects of BCI Neural Networks, 22(9):1352-1357, November 2009 (article)

Web DOI [BibTex]

Model Learning with Local Gaussian Process Regression

Nguyen-Tuong, D., Seeger, M., Peters, J.

Advanced Robotics, 23(15):2015-2034, November 2009 (article)

Abstract

Precise models of robot inverse dynamics allow the design of significantly more accurate, energy-efficient and compliant robot control. However, in some cases the accuracy of rigid-body models does not suffice for sound control performance due to unmodeled nonlinearities arising from hydraulic cable dynamics, complex friction or actuator dynamics. In such cases, estimating the inverse dynamics model from measured data poses an interesting alternative. Nonparametric regression methods, such as Gaussian process regression (GPR) or locally weighted projection regression (LWPR), are not as restrictive as parametric models and, thus, offer a more flexible framework for approximating unknown nonlinearities. In this paper, we propose a local approximation to the standard GPR, called local GPR (LGP), for real-time model online learning by combining the strengths of both regression methods, i.e., the high accuracy of GPR and the fast speed of LWPR. The approach is shown to have competitive learning performance for hig h-dimensional data while being sufficiently fast for real-time learning. The effectiveness of LGP is exhibited by a comparison with the state-of-the-art regression techniques, such as GPR, LWPR and ν-support vector regression. The applicability of the proposed LGP method is demonstrated by real-time online learning of the inverse dynamics model for robot model-based control on a Barrett WAM robot arm.

PDF Web DOI [BibTex]

ei Nguyen-Tuong, D., Seeger, M., Peters, J. Model Learning with Local Gaussian Process Regression Advanced Robotics, 23(15):2015-2034, November 2009 (article)

PDF Web DOI [BibTex]

Inferring textual entailment with a probabilistically sound calculus

Harmeling, S.

Natural Language Engineering, 15(4):459-477, October 2009 (article)

Abstract

We introduce a system for textual entailment that is based on a probabilistic model of entailment. The model is defined using a calculus of transformations on dependency trees, which is characterized by the fact that derivations in that calculus preserve the truth only with a certain probability. The calculus is successfully evaluated on the datasets of the PASCAL Challenge on Recognizing Textual Entailment.

PDF Web DOI [BibTex]

ei Harmeling, S. Inferring textual entailment with a probabilistically sound calculus Natural Language Engineering, 15(4):459-477, October 2009 (article)

PDF Web DOI [BibTex]

Modeling and Visualizing Uncertainty in Gene Expression Clusters using Dirichlet Process Mixtures

Rasmussen, CE., de la Cruz, BJ., Ghahramani, Z., Wild, DL.

IEEE/ACM Transactions on Computational Biology and Bioinformatics, 6(4):615-628, October 2009 (article)

Abstract

Although the use of clustering methods has rapidly become one of the standard computational approaches in the literature of microarray gene expression data, little attention has been paid to uncertainty in the results obtained. Dirichlet process mixture models provide a non-parametric Bayesian alternative to the bootstrap approach to modeling uncertainty in gene expression clustering. Most previously published applications of Bayesian model based clustering methods have been to short time series data. In this paper we present a case study of the application of non-parametric Bayesian clustering methods to the clustering of high-dimensional non-time series gene expression data using full Gaussian covariances. We use the probability that two genes belong to the same cluster in a Dirichlet process mixture model as a measure of the similarity of these gene expression profiles. Conversely, this probability can be used to define a dissimilarity measure, which, for the purposes of visualization, can be input to one of the standard linkage algorithms used for hierarchical clustering. Biologically plausible results are obtained from the Rosetta compendium of expression profiles which extend previously published cluster analyses of this data.

PDF Web DOI [BibTex]

ei Rasmussen, CE., de la Cruz, BJ., Ghahramani, Z., Wild, DL. Modeling and Visualizing Uncertainty in Gene Expression Clusters using Dirichlet Process Mixtures IEEE/ACM Transactions on Computational Biology and Bioinformatics, 6(4):615-628, October 2009 (article)

PDF Web DOI [BibTex]

Kernel Learning Approaches for Image Classification

Gehler, PV.

Biologische Kybernetik, Universität des Saarlandes, Saarbrücken, Germany, October 2009 (phdthesis)

Abstract

This thesis extends the use of kernel learning techniques to specific problems of image classification. Kernel learning is a paradigm in the field of machine learning that generalizes the use of inner products to compute similarities between arbitrary objects. In image classification one aims to separate images based on their visual content. We address two important problems that arise in this context: learning with weak label information and combination of heterogeneous data sources. The contributions we report on are not unique to image classification, and apply to a more general class of problems. We study the problem of learning with label ambiguity in the multiple instance learning framework. We discuss several different image classification scenarios that arise in this context and argue that the standard multiple instance learning requires a more detailed disambiguation. Finally we review kernel learning approaches proposed for this problem and derive a more efficient algorithm to solve them. The multiple kernel learning framework is an approach to automatically select kernel parameters. We extend it to its infinite limit and present an algorithm to solve the resulting problem. This result is then applied in two directions. We show how to learn kernels that adapt to the special structure of images. Finally we compare different ways of combining image features for object classification and present significant improvements compared to previous methods.

PDF [BibTex]

ei Gehler, PV. Kernel Learning Approaches for Image Classification Biologische Kybernetik, Universität des Saarlandes, Saarbrücken, Germany, October 2009 (phdthesis)

PDF [BibTex]

Thermodynamic efficiency of information and heat flow

Allahverdyan, A., Janzing, D., Mahler, G.

Journal of Statistical Mechanics: Theory and Experiment, 2009(09):P09011, September 2009 (article)

Abstract

A basic task of information processing is information transfer (flow). P0 Here we study a pair of Brownian particles each coupled to a thermal bath at temperatures T1 and T2 . The information flow in such a system is defined via the time-shifted mutual information. The information flow nullifies at equilibrium, and its efficiency is defined as the ratio of the flow to the total entropy production in the system. For a stationary state the information flows from higher to lower temperatures, and its efficiency is bounded from above by (max[T1 , T2 ])/(|T1 &amp;amp;amp;amp;#8722; T2 |). This upper bound is imposed by the second law and it quantifies the thermodynamic cost for information flow in the present class of systems. It can be reached in the adiabatic situation, where the particles have widely different characteristic times. The efficiency of heat flowdefined as the heat flow over the total amount of dissipated heatis limited from above by the same factor. There is a complementarity between heat and information flow: the set-up which is most efficient for the former is the least efficient for the latter and vice versa. The above bound for the efficiency can be (transiently) overcome in certain non-stationary situations, but the efficiency is still limited from above. We study yet another measure of information processing (transfer entropy) proposed in the literature. Though this measure does not require any thermodynamic cost, the information flow and transfer entropy are shown to be intimately related for stationary states.

PDF DOI [BibTex]

ei Allahverdyan, A., Janzing, D., Mahler, G. Thermodynamic efficiency of information and heat flow Journal of Statistical Mechanics: Theory and Experiment, 2009(09):P09011, September 2009 (article)

PDF DOI [BibTex]

Does Cognitive Science Need Kernels?

Jäkel, F., Schölkopf, B., Wichmann, F.

Trends in Cognitive Sciences, 13(9):381-388, September 2009 (article)

Abstract

Kernel methods are among the most successful tools in machine learning and are used in challenging data analysis problems in many disciplines. Here we provide examples where kernel methods have proven to be powerful tools for analyzing behavioral data, especially for identifying features in categorization experiments. We also demonstrate that kernel methods relate to perceptrons and exemplar models of categorization. Hence, we argue that kernel methods have neural and psychological plausibility, and theoretical results concerning their behavior are therefore potentially relevant for human category learning. In particular, we believe kernel methods have the potential to provide explanations ranging from the implementational via the algorithmic to the computational level.

PDF Web DOI [BibTex]

ei Jäkel, F., Schölkopf, B., Wichmann, F. Does Cognitive Science Need Kernels? Trends in Cognitive Sciences, 13(9):381-388, September 2009 (article)

PDF Web DOI [BibTex]

Robot Learning

Peters, J., Morimoto, J., Tedrake, R., Roy, N.

IEEE Robotics and Automation Magazine, 16(3):19-20, September 2009 (article)

Abstract

Creating autonomous robots that can learn to act in unpredictable environments has been a long-standing goal of robotics, artificial intelligence, and the cognitive sciences. In contrast, current commercially available industrial and service robots mostly execute fixed tasks and exhibit little adaptability. To bridge this gap, machine learning offers a myriad set of methods, some of which have already been applied with great success to robotics problems. As a result, there is an increasing interest in machine learning and statistics within the robotics community. At the same time, there has been a growth in the learning community in using robots as motivating applications for new algorithms and formalisms. Considerable evidence of this exists in the use of learning in high-profile competitions such as RoboCup and the Defense Advanced Research Projects Agency (DARPA) challenges, and the growing number of research programs funded by governments around the world.

PDF Web DOI [BibTex]

ei Peters, J., Morimoto, J., Tedrake, R., Roy, N. Robot Learning IEEE Robotics and Automation Magazine, 16(3):19-20, September 2009 (article)

PDF Web DOI [BibTex]

Kernel Methods in Computer Vision

Lampert, CH.

Foundations and Trends in Computer Graphics and Vision, 4(3):193-285, September 2009 (article)

Abstract

Over the last years, kernel methods have established themselves as powerful tools for computer vision researchers as well as for practitioners. In this tutorial, we give an introduction to kernel methods in computer vision from a geometric perspective, introducing not only the ubiquitous support vector machines, but also less known techniques for regression, dimensionality reduction, outlier detection and clustering. Additionally, we give an outlook on very recent, non-classical techniques for the prediction of structure data, for the estimation of statistical dependency and for learning the kernel function itself. All methods are illustrated with examples of successful application from the recent computer vision research literature.

Web DOI [BibTex]

ei Lampert, CH. Kernel Methods in Computer Vision Foundations and Trends in Computer Graphics and Vision, 4(3):193-285, September 2009 (article)

Web DOI [BibTex]

Fast Kernel-Based Independent Component Analysis

Shen, H., Jegelka, S., Gretton, A.

IEEE Transactions on Signal Processing, 57(9):3498-3511, September 2009 (article)

Abstract

Recent approaches to independent component analysis (ICA) have used kernel independence measures to obtain highly accurate solutions, particularly where classical methods experience difficulty (for instance, sources with near-zero kurtosis). FastKICA (fast HSIC-based kernel ICA) is a new optimization method for one such kernel independence measure, the Hilbert-Schmidt Independence Criterion (HSIC). The high computational efficiency of this approach is achieved by combining geometric optimization techniques, specifically an approximate Newton-like method on the orthogonal group, with accurate estimates of the gradient and Hessian based on an incomplete Cholesky decomposition. In contrast to other efficient kernel-based ICA algorithms, FastKICA is applicable to any twice differentiable kernel function. Experimental results for problems with large numbers of sources and observations indicate that FastKICA provides more accurate solutions at a given cost than gradient descent on HSIC. Comparing with other recently published ICA methods, FastKICA is competitive in terms of accuracy, relatively insensitive to local minima when initialized far from independence, and more robust towards outliers. An analysis of the local convergence properties of FastKICA is provided.

PDF Web DOI [BibTex]

ei Shen, H., Jegelka, S., Gretton, A. Fast Kernel-Based Independent Component Analysis IEEE Transactions on Signal Processing, 57(9):3498-3511, September 2009 (article)

PDF Web DOI [BibTex]

Guest editorial: Special issue on robot learning, Part B

Peters, J., Ng, A.

Autonomous Robots, 27(2):91-92, August 2009 (article)

PDF PDF DOI [BibTex]

ei Peters, J., Ng, A. Guest editorial: Special issue on robot learning, Part B Autonomous Robots, 27(2):91-92, August 2009 (article)

PDF PDF DOI [BibTex]

Policy Search for Motor Primitives

Peters, J., Kober, J.

KI - Zeitschrift K{\"u}nstliche Intelligenz, 23(3):38-40, August 2009 (article)

Abstract

Many motor skills in humanoid robotics can be learned using parametrized motor primitives from demonstrations. However, most interesting motor learning problems require self-improvement often beyond the reach of current reinforcement learning methods due to the high dimensionality of the state-space. We develop an EM-inspired algorithm applicable to complex motor learning tasks. We compare this algorithm to several well-known parametrized policy search methods and show that it outperforms them. We apply it to motor learning problems and show that it can learn the complex Ball-in-a-Cup task using a real Barrett WAM robot arm.

Web [BibTex]

ei Peters, J., Kober, J. Policy Search for Motor Primitives KI - Zeitschrift K{\"u}nstliche Intelligenz, 23(3):38-40, August 2009 (article)

Web [BibTex]

A neurophysiologically plausible population code model for human contrast discrimination

Goris, R., Wichmann, F., Henning, G.

Journal of Vision, 9(7):1-22, July 2009 (article)

Abstract

The pedestal effect is the improvement in the detectability of a sinusoidal grating in the presence of another grating of the same orientation, spatial frequency, and phase—usually called the pedestal. Recent evidence has demonstrated that the pedestal effect is differently modified by spectrally flat and notch-filtered noise: The pedestal effect is reduced in flat noise but virtually disappears in the presence of notched noise (G. B. Henning & F. A. Wichmann, 2007). Here we consider a network consisting of units whose contrast response functions resemble those of the cortical cells believed to underlie human pattern vision and demonstrate that, when the outputs of multiple units are combined by simple weighted summation—a heuristic decision rule that resembles optimal information combination and produces a contrast-dependent weighting profile—the network produces contrast-discrimination data consistent with psychophysical observations: The pedestal effect is present without noise, reduced in broadband noise, but almost disappears in notched noise. These findings follow naturally from the normalization model of simple cells in primary visual cortex, followed by response-based pooling, and suggest that in processing even low-contrast sinusoidal gratings, the visual system may combine information across neurons tuned to different spatial frequencies and orientations.

Web DOI [BibTex]

ei Goris, R., Wichmann, F., Henning, G. A neurophysiologically plausible population code model for human contrast discrimination Journal of Vision, 9(7):1-22, July 2009 (article)

Web DOI [BibTex]

Falsificationism and Statistical Learning Theory: Comparing the Popper and Vapnik-Chervonenkis Dimensions

Corfield, D., Schölkopf, B., Vapnik, V.

Journal for General Philosophy of Science, 40(1):51-58, July 2009 (article)

Abstract

We compare Karl Poppers ideas concerning the falsifiability of a theory with similar notions from the part of statistical learning theory known as VC-theory. Poppers notion of the dimension of a theory is contrasted with the apparently very similar VC-dimension. Having located some divergences, we discuss how best to view Poppers work from the perspective of statistical learning theory, either as a precursor or as aiming to capture a different learning activity.

PDF DOI [BibTex]