Publications | Max Planck Institute for Intelligent Systems

ics Buisson-Fenet, M. Actively Learning Dynamical Systems with Gaussian Processes Mines ParisTech, PSL Research University, 2019 (mastersthesis)

2013

Camera-specific Image Denoising

Schober, M.

Eberhard Karls Universität Tübingen, Germany, October 2013 (diplomathesis)

ei pn

2013

ei pn Schober, M. Camera-specific Image Denoising Eberhard Karls Universität Tübingen, Germany, October 2013 (diplomathesis)

pdf Project Page [BibTex]

Statistics on Manifolds with Applications to Modeling Shape Deformations

Freifeld, O.

Brown University, August 2013 (phdthesis)

Abstract

Statistical models of non-rigid deformable shape have wide application in many fields, including computer vision, computer graphics, and biometry. We show that shape deformations are well represented through nonlinear manifolds that are also matrix Lie groups. These pattern-theoretic representations lead to several advantages over other alternatives, including a principled measure of shape dissimilarity and a natural way to compose deformations. Moreover, they enable building models using statistics on manifolds. Consequently, such models are superior to those based on Euclidean representations. We demonstrate this by modeling 2D and 3D human body shape. Shape deformations are only one example of manifold-valued data. More generally, in many computer-vision and machine-learning problems, nonlinear manifold representations arise naturally and provide a powerful alternative to Euclidean representations. Statistics is traditionally concerned with data in a Euclidean space, relying on the linear structure and the distances associated with such a space; this renders it inappropriate for nonlinear spaces. Statistics can, however, be generalized to nonlinear manifolds. Moreover, by respecting the underlying geometry, the statistical models result in not only more effective analysis but also consistent synthesis. We go beyond previous work on statistics on manifolds by showing how, even on these curved spaces, problems related to modeling a class from scarce data can be dealt with by leveraging information from related classes residing in different regions of the space. We show the usefulness of our approach with 3D shape deformations. To summarize our main contributions: 1) We define a new 2D articulated model -- more expressive than traditional ones -- of deformable human shape that factors body-shape, pose, and camera variations. Its high realism is obtained from training data generated from a detailed 3D model. 2) We define a new manifold-based representation of 3D shape deformations that yields statistical deformable-template models that are better than the current state-of-the- art. 3) We generalize a transfer learning idea from Euclidean spaces to Riemannian manifolds. This work demonstrates the value of modeling manifold-valued data and their statistics explicitly on the manifold. Specifically, the methods here provide new tools for shape analysis.

ps Freifeld, O. Statistics on Manifolds with Applications to Modeling Shape Deformations Brown University, August 2013 (phdthesis)

pdf Project Page [BibTex]

Studying large-scale brain networks: electrical stimulation and neural-event-triggered fMRI

Logothetis, N., Eschenko, O., Murayama, Y., Augath, M., Steudel, T., Evrard, H., Besserve, M., Oeltermann, A.

Twenty-Second Annual Computational Neuroscience Meeting (CNS*2013), July 2013, journal = {BMC Neuroscience}, year = {2013}, month = {7}, volume = {14}, number = {Supplement 1}, pages = {A1}, (talk)

ei Logothetis, N., Eschenko, O., Murayama, Y., Augath, M., Steudel, T., Evrard, H., Besserve, M., Oeltermann, A. Studying large-scale brain networks: electrical stimulation and neural-event-triggered fMRI Twenty-Second Annual Computational Neuroscience Meeting (CNS*2013), July 2013, journal = {BMC Neuroscience}, year = {2013}, month = {7}, volume = {14}, number = {Supplement 1}, pages = {A1}, (talk)

Modelling and Learning Approaches to Image Denoising

Burger, HC.

Eberhard Karls Universität Tübingen, Germany, 2013 (phdthesis)

ei Burger, HC. Modelling and Learning Approaches to Image Denoising Eberhard Karls Universität Tübingen, Germany, 2013 (phdthesis)

MR-Based Attenuation Correction for Combined Brain PET/MR: Robustness of Atlas- and Pattern Recognition Method to Atlas Registration Failures

Mantlik, F., Bezrukov, I., Hofmann, M., Schölkopf, B., Pichler, B.

IEEE Nuclear Science Symposium and Medical Imaging Conference (IEEE MIC), 2013 (talk)

ei Mantlik, F., Bezrukov, I., Hofmann, M., Schölkopf, B., Pichler, B. MR-Based Attenuation Correction for Combined Brain PET/MR: Robustness of Atlas- and Pattern Recognition Method to Atlas Registration Failures IEEE Nuclear Science Symposium and Medical Imaging Conference (IEEE MIC), 2013 (talk)

Domain Generalization via Invariant Feature Representation

Muandet, K.

30th International Conference on Machine Learning (ICML2013), 2013 (talk)

ei Muandet, K. Domain Generalization via Invariant Feature Representation 30th International Conference on Machine Learning (ICML2013), 2013 (talk)

Lopez-Paz, D., Duvenaud, D.

Random Projections (Computational and Biological Learning Lab, University of Cambridge, 2013)

2013 (talk)

ei Lopez-Paz, D., Duvenaud, D. Random Projections (Computational and Biological Learning Lab, University of Cambridge, 2013) 2013 (talk)

Linear mixed models for genome-wide association studies

Lippert, C.

University of Tübingen, Germany, 2013 (phdthesis)

ei Lippert, C. Linear mixed models for genome-wide association studies University of Tübingen, Germany, 2013 (phdthesis)

Leveraging Weak Supervision for Video Understanding

Garcia Cifuentes, C.

University College London, 2013 (phdthesis)

Garcia Cifuentes, C. Leveraging Weak Supervision for Video Understanding University College London, 2013 (phdthesis)

Modeling and Learning Complex Motor Tasks: A case study on Robot Table Tennis

Mülling, K.

Technical University Darmstadt, Germany, 2013 (phdthesis)

ei Mülling, K. Modeling and Learning Complex Motor Tasks: A case study on Robot Table Tennis Technical University Darmstadt, Germany, 2013 (phdthesis)

Intention Inference and Decision Making with Hierarchical Gaussian Process Dynamics Models

Wang, Z.

Technical University Darmstadt, Germany, 2013 (phdthesis)

ei Wang, Z. Intention Inference and Decision Making with Hierarchical Gaussian Process Dynamics Models Technical University Darmstadt, Germany, 2013 (phdthesis)

Quantum kinetic theory for demagnetization after femtosecond laser pulses

Teeny, N.

Universität Stuttgart, Stuttgart, 2013 (mastersthesis)

mms

mms Teeny, N. Quantum kinetic theory for demagnetization after femtosecond laser pulses Universität Stuttgart, Stuttgart, 2013 (mastersthesis)

Ab-initio modeling of ultrafast demagnetization after laser irradiation in nickel, iron and cobalt

Illg, C.

Universität Stuttgart, Stuttgart, 2013 (phdthesis)

mms

mms Illg, C. Ab-initio modeling of ultrafast demagnetization after laser irradiation in nickel, iron and cobalt Universität Stuttgart, Stuttgart, 2013 (phdthesis)

2009

Machine Learning for Brain-Computer Interfaces

Hill, NJ.

Mini-Symposia on Assistive Machine Learning for People with Disabilities at NIPS (AMD), December 2009 (talk)

Abstract

Brain-computer interfaces (BCI) aim to be the ultimate in assistive technology: decoding a user‘s intentions directly from brain signals without involving any muscles or peripheral nerves. Thus, some classes of BCI potentially offer hope for users with even the most extreme cases of paralysis, such as in late-stage Amyotrophic Lateral Sclerosis, where nothing else currently allows communication of any kind. Other lines in BCI research aim to restore lost motor function in as natural a way as possible, reconnecting and in some cases re-training motor-cortical areas to control prosthetic, or previously paretic, limbs. Research and development are progressing on both invasive and non-invasive fronts, although BCI has yet to make a breakthrough to widespread clinical application. The high-noise high-dimensional nature of brain-signals, particularly in non-invasive approaches and in patient populations, make robust decoding techniques a necessity. Generally, the approach has been to use relatively simple feature extraction techniques, such as template matching and band-power estimation, coupled to simple linear classifiers. This has led to a prevailing view among applied BCI researchers that (sophisticated) machine-learning is irrelevant since "it doesn‘t matter what classifier you use once you‘ve done your preprocessing right and extracted the right features." I shall show a few examples of how this runs counter to both the empirical reality and the spirit of what needs to be done to bring BCI into clinical application. Along the way I‘ll highlight some of the interesting problems that remain open for machine-learners.

2009

ei Hill, NJ. Machine Learning for Brain-Computer Interfaces Mini-Symposia on Assistive Machine Learning for People with Disabilities at NIPS (AMD), December 2009 (talk)

PAC-Bayesian Approach to Formulation of Clustering Objectives

Seldin, Y.

NIPS Workshop on "Clustering: Science or Art? Towards Principled Approaches", December 2009 (talk)

Abstract

Clustering is a widely used tool for exploratory data analysis. However, the theoretical understanding of clustering is very limited. We still do not have a well-founded answer to the seemingly simple question of "how many clusters are present in the data?", and furthermore a formal comparison of clusterings based on different optimization objectives is far beyond our abilities. The lack of good theoretical support gives rise to multiple heuristics that confuse the practitioners and stall development of the field. We suggest that the ill-posed nature of clustering problems is caused by the fact that clustering is often taken out of its subsequent application context. We argue that one does not cluster the data just for the sake of clustering it, but rather to facilitate the solution of some higher level task. By evaluation of the clustering‘s contribution to the solution of the higher level task it is possible to compare different clusterings, even those obtained by different optimization objectives. In the preceding work it was shown that such an approach can be applied to evaluation and design of co-clustering solutions. Here we suggest that this approach can be extended to other settings, where clustering is applied.

ei Seldin, Y. PAC-Bayesian Approach to Formulation of Clustering Objectives NIPS Workshop on "Clustering: Science or Art? Towards Principled Approaches", December 2009 (talk)

Semi-supervised Kernel Canonical Correlation Analysis of Human Functional Magnetic Resonance Imaging Data

Shelton, JA.

Women in Machine Learning Workshop (WiML), December 2009 (talk)

Abstract

Kernel Canonical Correlation Analysis (KCCA) is a general technique for subspace learning that incorporates principal components analysis (PCA) and Fisher linear discriminant analysis (LDA) as special cases. By finding directions that maximize correlation, KCCA learns representations tied more closely to underlying process generating the the data and can ignore high-variance noise directions. However, for data where acquisition in a given modality is expensive or otherwise limited, KCCA may suffer from small sample effects. We propose to use semi-supervised Laplacian regularization to utilize data that are present in only one modality. This manifold learning approach is able to find highly correlated directions that also lie along the data manifold, resulting in a more robust estimate of correlated subspaces. Functional magnetic resonance imaging (fMRI) acquired data are naturally amenable to subspace techniques as data are well aligned and such data of the human brain are a particularly interesting candidate. In this study we implemented various supervised and semi-supervised versions of KCCA on human fMRI data, with regression to single and multivariate labels (corresponding to video content subjects viewed during the image acquisition). In each variate condition, Laplacian regularization improved performance whereas the semi-supervised variants of KCCA yielded the best performance. We additionally analyze the weights learned by the regression in order to infer brain regions that are important during different types of visual processing.

ei Shelton, JA. Semi-supervised Kernel Canonical Correlation Analysis of Human Functional Magnetic Resonance Imaging Data Women in Machine Learning Workshop (WiML), December 2009 (talk)

Event-Related Potentials in Brain-Computer Interfacing

Hill, NJ.

Invited lecture on the bachelor & masters course "Introduction to Brain-Computer Interfacing", October 2009 (talk)

Abstract

An introduction to event-related potentials with specific reference to their use in brain-computer interfacing applications and research.

ei Hill, NJ. Event-Related Potentials in Brain-Computer Interfacing Invited lecture on the bachelor & masters course "Introduction to Brain-Computer Interfacing", October 2009 (talk)

BCI2000 and Python

Hill, NJ.

Invited lecture at the 5th International BCI2000 Workshop, October 2009 (talk)

Abstract

A tutorial, with exercises, on how to integrate your own Python code with the BCI2000 software package.

ei Hill, NJ. BCI2000 and Python Invited lecture at the 5th International BCI2000 Workshop, October 2009 (talk)

Implementing a Signal Processing Filter in BCI2000 Using C++

Hill, NJ., Mellinger, J.

Invited lecture at the 5th International BCI2000 Workshop, October 2009 (talk)

Abstract

This tutorial shows how the functionality of the BCI2000 software package can be extended with one‘s own code, using BCI2000‘s C++ API.

ei Hill, NJ., Mellinger, J. Implementing a Signal Processing Filter in BCI2000 Using C++ Invited lecture at the 5th International BCI2000 Workshop, October 2009 (talk)

Kernel Learning Approaches for Image Classification

Gehler, PV.

Biologische Kybernetik, Universität des Saarlandes, Saarbrücken, Germany, October 2009 (phdthesis)

Abstract

This thesis extends the use of kernel learning techniques to specific problems of image classification. Kernel learning is a paradigm in the field of machine learning that generalizes the use of inner products to compute similarities between arbitrary objects. In image classification one aims to separate images based on their visual content. We address two important problems that arise in this context: learning with weak label information and combination of heterogeneous data sources. The contributions we report on are not unique to image classification, and apply to a more general class of problems. We study the problem of learning with label ambiguity in the multiple instance learning framework. We discuss several different image classification scenarios that arise in this context and argue that the standard multiple instance learning requires a more detailed disambiguation. Finally we review kernel learning approaches proposed for this problem and derive a more efficient algorithm to solve them. The multiple kernel learning framework is an approach to automatically select kernel parameters. We extend it to its infinite limit and present an algorithm to solve the resulting problem. This result is then applied in two directions. We show how to learn kernels that adapt to the special structure of images. Finally we compare different ways of combining image features for object classification and present significant improvements compared to previous methods.

ei Gehler, PV. Kernel Learning Approaches for Image Classification Biologische Kybernetik, Universität des Saarlandes, Saarbrücken, Germany, October 2009 (phdthesis)

Learning Motor Primitives for Robotics

Kober, J., Peters, J., Oztop, E.

Advanced Telecommunications Research Center ATR, June 2009 (talk)

Abstract

The acquisition and self-improvement of novel motor skills is among the most important problems in robotics. Motor primitives offer one of the most promising frameworks for the application of machine learning techniques in this context. Employing the Dynamic Systems Motor primitives originally introduced by Ijspeert et al. (2003), appropriate learning algorithms for a concerted approach of both imitation and reinforcement learning are presented. Using these algorithms new motor skills, i.e., Ball-in-a-Cup, Ball-Paddling and Dart-Throwing, are learned.

ei Kober, J., Peters, J., Oztop, E. Learning Motor Primitives for Robotics Advanced Telecommunications Research Center ATR, June 2009 (talk)

Learning To Detect Unseen Object Classes by Between-Class Attribute Transfer

Lampert, C.

IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), June 2009 (talk)

ei Lampert, C. Learning To Detect Unseen Object Classes by Between-Class Attribute Transfer IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), June 2009 (talk)

Kernel Methods in Computer Vision:Object Localization, Clustering,and Taxonomy Discovery

Blaschko, MB.

Biologische Kybernetik, Technische Universität Berlin, Berlin, Germany, March 2009 (phdthesis)

PDF PDF [BibTex]

ei Blaschko, MB. Kernel Methods in Computer Vision:Object Localization, Clustering,and Taxonomy Discovery Biologische Kybernetik, Technische Universität Berlin, Berlin, Germany, March 2009 (phdthesis)

PDF PDF [BibTex]

Motor Control and Learning in Table Tennis

Mülling, K.

Eberhard Karls Universität Tübingen, Gerrmany, 2009 (diplomathesis)

ei Mülling, K. Motor Control and Learning in Table Tennis Eberhard Karls Universität Tübingen, Gerrmany, 2009 (diplomathesis)

Hierarchical Clustering and Density Estimation Based on k-nearest-neighbor graphs

Drewe, P.

Eberhard Karls Universität Tübingen, Germany, 2009 (diplomathesis)

ei Drewe, P. Hierarchical Clustering and Density Estimation Based on k-nearest-neighbor graphs Eberhard Karls Universität Tübingen, Germany, 2009 (diplomathesis)

Learning with Structured Data: Applications to Computer Vision

Nowozin, S.

Technische Universität Berlin, Germany, 2009 (phdthesis)

ei Nowozin, S. Learning with Structured Data: Applications to Computer Vision Technische Universität Berlin, Germany, 2009 (phdthesis)

From Differential Equations to Differential Geometry: Aspects of Regularisation in Machine Learning

Steinke, F.

Universität des Saarlandes, Saarbrücken, Germany, 2009 (phdthesis)

ei Steinke, F. From Differential Equations to Differential Geometry: Aspects of Regularisation in Machine Learning Universität des Saarlandes, Saarbrücken, Germany, 2009 (phdthesis)

Magnetische L10-FePt Nanostrukturen für höchste Datenspeicherdichten

Breitling, A.

Universität Stuttgart, Stuttgart, 2009 (phdthesis)

mms

mms Breitling, A. Magnetische L10-FePt Nanostrukturen für höchste Datenspeicherdichten Universität Stuttgart, Stuttgart, 2009 (phdthesis)

Ab-initio Elliott-Yafet modeling of ultrafast demagnetization after laser irradiation

Illg, C.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

mms Illg, C. Ab-initio Elliott-Yafet modeling of ultrafast demagnetization after laser irradiation Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

Element specific investigation of the magnetization profile at the CrO2/RuO2 interface

Zafar, K.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

mms Zafar, K. Element specific investigation of the magnetization profile at the CrO2/RuO2 interface Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

Bayesian Methods for Autonomous Learning Systems (Phd Thesis)

Ting, J.

Department of Computer Science, University of Southern California, Los Angeles, CA, 2009, clmc (phdthesis)

am Ting, J. Bayesian Methods for Autonomous Learning Systems (Phd Thesis) Department of Computer Science, University of Southern California, Los Angeles, CA, 2009, clmc (phdthesis)

Magnetic resonant reflectometry on exchange bias systems

Brück, S.

Universität Stuttgart, Stuttgart, 2009 (phdthesis)

mms

mms Brück, S. Magnetic resonant reflectometry on exchange bias systems Universität Stuttgart, Stuttgart, 2009 (phdthesis)

In-situ - Untersuchungen zu Interdiffusion und Magnetismus in magnetischen Multilayern

Schmidt, M.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

mms Schmidt, M. In-situ - Untersuchungen zu Interdiffusion und Magnetismus in magnetischen Multilayern Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

Theorie der elektronischen Zustände in oxidischen magnetischen Materialien

Kostoglou, C.

Universität Stuttgart, Stuttgart, 2009 (phdthesis)

mms

mms Kostoglou, C. Theorie der elektronischen Zustände in oxidischen magnetischen Materialien Universität Stuttgart, Stuttgart, 2009 (phdthesis)

Magnetooptische Untersuchungen an Ferromagnet- und Supraleiter-Nanosystemen und deren Hybriden

Treiber, S.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

mms Treiber, S. Magnetooptische Untersuchungen an Ferromagnet- und Supraleiter-Nanosystemen und deren Hybriden Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

2007

Reaction graph kernels for discovering missing enzymes in the plant secondary metabolism

Saigo, H., Hattori, M., Tsuda, K.

NIPS Workshop on Machine Learning in Computational Biology, December 2007 (talk)

Abstract

Secondary metabolic pathway in plant is important for finding druggable candidate enzymes. However, there are many enzymes whose functions are still undiscovered especially in organism-specific metabolic pathways. We propose reaction graph kernels for automatically assigning the EC numbers to unknown enzymatic reactions in a metabolic network. Experiments are carried out on KEGG/REACTION database and our method successfully predicted the first three digits of the EC number with 83% accuracy.We also exhaustively predicted missing enzymatic functions in the plant secondary metabolism pathways, and evaluated our results in biochemical validity.

2007

ei Saigo, H., Hattori, M., Tsuda, K. Reaction graph kernels for discovering missing enzymes in the plant secondary metabolism NIPS Workshop on Machine Learning in Computational Biology, December 2007 (talk)

Positional Oligomer Importance Matrices

Sonnenburg, S., Zien, A., Philips, P., Rätsch, G.

NIPS Workshop on Machine Learning in Computational Biology, December 2007 (talk)

Abstract

At the heart of many important bioinformatics problems, such as gene finding and function prediction, is the classification of biological sequences, above all of DNA and proteins. In many cases, the most accurate classifiers are obtained by training SVMs with complex sequence kernels, for instance for transcription starts or splice sites. However, an often criticized downside of SVMs with complex kernels is that it is very hard for humans to understand the learned decision rules and to derive biological insights from them. To close this gap, we introduce the concept of positional oligomer importance matrices (POIMs) and develop an efficient algorithm for their computation. We demonstrate how they overcome the limitations of sequence logos, and how they can be used to find relevant motifs for different biological phenomena in a straight-forward way. Note that the concept of POIMs is not limited to interpreting SVMs, but is applicable to general k−mer based scoring systems.

ei Sonnenburg, S., Zien, A., Philips, P., Rätsch, G. Positional Oligomer Importance Matrices NIPS Workshop on Machine Learning in Computational Biology, December 2007 (talk)

Machine Learning Algorithms for Polymorphism Detection

Schweikert, G., Zeller, G., Weigel, D., Schölkopf, B., Rätsch, G.

NIPS Workshop on Machine Learning in Computational Biology, December 2007 (talk)

ei Schweikert, G., Zeller, G., Weigel, D., Schölkopf, B., Rätsch, G. Machine Learning Algorithms for Polymorphism Detection NIPS Workshop on Machine Learning in Computational Biology, December 2007 (talk)

An Automated Combination of Kernels for Predicting Protein Subcellular Localization

Zien, A., Ong, C.

NIPS Workshop on Machine Learning in Computational Biology, December 2007 (talk)

Abstract

Protein subcellular localization is a crucial ingredient to many important inferences about cellular processes, including prediction of protein function and protein interactions.We propose a new class of protein sequence kernels which considers all motifs including motifs with gaps. This class of kernels allows the inclusion of pairwise amino acid distances into their computation. We utilize an extension of the multiclass support vector machine (SVM)method which directly solves protein subcellular localization without resorting to the common approach of splitting the problem into several binary classification problems. To automatically search over families of possible amino acid motifs, we optimize over multiple kernels at the same time. We compare our automated approach to four other predictors on three different datasets, and show that we perform better than the current state of the art. Furthermore, our method provides some insights as to which features are most useful for determining subcellular localization, which are in agreement with biological reasoning.

ei Zien, A., Ong, C. An Automated Combination of Kernels for Predicting Protein Subcellular Localization NIPS Workshop on Machine Learning in Computational Biology, December 2007 (talk)

Challenges in Brain-Computer Interface Development: Induction, Measurement, Decoding, Integration

Hill, NJ.

Invited keynote talk at the launch of BrainGain, the Dutch BCI research consortium, November 2007 (talk)

Abstract

I‘ll present a perspective on Brain-Computer Interface development from T{\"u}bingen. Some of the benefits promised by BCI technology lie in the near foreseeable future, and some further away. Our motivation is to make BCI technology feasible for the people who could benefit from what it has to offer soon: namely, people in the "completely locked-in" state. I‘ll mention some of the challenges of working with this user group, and explain the specific directions they have motivated us to take in developing experimental methods, algorithms, and software.

ei Hill, NJ. Challenges in Brain-Computer Interface Development: Induction, Measurement, Decoding, Integration Invited keynote talk at the launch of BrainGain, the Dutch BCI research consortium, November 2007 (talk)