Publications | Max Planck Institute for Intelligent Systems

117 results (View BibTeX file of all listed publications)

2007

A Tutorial on Spectral Clustering

Statistics and Computing, 17(4):395-416, December 2007 (article)

Abstract

In recent years, spectral clustering has become one of the most popular modern clustering algorithms. It is simple to implement, can be solved efficiently by standard linear algebra software, and very often outperforms traditional clustering algorithms such as the k-means algorithm. On the first glance spectral clustering appears slightly mysterious, and it is not obvious to see why it works at all and what it really does. The goal of this tutorial is to give some intuition on those questions. We describe different graph Laplacians and their basic properties, present the most common spectral clustering algorithms, and derive those algorithms from scratch by several different approaches. Advantages and disadvantages of the different spectral clustering algorithms are discussed.

PDF PDF DOI [BibTex]

2007

ei von Luxburg, U. A Tutorial on Spectral Clustering Statistics and Computing, 17(4):395-416, December 2007 (article)

PDF PDF DOI [BibTex]

A Tutorial on Kernel Methods for Categorization

Jäkel, F., Schölkopf, B., Wichmann, F.

Journal of Mathematical Psychology, 51(6):343-358, December 2007 (article)

Abstract

The abilities to learn and to categorize are fundamental for cognitive systems, be it animals or machines, and therefore have attracted attention from engineers and psychologists alike. Modern machine learning methods and psychological models of categorization are remarkably similar, partly because these two fields share a common history in artificial neural networks and reinforcement learning. However, machine learning is now an independent and mature field that has moved beyond psychologically or neurally inspired algorithms towards providing foundations for a theory of learning that is rooted in statistics and functional analysis. Much of this research is potentially interesting for psychological theories of learning and categorization but also hardly accessible for psychologists. Here, we provide a tutorial introduction to a popular class of machine learning tools, called kernel methods. These methods are closely related to perceptrons, radial-basis-function neural networks and exemplar theories of catego rization. Recent theoretical advances in machine learning are closely tied to the idea that the similarity of patterns can be encapsulated in a positive definite kernel. Such a positive definite kernel can define a reproducing kernel Hilbert space which allows one to use powerful tools from functional analysis for the analysis of learning algorithms. We give basic explanations of some key conceptsthe so-called kernel trick, the representer theorem and regularizationwhich may open up the possibility that insights from machine learning can feed back into psychology.

PDF Web DOI [BibTex]

ei Jäkel, F., Schölkopf, B., Wichmann, F. A Tutorial on Kernel Methods for Categorization Journal of Mathematical Psychology, 51(6):343-358, December 2007 (article)

PDF Web DOI [BibTex]

Accurate Splice site Prediction Using Support Vector Machines

Sonnenburg, S., Schweikert, G., Philips, P., Behr, J., Rätsch, G.

BMC Bioinformatics, 8(Supplement 10):1-16, December 2007 (article)

Abstract

Background: For splice site recognition, one has to solve two classification problems: discriminating true from decoy splice sites for both acceptor and donor sites. Gene finding systems typically rely on Markov Chains to solve these tasks. Results: In this work we consider Support Vector Machines for splice site recognition. We employ the so-called weighted degree kernel which turns out well suited for this task, as we will illustrate in several experiments where we compare its prediction accuracy with that of recently proposed systems. We apply our method to the genome-wide recognition of splice sites in Caenorhabditis elegans, Drosophila melanogaster, Arabidopsis thaliana, Danio rerio, and Homo sapiens. Our performance estimates indicate that splice sites can be recognized very accurately in these genomes and that our method outperforms many other methods including Markov Chains, GeneSplicer and SpliceMachine. We provide genome-wide predictions of splice sites and a stand-alone prediction tool ready to be used for incorporation in a gene finder. Availability: Data, splits, additional information on the model selection, the whole genome predictions, as well as the stand-alone prediction tool are available for download at http:// www.fml.mpg.de/raetsch/projects/splice.

PDF DOI [BibTex]

ei Sonnenburg, S., Schweikert, G., Philips, P., Behr, J., Rätsch, G. Accurate Splice site Prediction Using Support Vector Machines BMC Bioinformatics, 8(Supplement 10):1-16, December 2007 (article)

PDF DOI [BibTex]

Experimental design for efficient identification of gene regulatory networks using sparse Bayesian models

Steinke, F., Seeger, M., Tsuda, K.

BMC Systems Biology, 1(51):1-15, November 2007 (article)

PDF PDF DOI [BibTex]

ei Steinke, F., Seeger, M., Tsuda, K. Experimental design for efficient identification of gene regulatory networks using sparse Bayesian models BMC Systems Biology, 1(51):1-15, November 2007 (article)

PDF PDF DOI [BibTex]

Some Theoretical Aspects of Human Categorization Behavior: Similarity and Generalization

Jäkel, F.

Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, November 2007, passed with "ausgezeichnet", summa cum laude, published online (phdthesis)

PDF [BibTex]

ei Jäkel, F. Some Theoretical Aspects of Human Categorization Behavior: Similarity and Generalization Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, November 2007, passed with "ausgezeichnet", summa cum laude, published online (phdthesis)

PDF [BibTex]

Statistical Learning Theory Approaches to Clustering

Jegelka, S.

Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, November 2007 (diplomathesis)

PDF [BibTex]

ei Jegelka, S. Statistical Learning Theory Approaches to Clustering Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, November 2007 (diplomathesis)

PDF [BibTex]

A unifying framework for robot control with redundant DOFs

Peters, J., Mistry, M., Udwadia, F., Nakanishi, J., Schaal, S.

Autonomous Robots, 24(1):1-12, October 2007 (article)

Abstract

Recently, Udwadia (Proc. R. Soc. Lond. A 2003:17831800, 2003) suggested to derive tracking controllers for mechanical systems with redundant degrees-of-freedom (DOFs) using a generalization of Gauss principle of least constraint. This method allows reformulating control problems as a special class of optimal controllers. In this paper, we take this line of reasoning one step further and demonstrate that several well-known and also novel nonlinear robot control laws can be derived from this generic methodology. We show experimental verifications on a Sarcos Master Arm robot for some of the derived controllers. The suggested approach offers a promising unification and simplification of nonlinear control law design for robots obeying rigid body dynamics equations, both with or without external constraints, with over-actuation or underactuation, as well as open-chain and closed-chain kinematics.

PDF PDF DOI [BibTex]

ei Peters, J., Mistry, M., Udwadia, F., Nakanishi, J., Schaal, S. A unifying framework for robot control with redundant DOFs Autonomous Robots, 24(1):1-12, October 2007 (article)

PDF PDF DOI [BibTex]

The Need for Open Source Software in Machine Learning

Sonnenburg, S., Braun, M., Ong, C., Bengio, S., Bottou, L., Holmes, G., LeCun, Y., Müller, K., Pereira, F., Rasmussen, C., Rätsch, G., Schölkopf, B., Smola, A., Vincent, P., Weston, J., Williamson, R.

Journal of Machine Learning Research, 8, pages: 2443-2466, October 2007 (article)

Abstract

Open source tools have recently reached a level of maturity which makes them suitable for building large-scale real-world systems. At the same time, the field of machine learning has developed a large body of powerful learning algorithms for diverse applications. However, the true potential of these methods is not realized, since existing implementations are not openly shared, resulting in software with low usability, and weak interoperability. We argue that this situation can be significantly improved by increasing incentives for researchers to publish their software under an open source model. Additionally, we outline the problems authors are faced with when trying to publish algorithmic implementations of machine learning methods. We believe that a resource of peer reviewed software accompanied by short articles would be highly valuable to both the machine learning and the general scientific community.

PDF Web [BibTex]

ei Sonnenburg, S., Braun, M., Ong, C., Bengio, S., Bottou, L., Holmes, G., LeCun, Y., Müller, K., Pereira, F., Rasmussen, C., Rätsch, G., Schölkopf, B., Smola, A., Vincent, P., Weston, J., Williamson, R. The Need for Open Source Software in Machine Learning Journal of Machine Learning Research, 8, pages: 2443-2466, October 2007 (article)

PDF Web [BibTex]

Some observations on the masking effects of Mach bands

Curnow, T., Cowie, DA., Henning, GB., Hill, NJ.

Journal of the Optical Society of America A, 24(10):3233-3241, October 2007 (article)

Abstract

There are 8 cycle / deg ripples or oscillations in performance as a function of location near Mach bands in experiments measuring Mach bands masking effects on random polarity signal bars. The oscillations with increments are 180 degrees out of phase with those for decrements. The oscillations, much larger than the measurement error, appear to relate to the weighting function of the spatial-frequency-tuned channel detecting the broad- band signals. The ripples disappear with step maskers and become much smaller at durations below 25 ms, implying either that the site of masking has changed or that the weighting function and hence spatial-frequency tuning is slow to develop.

PDF Web DOI [BibTex]

ei Curnow, T., Cowie, DA., Henning, GB., Hill, NJ. Some observations on the masking effects of Mach bands Journal of the Optical Society of America A, 24(10):3233-3241, October 2007 (article)

PDF Web DOI [BibTex]

Mining complex genotypic features for predicting HIV-1 drug resistance

Saigo, H., Uno, T., Tsuda, K.

Bioinformatics, 23(18):2455-2462, September 2007 (article)

Abstract

Human immunodeficiency virus type 1 (HIV-1) evolves in human body, and its exposure to a drug often causes mutations that enhance the resistance against the drug. To design an effective pharmacotherapy for an individual patient, it is important to accurately predict the drug resistance based on genotype data. Notably, the resistance is not just the simple sum of the effects of all mutations. Structural biological studies suggest that the association of mutations is crucial: Even if mutations A or B alone do not affect the resistance, a significant change might happen when the two mutations occur together. Linear regression methods cannot take the associations into account, while decision tree methods can reveal only limited associations. Kernel methods and neural networks implicitly use all possible associations for prediction, but cannot select salient associations explicitly. Our method, itemset boosting, performs linear regression in the complete space of power sets of mutations. It implements a forward feature selection procedure where, in each iteration, one mutation combination is found by an efficient branch-and-bound search. This method uses all possible combinations, and salient associations are explicitly shown. In experiments, our method worked particularly well for predicting the resistance of nucleotide reverse transcriptase inhibitors (NRTIs). Furthermore, it successfully recovered many mutation associations known in biological literature.

Web DOI [BibTex]

ei Saigo, H., Uno, T., Tsuda, K. Mining complex genotypic features for predicting HIV-1 drug resistance Bioinformatics, 23(18):2455-2462, September 2007 (article)

Web DOI [BibTex]

Real-Time Fetal Heart Monitoring in Biomagnetic Measurements Using Adaptive Real-Time ICA

Waldert, S., Bensch, M., Bogdan, M., Rosenstiel, W., Schölkopf, B., Lowery, C., Eswaran, H., Preissl, H.

IEEE Transactions on Biomedical Engineering, 54(10):1867-1874, September 2007 (article)

Abstract

Electrophysiological signals of the developing fetal brain and heart can be investigated by fetal magnetoencephalography (fMEG). During such investigations, the fetal heart activity and that of the mother should be monitored continuously to provide an important indication of current well-being. Due to physical constraints of an fMEG system, it is not possible to use clinically established heart monitors for this purpose. Considering this constraint, we developed a real-time heart monitoring system for biomagnetic measurements and showed its reliability and applicability in research and for clinical examinations. The developed system consists of real-time access to fMEG data, an algorithm based on Independent Component Analysis (ICA), and a graphical user interface (GUI). The algorithm extracts the current fetal and maternal heart signal from a noisy and artifact-contaminated data stream in real-time and is able to adapt automatically to continuously varying environmental parameters. This algorithm has been na med Adaptive Real-time ICA (ARICA) and is applicable to real-time artifact removal as well as to related blind signal separation problems.

PDF Web DOI [BibTex]

ei Waldert, S., Bensch, M., Bogdan, M., Rosenstiel, W., Schölkopf, B., Lowery, C., Eswaran, H., Preissl, H. Real-Time Fetal Heart Monitoring in Biomagnetic Measurements Using Adaptive Real-Time ICA IEEE Transactions on Biomedical Engineering, 54(10):1867-1874, September 2007 (article)

PDF Web DOI [BibTex]

Book Review: Computational Intelligence: Principles, Techniques and Applications by Amit Konar

Peters, J.

The Computer Journal, 50(6):758-758, September 2007 (article)

Web DOI [BibTex]

ei Peters, J. Book Review: Computational Intelligence: Principles, Techniques and Applications by Amit Konar The Computer Journal, 50(6):758-758, September 2007 (article)

Web DOI [BibTex]

Error Correcting Codes for the P300 Visual Speller

Biessmann, F.

Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, July 2007 (diplomathesis)

Abstract

The aim of brain-computer interface (BCI) research is to establish a communication system based on intentional modulation of brain activity. This is accomplished by classifying patterns of brain ac- tivity, volitionally induced by the user. The BCI presented in this study is based on a classical paradigm as proposed by (Farwell and Donchin, 1988), the P300 visual speller. Recording electroencephalo- grams (EEG) from the scalp while presenting letters successively to the user, the speller can infer from the brain signal which letter the user was focussing on. Since EEG recordings are noisy, usually many repetitions are needed to detect the correct letter. The focus of this study was to improve the accuracy of the visual speller applying some basic principles from information theory: Stimulus sequences of the speller have been modi&amp;amp;#64257;ed into error-correcting codes. Additionally a language model was incorporated into the probabilistic letter de- coder. Classi&amp;amp;#64257;cation of single EEG epochs was less accurate using error correcting codes. However, the novel code could compensate for that such that overall, letter accuracies were as high as or even higher than for classical stimulus codes. In particular at high noise levels, error-correcting decoding achieved higher letter accuracies.

PDF [BibTex]

ei Biessmann, F. Error Correcting Codes for the P300 Visual Speller Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, July 2007 (diplomathesis)

PDF [BibTex]

Feature Selection for Trouble Shooting in Complex Assembly Lines

Pfingsten, T., Herrmann, D., Schnitzler, T., Feustel, A., Schölkopf, B.

IEEE Transactions on Automation Science and Engineering, 4(3):465-469, July 2007 (article)

Abstract

The final properties of sophisticated products can be affected by many unapparent dependencies within the manufacturing process, and the products integrity can often only be checked in a final measurement. Troubleshooting can therefore be very tedious if not impossible in large assembly lines. In this paper we show that Feature Selection is an efficient tool for serial-grouped lines to reveal causes for irregularities in product attributes. We compare the performance of several methods for Feature Selection on real-world problems in mass-production of semiconductor devices. Note to Practitioners We present a data based procedure to localize flaws in large production lines: using the results of final quality inspections and information about which machines processed which batches, we are able to identify machines which cause low yield.

PDF Web DOI [BibTex]

ei Pfingsten, T., Herrmann, D., Schnitzler, T., Feustel, A., Schölkopf, B. Feature Selection for Trouble Shooting in Complex Assembly Lines IEEE Transactions on Automation Science and Engineering, 4(3):465-469, July 2007 (article)

PDF Web DOI [BibTex]

Gene selection via the BAHSIC family of algorithms

Song, L., Bedo, J., Borgwardt, K., Gretton, A., Smola, A.

Bioinformatics, 23(13: ISMB/ECCB 2007 Conference Proceedings):i490-i498, July 2007 (article)

Abstract

Motivation: Identifying significant genes among thousands of sequences on a microarray is a central challenge for cancer research in bioinformatics. The ultimate goal is to detect the genes that are involved in disease outbreak and progression. A multitude of methods have been proposed for this task of feature selection, yet the selected gene lists differ greatly between different methods. To accomplish biologically meaningful gene selection from microarray data, we have to understand the theoretical connections and the differences between these methods. In this article, we define a kernel-based framework for feature selection based on the Hilbert–Schmidt independence criterion and backward elimination, called BAHSIC. We show that several well-known feature selectors are instances of BAHSIC, thereby clarifying their relationship. Furthermore, by choosing a different kernel, BAHSIC allows us to easily define novel feature selection algorithms. As a further advantage, feature selection via BAHSIC works directly on multiclass problems. Results: In a broad experimental evaluation, the members of the BAHSIC family reach high levels of accuracy and robustness when compared to other feature selection techniques. Experiments show that features selected with a linear kernel provide the best classification performance in general, but if strong non-linearities are present in the data then non-linear kernels can be more suitable.

Web DOI [BibTex]

ei Song, L., Bedo, J., Borgwardt, K., Gretton, A., Smola, A. Gene selection via the BAHSIC family of algorithms Bioinformatics, 23(13: ISMB/ECCB 2007 Conference Proceedings):i490-i498, July 2007 (article)

Web DOI [BibTex]

Phenotyping of Chondrocytes In Vivo and In Vitro Using cDNA Array Technology

Zien, A., Gebhard, P., Fundel, K., Aigner, T.

Clinical Orthopaedics and Related Research, 460, pages: 226-233, July 2007 (article)

Abstract

The cDNA array technology is a powerful tool to analyze a high number of genes in parallel. We investigated whether large-scale gene expression analysis allows clustering and identification of cellular phenotypes of chondrocytes in different in vivo and in vitro conditions. In 100% of cases, clustering analysis distinguished between in vivo and in vitro samples, suggesting fundamental differences in chondrocytes in situ and in vitro regardless of the culture conditions or disease status. It also allowed us to differentiate between healthy and osteoarthritic cartilage. The clustering also revealed the relative importance of the investigated culturing conditions (stimulation agent, stimulation time, bead/monolayer). We augmented the cluster analysis with a statistical search for genes showing differential expression. The identified genes provided hints to the molecular basis of the differences between the sample classes. Our approach shows the power of modern bioinformatic algorithms for understanding and class ifying chondrocytic phenotypes in vivo and in vitro. Although it does not generate new experimental data per se, it provides valuable information regarding the biology of chondrocytes and may provide tools for diagnosing and staging the osteoarthritic disease process.

DOI [BibTex]

ei Zien, A., Gebhard, P., Fundel, K., Aigner, T. Phenotyping of Chondrocytes In Vivo and In Vitro Using cDNA Array Technology Clinical Orthopaedics and Related Research, 460, pages: 226-233, July 2007 (article)

DOI [BibTex]

Common Sequence Polymorphisms Shaping Genetic Diversity in Arabidopsis thaliana

Clark, R., Schweikert, G., Toomajian, C., Ossowski, S., Zeller, G., Shinn, P., Warthmann, N., Hu, T., Fu, G., Hinds, D., Chen, H., Frazer, K., Huson, D., Schölkopf, B., Nordborg, M., Rätsch, G., Ecker, J., Weigel, D.

Science, 317(5836):338-342, July 2007 (article)

Abstract

The genomes of individuals from the same species vary in sequence as a result of different evolutionary processes. To examine the patterns of, and the forces shaping, sequence variation in Arabidopsis thaliana, we performed high-density array resequencing of 20 diverse strains (accessions). More than 1 million nonredundant single-nucleotide polymorphisms (SNPs) were identified at moderate false discovery rates (FDRs), and ~4% of the genome was identified as being highly dissimilar or deleted relative to the reference genome sequence. Patterns of polymorphism are highly nonrandom among gene families, with genes mediating interaction with the biotic environment having exceptional polymorphism levels. At the chromosomal scale, regional variation in polymorphism was readily apparent. A scan for recent selective sweeps revealed several candidate regions, including a notable example in which almost all variation was removed in a 500-kilobase window. Analyzing the polymorphisms we describe in larger sets of accessions will enable a detailed understanding of forces shaping population-wide sequence variation in A. thaliana.

PDF DOI [BibTex]

ei Clark, R., Schweikert, G., Toomajian, C., Ossowski, S., Zeller, G., Shinn, P., Warthmann, N., Hu, T., Fu, G., Hinds, D., Chen, H., Frazer, K., Huson, D., Schölkopf, B., Nordborg, M., Rätsch, G., Ecker, J., Weigel, D. Common Sequence Polymorphisms Shaping Genetic Diversity in Arabidopsis thaliana Science, 317(5836):338-342, July 2007 (article)

PDF DOI [BibTex]

Graph Laplacians and their Convergence on Random Neighborhood Graphs

Hein, M., Audibert, J., von Luxburg, U.

Journal of Machine Learning Research, 8, pages: 1325-1370, June 2007 (article)

Abstract

Given a sample from a probability measure with support on a submanifold in Euclidean space one can construct a neighborhood graph which can be seen as an approximation of the submanifold. The graph Laplacian of such a graph is used in several machine learning methods like semi-supervised learning, dimensionality reduction and clustering. In this paper we determine the pointwise limit of three different graph Laplacians used in the literature as the sample size increases and the neighborhood size approaches zero. We show that for a uniform measure on the submanifold all graph Laplacians have the same limit up to constants. However in the case of a non-uniform measure on the submanifold only the so called random walk graph Laplacian converges to the weighted Laplace-Beltrami operator.

PDF PDF [BibTex]

ei Hein, M., Audibert, J., von Luxburg, U. Graph Laplacians and their Convergence on Random Neighborhood Graphs Journal of Machine Learning Research, 8, pages: 1325-1370, June 2007 (article)

PDF PDF [BibTex]

Bayesian Reconstruction of the Density of States

Habeck, M.

Physical Review Letters, 98(20, 200601):1-4, May 2007 (article)

Abstract

A Bayesian framework is developed to reconstruct the density of states from multiple canonical simulations. The framework encompasses the histogram reweighting method of Ferrenberg and Swendsen. The new approach applies to nonparametric as well as parametric models and does not require simulation data to be discretized. It offers a means to assess the precision of the reconstructed density of states and of derived thermodynamic quantities.

Web DOI [BibTex]

ei Habeck, M. Bayesian Reconstruction of the Density of States Physical Review Letters, 98(20, 200601):1-4, May 2007 (article)

Web DOI [BibTex]

PALMA: mRNA to Genome Alignments using Large Margin Algorithms

Schulze, U., Hepp, B., Ong, C., Rätsch, G.

Bioinformatics, 23(15):1892-1900, May 2007 (article)

Abstract

Motivation: Despite many years of research on how to properly align sequences in the presence of sequencing errors, alternative splicing and micro-exons, the correct alignment of mRNA sequences to genomic DNA is still a challenging task. Results: We present a novel approach based on large margin learning that combines accurate plice site predictions with common sequence alignment techniques. By solving a convex optimization problem, our algorithm called PALMA tunes the parameters of the model such that true alignments score higher than other alignments. We study the accuracy of alignments of mRNAs containing artificially generated micro-exons to genomic DNA. In a carefully designed experiment, we show that our algorithm accurately identifies the intron boundaries as well as boundaries of the optimal local alignment. It outperforms all other methods: for 5702 artificially shortened EST sequences from C. elegans and human it correctly identifies the intron boundaries in all except two cases. The best other method is a recently proposed method called exalin which misaligns 37 of the sequences. Our method also demonstrates robustness to mutations, insertions and deletions, retaining accuracy even at high noise levels. Availability: Datasets for training, evaluation and testing, additional results and a stand-alone alignment tool implemented in C++ and python are available at http://www.fml.mpg.de/raetsch/projects/palma.

Web DOI [BibTex]

ei Schulze, U., Hepp, B., Ong, C., Rätsch, G. PALMA: mRNA to Genome Alignments using Large Margin Algorithms Bioinformatics, 23(15):1892-1900, May 2007 (article)

Web DOI [BibTex]

Nonparametric Bayesian Discrete Latent Variable Models for Unsupervised Learning

Görür, D.

Biologische Kybernetik, Technische Universität Berlin, Berlin, Germany, April 2007, published online (phdthesis)

PDF PDF [BibTex]

ei Görür, D. Nonparametric Bayesian Discrete Latent Variable Models for Unsupervised Learning Biologische Kybernetik, Technische Universität Berlin, Berlin, Germany, April 2007, published online (phdthesis)

PDF PDF [BibTex]

Texture and object motion in slant discrimination: Failure of reliability-based weighting of cues may be evidence for strong fusion

Rosas, P., Wichmann, F., Wagemans, J.

Journal of Vision, 7(6:3):1-21, April 2007 (article)

PDF DOI [BibTex]

ei Rosas, P., Wichmann, F., Wagemans, J. Texture and object motion in slant discrimination: Failure of reliability-based weighting of cues may be evidence for strong fusion Journal of Vision, 7(6:3):1-21, April 2007 (article)

PDF DOI [BibTex]

Training a Support Vector Machine in the Primal

Chapelle, O.

Neural Computation, 19(5):1155-1178, March 2007 (article)

Abstract

Most literature on Support Vector Machines (SVMs) concentrate on the dual optimization problem. In this paper, we would like to point out that the primal problem can also be solved efficiently, both for linear and non-linear SVMs, and that there is no reason for ignoring this possibilty. On the contrary, from the primal point of view new families of algorithms for large scale SVM training can be investigated.

PDF Web DOI [BibTex]

ei Chapelle, O. Training a Support Vector Machine in the Primal Neural Computation, 19(5):1155-1178, March 2007 (article)

PDF Web DOI [BibTex]

Applications of Kernel Machines to Structured Data

Eichhorn, J.

Biologische Kybernetik, Technische Universität Berlin, Berlin, Germany, March 2007, passed with "sehr gut", published online (phdthesis)

PDF [BibTex]

ei Eichhorn, J. Applications of Kernel Machines to Structured Data Biologische Kybernetik, Technische Universität Berlin, Berlin, Germany, March 2007, passed with "sehr gut", published online (phdthesis)

PDF [BibTex]

A priori Knowledge from Non-Examples

Sinz, FH.

Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, March 2007 (diplomathesis)

PDF Web [BibTex]

ei Sinz, FH. A priori Knowledge from Non-Examples Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, March 2007 (diplomathesis)

PDF Web [BibTex]

Improving the Caenorhabditis elegans Genome Annotation Using Machine Learning

Rätsch, G., Sonnenburg, S., Srinivasan, J., Witte, H., Müller, K., Sommer, R., Schölkopf, B.

PLoS Computational Biology, 3(2, e20):0313-0322, February 2007 (article)

PDF DOI [BibTex]

ei Rätsch, G., Sonnenburg, S., Srinivasan, J., Witte, H., Müller, K., Sommer, R., Schölkopf, B. Improving the Caenorhabditis elegans Genome Annotation Using Machine Learning PLoS Computational Biology, 3(2, e20):0313-0322, February 2007 (article)

PDF DOI [BibTex]

Quantum broadcasting problem in classical low-power signal processing

Janzing, D., Steudel, B.

Physical Review A, 75(2):11, February 2007 (article)

Web DOI [BibTex]

ei Janzing, D., Steudel, B. Quantum broadcasting problem in classical low-power signal processing Physical Review A, 75(2):11, February 2007 (article)

Web DOI [BibTex]

Statistical Consistency of Kernel Canonical Correlation Analysis

Fukumizu, K., Bach, F., Gretton, A.

Journal of Machine Learning Research, 8, pages: 361-383, February 2007 (article)

Abstract

While kernel canonical correlation analysis (CCA) has been applied in many contexts, the convergence of finite sample estimates of the associated functions to their population counterparts has not yet been established. This paper gives a mathematical proof of the statistical convergence of kernel CCA, providing a theoretical justification for the method. The proof uses covariance operators defined on reproducing kernel Hilbert spaces, and analyzes the convergence of their empirical estimates of finite rank to their population counterparts, which can have infinite rank. The result also gives a sufficient condition for convergence on the regularization coefficient involved in kernel CCA: this should decrease as n^{-1/3}, where n is the number of data.

PDF [BibTex]

ei Fukumizu, K., Bach, F., Gretton, A. Statistical Consistency of Kernel Canonical Correlation Analysis Journal of Machine Learning Research, 8, pages: 361-383, February 2007 (article)

PDF [BibTex]

Machine Learning for Mass Production and Industrial Engineering

Pfingsten, T.

Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, February 2007 (phdthesis)

PDF [BibTex]

ei Pfingsten, T. Machine Learning for Mass Production and Industrial Engineering Biologische Kybernetik, Eberhard-Karls-Universität Tübingen, Tübingen, Germany, February 2007 (phdthesis)

PDF [BibTex]

Some observations on the pedestal effect

Henning, G., Wichmann, F.

Journal of Vision, 7(1:3):1-15, January 2007 (article)

Abstract

The pedestal or dipper effect is the large improvement in the detectability of a sinusoidal grating observed when it is added to a masking or pedestal grating of the same spatial frequency, orientation, and phase. We measured the pedestal effect in both broadband and notched noiseVnoise from which a 1.5-octave band centered on the signal frequency had been removed. Although the pedestal effect persists in broadband noise, it almost disappears in the notched noise. Furthermore, the pedestal effect is substantial when either high- or low-pass masking noise is used. We conclude that the pedestal effect in the absence of notched noise results principally from the use of information derived from channels with peak sensitivities at spatial frequencies different from that of the signal and the pedestal. We speculate that the spatial-frequency components of the notched noise above and below the spatial frequency of the signal and the pedestal prevent off-frequency looking, that is, prevent the use of information about changes in contrast carried in channels tuned to spatial frequencies that are very much different from that of the signal and the pedestal. Thus, the pedestal or dipper effect measured without notched noise appears not to be a characteristic of individual spatial-frequency-tuned channels.

PDF Web DOI [BibTex]

ei Henning, G., Wichmann, F. Some observations on the pedestal effect Journal of Vision, 7(1:3):1-15, January 2007 (article)

PDF Web DOI [BibTex]

Development of a Brain-Computer Interface Approach Based on Covert Attention to Tactile Stimuli

Raths, C.

University of Tübingen, Germany, University of Tübingen, Germany, January 2007 (diplomathesis)

[BibTex]

ei Raths, C. Development of a Brain-Computer Interface Approach Based on Covert Attention to Tactile Stimuli University of Tübingen, Germany, University of Tübingen, Germany, January 2007 (diplomathesis)

[BibTex]

Cue Combination and the Effect of Horizontal Disparity and Perspective on Stereoacuity

Zalevski, AM., Henning, GB., Hill, NJ.

Spatial Vision, 20(1):107-138, January 2007 (article)

Abstract

Relative depth judgments of vertical lines based on horizontal disparity deteriorate enormously when the lines form part of closed configurations (Westheimer, 1979). In studies showing this effect, perspective was not manipulated and thus produced inconsistency between horizontal disparity and perspective. We show that stereoacuity improves dramatically when perspective and horizontal disparity are made consistent. Observers appear to use unhelpful perspective cues in judging the relative depth of the vertical sides of rectangles in a way not incompatible with a form of cue weighting. However, 95% confidence intervals for the weights derived for cues usually exceed the a-priori [0-1] range.

PDF PDF DOI [BibTex]

ei Zalevski, AM., Henning, GB., Hill, NJ. Cue Combination and the Effect of Horizontal Disparity and Perspective on Stereoacuity Spatial Vision, 20(1):107-138, January 2007 (article)

PDF PDF DOI [BibTex]

A Machine Learning Approach for Estimating the Attenuation Map for a Combined PET/MR Scanner

Hofmann, M.

Biologische Kybernetik, Max-Planck Institute for Biological Cybernetics, Tübingen, Germany, 2007 (diplomathesis)

[BibTex]

ei Hofmann, M. A Machine Learning Approach for Estimating the Attenuation Map for a Combined PET/MR Scanner Biologische Kybernetik, Max-Planck Institute for Biological Cybernetics, Tübingen, Germany, 2007 (diplomathesis)

[BibTex]

Frequency-domain displacement sensing with a fiber ring-resonator containing a variable gap

Vollmer, F., Fischer, P.

SENSORS AND ACTUATORS A-PHYSICAL, 134(2):410-413, 2007 (article)

Abstract

Ring-resonators are in general not amenable to strain-free (non-contact) displacement measurements. We show that this limitation may be overcome if the ring-resonator, here a fiber-loop, is designed to contain a gap, such that the light traverses a free-space part between two aligned waveguide ends. Displacements are determined with nanometer sensitivity by measuring the associated changes in the resonance frequencies. Miniaturization should increase the sensitivity of the ring-resonator interferometer. Ring geometries that contain an optical circulator can be used to profile reflective samples. (c) 2006 Elsevier B.V. All rights reserved.

DOI [BibTex]

pf Vollmer, F., Fischer, P. Frequency-domain displacement sensing with a fiber ring-resonator containing a variable gap SENSORS AND ACTUATORS A-PHYSICAL, 134(2):410-413, 2007 (article)

DOI [BibTex]

Observation of the Faraday effect via beam deflection in a longitudinal magnetic field

Ghosh, A., Hill, W., Fischer, P.

PHYSICAL REVIEW A, 76(5), 2007 (article)

Abstract

We show that magnetic-field-induced circular differential deflection of light can be observed in reflection or refraction at a single interface. The difference in the reflection or refraction angles between the two circular polarization components is a function of the magnetic-field strength and the Verdet constant, and permits the observation of the Faraday effect not via polarization rotation in transmission, but via changes in the propagation direction. Deflection measurements do not suffer from n-pi ambiguities and are shown to be another means to map magnetic fields with high axial resolution, or to determine the sign and magnitude of magnetic-field pulses in a single measurement.

DOI [BibTex]

pf Ghosh, A., Hill, W., Fischer, P. Observation of the Faraday effect via beam deflection in a longitudinal magnetic field PHYSICAL REVIEW A, 76(5), 2007 (article)

DOI [BibTex]

Comment on “negative refraction at optical frequencies in nonmagnetic two-component molecular media” - Reply

Chen, Y., Fischer, P., Wise, F. W.

PHYSICAL REVIEW LETTERS, 98(5), 2007 (article)

DOI [BibTex]

pf Chen, Y., Fischer, P., Wise, F. W. Comment on “negative refraction at optical frequencies in nonmagnetic two-component molecular media” - Reply PHYSICAL REVIEW LETTERS, 98(5), 2007 (article)

DOI [BibTex]

Circular differential double diffraction in chiral media

Ghosh, A., Fazal, F. M., Fischer, P.

OPTICS LETTERS, 32(13):1836-1838, 2007 (article)

Abstract

In an optically active liquid the diffraction angle depends on the circular polarization state of the incident light beam. We report the observation of circular differential diffraction in an isotropic chiral medium, and we demonstrate that double diffraction is an alternate means to determine the handedness (enantiomeric excess) of a solution. (c) 2007 Optical Society of America.

DOI [BibTex]

pf Ghosh, A., Fazal, F. M., Fischer, P. Circular differential double diffraction in chiral media OPTICS LETTERS, 32(13):1836-1838, 2007 (article)

DOI [BibTex]

Bacterial flagella-based propulsion and on/off motion control of microscale objects

Behkam, B., Sitti, M.

Applied Physics Letters, 90(2):023902, AIP, 2007 (article)

[BibTex]

pi Behkam, B., Sitti, M. Bacterial flagella-based propulsion and on/off motion control of microscale objects Applied Physics Letters, 90(2):023902, AIP, 2007 (article)

[BibTex]

Friction of partially embedded vertically aligned carbon nanofibers inside elastomers

Aksak, B., Sitti, M., Cassell, A., Li, J., Meyyappan, M., Callen, P.

Applied Physics Letters, 91(6):061906, AIP, 2007 (article)

[BibTex]

pi Aksak, B., Sitti, M., Cassell, A., Li, J., Meyyappan, M., Callen, P. Friction of partially embedded vertically aligned carbon nanofibers inside elastomers Applied Physics Letters, 91(6):061906, AIP, 2007 (article)

[BibTex]

Enhanced friction of elastomer microfiber adhesives with spatulate tips

Kim, S., Aksak, B., Sitti, M.

Applied Physics Letters, 91(22):221913, AIP, 2007 (article)

Project Page [BibTex]

pi Kim, S., Aksak, B., Sitti, M. Enhanced friction of elastomer microfiber adhesives with spatulate tips Applied Physics Letters, 91(22):221913, AIP, 2007 (article)

Project Page [BibTex]

The new robotics - towards human-centered machines

Schaal, S.

HFSP Journal Frontiers of Interdisciplinary Research in the Life Sciences, 1(2):115-126, 2007, clmc (article)

Abstract

Research in robotics has moved away from its primary focus on industrial applications. The New Robotics is a vision that has been developed in past years by our own university and many other national and international research instiutions and addresses how increasingly more human-like robots can live among us and take over tasks where our current society has shortcomings. Elder care, physical therapy, child education, search and rescue, and general assistance in daily life situations are some of the examples that will benefit from the New Robotics in the near future. With these goals in mind, research for the New Robotics has to embrace a broad interdisciplinary approach, ranging from traditional mathematical issues of robotics to novel issues in psychology, neuroscience, and ethics. This paper outlines some of the important research problems that will need to be resolved to make the New Robotics a reality.

link (url) [BibTex]

am Schaal, S. The new robotics - towards human-centered machines HFSP Journal Frontiers of Interdisciplinary Research in the Life Sciences, 1(2):115-126, 2007, clmc (article)

link (url) [BibTex]

On the theory of magnetization dynamics of non-collinear spin systems in the s-d model

De Angeli, L.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

mms De Angeli, L. On the theory of magnetization dynamics of non-collinear spin systems in the s-d model Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

[BibTex]

Zur ab-initio Elektronentheorie des Magnetismus bei endlichen Temperaturen

Dietermann, F.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

mms Dietermann, F. Zur ab-initio Elektronentheorie des Magnetismus bei endlichen Temperaturen Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

[BibTex]

Röntgenzirkulardichroische Untersuchungen an ferromagnetischen verdünnten Halbleitersystemen

Tietze, T.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

mms Tietze, T. Röntgenzirkulardichroische Untersuchungen an ferromagnetischen verdünnten Halbleitersystemen Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

[BibTex]

Low-dimensional Fe on vicinal Ir(997): Growth and magnetic properties

Kawwam, M.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

mms Kawwam, M. Low-dimensional Fe on vicinal Ir(997): Growth and magnetic properties Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

[BibTex]

Micromagnetic simulations of switching processes and the role of thermal fluctuations

Macke, S.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

mms Macke, S. Micromagnetic simulations of switching processes and the role of thermal fluctuations Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

[BibTex]

Hydrogen storage in metal-organic frameworks

Hirscher, M., Panella, B.

{Scripta Materialia}, 56, pages: 809-812, 2007 (article)

mms

[BibTex]

mms Hirscher, M., Panella, B. Hydrogen storage in metal-organic frameworks {Scripta Materialia}, 56, pages: 809-812, 2007 (article)

[BibTex]

Substrate-induced current anisotropy in YBa2Cu3O7-δthin films

Djupmyr, M., Albrecht, J.

{Physica C}, 460-462, pages: 1190-1191, 2007 (article)

mms

DOI [BibTex]

mms Djupmyr, M., Albrecht, J. Substrate-induced current anisotropy in YBa2Cu3O7-δthin films {Physica C}, 460-462, pages: 1190-1191, 2007 (article)

DOI [BibTex]

A micellar approach to magnetic ultrahigh-density data-storage media: extending the limits of current colloidal methods

Ethirajan, A., Wiedwald, U., Boyen, H.-G., Kern, B., Han, L., Klimmer, A., Weigl, F., Kästle, G., Ziemann, P., Fauth, K., Cai, J., Behm, J., Romanyuk, A., Oelhafen, P., Walther, P., Biskupek, J., Kaiser, U.

{Advanced Materials}, 19, pages: 406-410, 2007 (article)

mms

[BibTex]

mms Ethirajan, A., Wiedwald, U., Boyen, H.-G., Kern, B., Han, L., Klimmer, A., Weigl, F., Kästle, G., Ziemann, P., Fauth, K., Cai, J., Behm, J., Romanyuk, A., Oelhafen, P., Walther, P., Biskupek, J., Kaiser, U. A micellar approach to magnetic ultrahigh-density data-storage media: extending the limits of current colloidal methods {Advanced Materials}, 19, pages: 406-410, 2007 (article)

[BibTex]