Header logo is


2015


Automatic LQR Tuning Based on Gaussian Process Optimization: Early Experimental Results
Automatic LQR Tuning Based on Gaussian Process Optimization: Early Experimental Results

Marco, A., Hennig, P., Bohg, J., Schaal, S., Trimpe, S.

Machine Learning in Planning and Control of Robot Motion Workshop at the IEEE/RSJ International Conference on Intelligent Robots and Systems (iROS), pages: , , Machine Learning in Planning and Control of Robot Motion Workshop, October 2015 (conference)

Abstract
This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved according to a pre-defined performance objective evaluated from experimental data. The underlying Bayesian optimization algorithm is Entropy Search, which represents the latent objective as a Gaussian process and constructs an explicit belief over the location of the objective minimum. This is used to maximize the information gain from each experimental evaluation. Thus, this framework shall yield improved controllers with fewer evaluations compared to alternative approaches. A seven-degree-of-freedom robot arm balancing an inverted pole is used as the experimental demonstrator. Preliminary results of a low-dimensional tuning problem highlight the method’s potential for automatic controller tuning on robotic platforms.

am ei ics pn

PDF DOI Project Page [BibTex]

2015


PDF DOI Project Page [BibTex]


Direct Loss Minimization Inverse Optimal Control
Direct Loss Minimization Inverse Optimal Control

Doerr, A., Ratliff, N., Bohg, J., Toussaint, M., Schaal, S.

In Proceedings of Robotics: Science and Systems, Rome, Italy, Robotics: Science and Systems XI, July 2015 (inproceedings)

Abstract
Inverse Optimal Control (IOC) has strongly impacted the systems engineering process, enabling automated planner tuning through straightforward and intuitive demonstration. The most successful and established applications, though, have been in lower dimensional problems such as navigation planning where exact optimal planning or control is feasible. In higher dimensional systems, such as humanoid robots, research has made substantial progress toward generalizing the ideas to model free or locally optimal settings, but these systems are complicated to the point where demonstration itself can be difficult. Typically, real-world applications are restricted to at best noisy or even partial or incomplete demonstrations that prove cumbersome in existing frameworks. This work derives a very flexible method of IOC based on a form of Structured Prediction known as Direct Loss Minimization. The resulting algorithm is essentially Policy Search on a reward function that rewards similarity to demonstrated behavior (using Covariance Matrix Adaptation (CMA) in our experiments). Our framework blurs the distinction between IOC, other forms of Imitation Learning, and Reinforcement Learning, enabling us to derive simple, versatile, and practical algorithms that blend imitation and reinforcement signals into a unified framework. Our experiments analyze various aspects of its performance and demonstrate its efficacy on conveying preferences for motion shaping and combined reach and grasp quality optimization.

am ics

PDF Video Project Page [BibTex]

PDF Video Project Page [BibTex]


no image
LMI-Based Synthesis for Distributed Event-Based State Estimation

Muehlebach, M., Trimpe, S.

In Proceedings of the American Control Conference, July 2015 (inproceedings)

Abstract
This paper presents an LMI-based synthesis procedure for distributed event-based state estimation. Multiple agents observe and control a dynamic process by sporadically exchanging data over a broadcast network according to an event-based protocol. In previous work [1], the synthesis of event-based state estimators is based on a centralized design. In that case three different types of communication are required: event-based communication of measurements, periodic reset of all estimates to their joint average, and communication of inputs. The proposed synthesis problem eliminates the communication of inputs as well as the periodic resets (under favorable circumstances) by accounting explicitly for the distributed structure of the control system.

am ics

PDF DOI Project Page [BibTex]

PDF DOI Project Page [BibTex]


no image
Guaranteed H2 Performance in Distributed Event-Based State Estimation

Muehlebach, M., Trimpe, S.

In Proceeding of the First International Conference on Event-based Control, Communication, and Signal Processing, June 2015 (inproceedings)

am ics

PDF DOI Project Page [BibTex]

PDF DOI Project Page [BibTex]


no image
On the Choice of the Event Trigger in Event-based Estimation

Trimpe, S., Campi, M.

In Proceeding of the First International Conference on Event-based Control, Communication, and Signal Processing, June 2015 (inproceedings)

am ics

PDF DOI Project Page [BibTex]

PDF DOI Project Page [BibTex]


no image
Toward a large-scale visuo-haptic dataset for robotic learning

Burka, A., Hu, S., Krishnan, S., Kuchenbecker, K. J., Hendricks, L. A., Gao, Y., Darrell, T.

In Proc. CVPR Workshop on the Future of Datasets in Vision, 2015 (inproceedings)

hi

Project Page [BibTex]

Project Page [BibTex]


no image
Detecting Lumps in Simulated Tissue via Palpation with a BioTac

Hui, J., Block, A., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, 2015, Work-in-progress paper. Poster presentation given by Hui (inproceedings)

hi

[BibTex]

[BibTex]


no image
Analysis of the Instrument Vibrations and Contact Forces Caused by an Expert Robotic Surgeon Doing FRS Tasks

Brown, J. D., O’Brien, C., Miyasaka, K., Dumon, K. R., Kuchenbecker, K. J.

In Proc. Hamlyn Symposium on Medical Robotics, pages: 75-76, London, England, June 2015, Poster presentation given by Brown (inproceedings)

hi

[BibTex]

[BibTex]


no image
Should Haptic Texture Vibrations Respond to User Force and Speed?

Culbertson, H., Kuchenbecker, K. J.

In IEEE World Haptics Conference, pages: 106 - 112, Evanston, Illinois, USA, June 2015, Oral presentation given by Culbertson (inproceedings)

hi

[BibTex]

[BibTex]


no image
Enabling the Baxter Robot to Play Hand-Clapping Games

Fitter, N. T., Neuburger, M., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, June 2015, Work-in-progress paper. Poster presentation given by Fitter (inproceedings)

hi

[BibTex]

[BibTex]


no image
Event-based Estimation and Control for Remote Robot Operation with Reduced Communication

Trimpe, S., Buchli, J.

In Proceedings of the IEEE International Conference on Robotics and Automation, May 2015 (inproceedings)

Abstract
An event-based communication framework for remote operation of a robot via a bandwidth-limited network is proposed. The robot sends state and environment estimation data to the operator, and the operator transmits updated control commands or policies to the robot. Event-based communication protocols are designed to ensure that data is transmitted only when required: the robot sends new estimation data only if this yields a significant information gain at the operator, and the operator transmits an updated control policy only if this comes with a significant improvement in control performance. The developed framework is modular and can be used with any standard estimation and control algorithms. Simulation results of a robotic arm highlight its potential for an efficient use of limited communication resources, for example, in disaster response scenarios such as the DARPA Robotics Challenge.

am ics

PDF DOI Project Page [BibTex]

PDF DOI Project Page [BibTex]


no image
Using IMU Data to Teach a Robot Hand-Clapping Games

Fitter, N. T., Kuchenbecker, K. J.

In Proc. IEEE Haptics Symposium, pages: 353-355, April 2015, Work-in-progress paper. Poster presentation given by Fitter (inproceedings)

hi

[BibTex]

[BibTex]


no image
Haptic Feedback in Transoral Robotic Surgery: A Feasibility Study

Bur, A. M., Gomez, E. D., Rassekh, C. H., Newman, J. G., Weinstein, G. S., Kuchenbecker, K. J.

In Proc. Annual Meeting of the Triological Society at COSM, April 2015, Poster presentation given by Bur (inproceedings)

hi

[BibTex]

[BibTex]


no image
Design and Validation of a Practical Simulator for Transoral Robotic Surgery

Bur, A. M., Gomez, E. D., Chalian, A. A., Newman, J. G., Weinstein, G. S., Kuchenbecker, K. J.

In Proc. Society for Robotic Surgery Annual Meeting: Transoral Program, (T8), February 2015, Oral presentation given by Bur (inproceedings)

hi

[BibTex]

[BibTex]


no image
Inference of Cause and Effect with Unsupervised Inverse Regression

Sgouritsa, E., Janzing, D., Hennig, P., Schölkopf, B.

In Proceedings of the 18th International Conference on Artificial Intelligence and Statistics, 38, pages: 847-855, JMLR Workshop and Conference Proceedings, (Editors: Lebanon, G. and Vishwanathan, S.V.N.), JMLR.org, AISTATS, 2015 (inproceedings)

ei pn

Web PDF [BibTex]

Web PDF [BibTex]


Probabilistic Line Searches for Stochastic Optimization
Probabilistic Line Searches for Stochastic Optimization

Mahsereci, M., Hennig, P.

In Advances in Neural Information Processing Systems 28, pages: 181-189, (Editors: C. Cortes, N.D. Lawrence, D.D. Lee, M. Sugiyama and R. Garnett), Curran Associates, Inc., 29th Annual Conference on Neural Information Processing Systems (NIPS), 2015 (inproceedings)

Abstract
In deterministic optimization, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for a strict sequence of decisions collapsing the search space. We construct a probabilistic line search by combining the structure of existing deterministic methods with notions from Bayesian optimization. Our method retains a Gaussian process surrogate of the univariate optimization objective, and uses a probabilistic belief over the Wolfe conditions to monitor the descent. The algorithm has very low computational cost, and no user-controlled parameters. Experiments show that it effectively removes the need to define a learning rate for stochastic gradient descent. [You can find the matlab research code under `attachments' below. The zip-file contains a minimal working example. The docstring in probLineSearch.m contains additional information. A more polished implementation in C++ will be published here at a later point. For comments and questions about the code please write to mmahsereci@tue.mpg.de.]

ei pn

Matlab research code link (url) [BibTex]

Matlab research code link (url) [BibTex]


no image
A Random Riemannian Metric for Probabilistic Shortest-Path Tractography

Hauberg, S., Schober, M., Liptrot, M., Hennig, P., Feragen, A.

In 18th International Conference on Medical Image Computing and Computer Assisted Intervention, 9349, pages: 597-604, Lecture Notes in Computer Science, MICCAI, 2015 (inproceedings)

ei pn

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
A New Perspective and Extension of the Gaussian Filter

Wüthrich, M., Trimpe, S., Kappler, D., Schaal, S.

In Robotics: Science and Systems, 2015 (inproceedings)

Abstract
The Gaussian Filter (GF) is one of the most widely used filtering algorithms; instances are the Extended Kalman Filter, the Unscented Kalman Filter and the Divided Difference Filter. GFs represent the belief of the current state by a Gaussian with the mean being an affine function of the measurement. We show that this representation can be too restrictive to accurately capture the dependencies in systems with nonlinear observation models, and we investigate how the GF can be generalized to alleviate this problem. To this end we view the GF from a variational-inference perspective, and analyze how restrictions on the form of the belief can be relaxed while maintaining simplicity and efficiency. This analysis provides a basis for generalizations of the GF. We propose one such generalization which coincides with a GF using a virtual measurement, obtained by applying a nonlinear function to the actual measurement. Numerical experiments show that the proposed Feature Gaussian Filter (FGF) can have a substantial performance advantage over the standard GF for systems with nonlinear observation models.

am ics

Web PDF Project Page [BibTex]


no image
Combined FORC and x-ray microscopy study of magnetisation reversal in antidot lattices

Gräfe, J., Haering, F., Stahl, C., Weigand, M., Skripnik, M., Nowak, U., Ziemann, P., Wiedwald, U., Schütz, G., Goering, E.

In IEEE International Magnetics Conference (INTERMAG 2015), IEEE, Beijing, China, 2015 (inproceedings)

mms

DOI Project Page Project Page [BibTex]

DOI Project Page Project Page [BibTex]


no image
Local control of domain wall dynamics in ferromagnetic rings

Richter, K., Mawass, M., Krone, A., Krüger, B., Weigand, M., Stoll, H., Schütz, G., Kläui, M.

In IEEE International Magnetics Conference (INTERMAG 2015), IEEE, Beijing, China, 2015 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Ultrafast demagnetization after laser pulse irradiation in Ni: Ab-initio electron-phonon scattering and phase space calculations

Illg, C., Haag, M., Fähnle, M.

In Ultrafast Magnetism I. Proceedings of the International Conference UMC 2013, 159, pages: 131-133, Springer Proceedings in Physics, Springer, Strasbourg, 2015 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Automotive domain wall propagation in ferromagnetic rings

Richter, K., Mawass, M., Krone, A., Krüger, B., Weigand, M., Schütz, G., Stoll, H., Kläui, M.

In IEEE International Magnetics Conference (INTERMAG 2015), IEEE, Beijing, China, 2015 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
The third dimension: Vortex core reversal by interaction with \textquotesingleflexure modes’

Noske, M., Stoll, H., Fähnle, M., Weigand, M., Dieterle, G., Förster, J., Gangwar, A., Slavin, A., Back, C. H., Schütz, G.

In IEEE International Magnetics Conference (INTERMAG 2015), IEEE, Beijing, China, 2015 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Skyrmions at room temperature in magnetic multilayers

Moreau-Luchaire, C., Reyren, N., Moutafis, C., Sampaio, J., Van Horne, N., Vaz, C. A., Warnicke, P., Garcia, K., Weigand, M., Bouzehouane, K., Deranlot, C., George, J., Raabe, J., Cros, V., Fert, A.

In IEEE International Magnetics Conference (INTERMAG 2015), IEEE, Beijing, China, 2015 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]

2009


no image
Image-Enabled Force Feedback for Robotic Teleoperation of a Flexible Tool

Lindsey, Q., Tenenholtz, N., Lee, D. I., Kuchenbecker, K. J.

In Proc. IASTED International Conference on Robotics and Applications, pages: 224-233, Boston, Massachusetts, November 2009, Oral presentation given by Lindsey (inproceedings)

hi

[BibTex]

2009


[BibTex]


no image
GPU Methods for Real-Time Haptic Interaction with 3D Fluids

Yang, M., Lu, J., Safonova, A., Kuchenbecker, K. J.

In Proc. IEEE International Workshop on Haptic Audio-Visual Environments and Games, pages: 24-29, Lecco, Italy, November 2009, Oral presentation given by Kuchenbecker (inproceedings)

hi

[BibTex]

[BibTex]


no image
The AirWand: Design and Characterization of a Large-Workspace Haptic Device

Romano, J. M., Kuchenbecker, K. J.

In Proc. IEEE International Conference on Robotics and Automation, pages: 1461-1466, Kobe, Japan, May 2009, Oral presentation given by \uline{Romano} (inproceedings)

hi

[BibTex]

[BibTex]


no image
Stiffness Discrimination with Visual and Proprioceptive Cues

Gurari, N., Kuchenbecker, K. J., Okamura, A. M.

In Proc. IEEE World Haptics Conference, pages: 121-126, Salt Lake City, Utah, USA, March 2009, Poster presentation given by Gurari (inproceedings)

hi

[BibTex]

[BibTex]


no image
Toward Tactilely Transparent Gloves: Collocated Slip Sensing and Vibrotactile Actuation

Romano, J. M., Gray, S. R., Jacobs, N. T., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, pages: 279-284, Salt Lake City, Utah, USA, March 2009, Poster presentation given by Romano, Gray, and Jacobs (inproceedings)

hi

[BibTex]

[BibTex]


no image
A High-Fidelity Ungrounded Torque Feedback Device: The iTorqU 2.0

Winfree, K. N., Gewirtz, J., Mather, T., Fiene, J., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, pages: 261-266, Salt Lake City, Utah, USA, March 2009, Poster presentation given by Winfree and Gewirtz (inproceedings)

hi

[BibTex]

[BibTex]


no image
Real-Time Graphic and Haptic Simulation of Deformable Tissue Puncture

Romano, J. M., Safonova, A., Kuchenbecker, K. J.

In Proc. Medicine Meets Virtual Reality, Long Beach, California, USA, January 2009, Poster presentation given by Romano (inproceedings)

hi

[BibTex]

[BibTex]


no image
A Limiting Property of the Matrix Exponential with Application to Multi-loop Control

Trimpe, S., D’Andrea, R.

In Proceedings of the Joint 48th IEEE Conference on Decision (CDC) and Control and 28th Chinese Control Conference, 2009 (inproceedings)

am ics

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Haptic Display of Realistic Tool Contact Via Dynamically Compensated Control of a Dedicated Actuator

McMahan, W., Kuchenbecker, K. J.

In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages: 3171-3177, St. Louis, Missouri, USA, 2009, Oral presentation given by McMahan (inproceedings)

hi

[BibTex]

[BibTex]