Header logo is


2020


no image
Deep Graph Matching via Blackbox Differentiation of Combinatorial Solvers

Rolinek, M., Swoboda, P., Zietlow, D., Paulus, A., Musil, V., Martius, G.

In Computer Vision – ECCV 2020, Springer International Publishing, Cham, August 2020 (inproceedings)

Abstract
Building on recent progress at the intersection of combinatorial optimization and deep learning, we propose an end-to-end trainable architecture for deep graph matching that contains unmodified combinatorial solvers. Using the presence of heavily optimized combinatorial solvers together with some improvements in architecture design, we advance state-of-the-art on deep graph matching benchmarks for keypoint correspondence. In addition, we highlight the conceptual advantages of incorporating solvers into deep learning architectures, such as the possibility of post-processing with a strong multi-graph matching solver or the indifference to changes in the training setting. Finally, we propose two new challenging experimental setups.

al

Code Arxiv [BibTex]

2020


Code Arxiv [BibTex]


no image
Where Does It End? - Reasoning About Hidden Surfaces by Object Intersection Constraints

Strecke, M., Stückler, J.

In Proceedings IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR) 2020, June 2020 (inproceedings)

ev

preprint project page [BibTex]

preprint project page [BibTex]


Changes in Normal Force During Passive Dynamic Touch: Contact Mechanics and Perception
Changes in Normal Force During Passive Dynamic Touch: Contact Mechanics and Perception

Gueorguiev, D., Lambert, J., Thonnard, J., Kuchenbecker, K. J.

In Proceedings of the IEEE Haptics Symposium (HAPTICS), pages: 746-752, Washington, USA, March 2020 (inproceedings)

Abstract
Using a force-controlled robotic platform, we investigated the contact mechanics and psychophysical responses induced by negative and positive modulations in normal force during passive dynamic touch. In the natural state of the finger, the applied normal force modulation induces a correlated change in the tangential force. In a second condition, we applied talcum powder to the fingerpad, which induced a significant modification in the slope of the correlated tangential change. In both conditions, the same ten participants had to detect the interval that contained a decrease or an increase in the pre-stimulation normal force of 1 N. In the natural state, the 75% just noticeable difference for this task was found to be a ratio of 0.19 and 0.18 for decreases and increases, respectively. With talcum powder on the fingerpad, the normal force thresholds remained stable, following the Weber law of constant just noticeable differences, while the tangential force thresholds changed in the same way as the correlation slopes. This result suggests that participants predominantly relied on the normal force changes to perform the detection task. In addition, participants were asked to report whether the force decreased or increased. Their performance was generally poor at this second task even for above-threshold changes. However, their accuracy slightly improved with the talcum powder, which might be due to the reduced finger-surface friction.

hi

DOI [BibTex]

DOI [BibTex]


Acoustofluidic Tweezers for the 3D Manipulation of Microparticles
Acoustofluidic Tweezers for the 3D Manipulation of Microparticles

Guo, X., Ma, Z., Goyal, R., Jeong, M., Pang, W., Fischer, P., Dian, X., Qiu, T.

In 2020 IEEE International Conference on Robotics and Automation (ICRA),, Febuary 2020 (conference)

Abstract
Non-contact manipulation is of great importance in the actuation of micro-robotics. It is challenging to contactless manipulate micro-scale objects over large spatial distance in fluid. Here, we describe a novel approach for the dynamic position control of microparticles in three-dimensional (3D) space, based on high-speed acoustic streaming generated by a micro-fabricated gigahertz transducer. Due to the vertical lifting force and the horizontal centripetal force generated by the streaming, microparticles are able to be stably trapped at a position far away from the transducer surface, and to be manipulated over centimeter distance in all three directions. Only the hydrodynamic force is utilized in the system for particle manipulation, making it a versatile tool regardless the material properties of the trapped particle. The system shows high reliability and manipulation velocity, revealing its potentials for the applications in robotics and automation at small scales.

pf

[BibTex]

[BibTex]


no image
A Real-Robot Dataset for Assessing Transferability of Learned Dynamics Models

Agudelo-España, D., Zadaianchuk, A., Wenk, P., Garg, A., Akpo, J., Grimminger, F., Viereck, J., Naveau, M., Righetti, L., Martius, G., Krause, A., Schölkopf, B., Bauer, S., Wüthrich, M.

IEEE International Conference on Robotics and Automation (ICRA), 2020 (conference) Accepted

am al ei mg

Project Page PDF [BibTex]

Project Page PDF [BibTex]


no image
Learning to Identify Physical Parameters from Video Using Differentiable Physics

Kandukuri, R., Achterhold, J., Moeller, M., Stueckler, J.

Accepted for publication at the 42th German Conference on Pattern Recognition (GCPR), 2020, GCPR 2020 Honorable Mention (conference) Accepted

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Planning from Images with Deep Latent Gaussian Process Dynamics

Bosch, N., Achterhold, J., Leal-Taixe, L., Stückler, J.

Proceedings of the 2nd Conference on Learning for Dynamics and Control (L4DC), 120, pages: 640-650, Proceedings of Machine Learning Research (PMLR), (Editors: Alexandre M. Bayen and Ali Jadbabaie and George Pappas and Pablo A. Parrilo and Benjamin Recht and Claire Tomlin and Melanie Zeilinger), 2020, arXiv:2005.03770 (conference)

ev

preprint project page poster [BibTex]

preprint project page poster [BibTex]


Optimizing Rank-based Metrics with Blackbox Differentiation
Optimizing Rank-based Metrics with Blackbox Differentiation

Rolinek, M., Musil, V., Paulus, A., Vlastelica, M., Michaelis, C., Martius, G.

In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 7620-7630, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2020, 2020, Best paper nomination (inproceedings)

Abstract
Rank-based metrics are some of the most widely used criteria for performance evaluation of computer vision models. Despite years of effort, direct optimization for these metrics remains a challenge due to their non-differentiable and non-decomposable nature. We present an efficient, theoretically sound, and general method for differentiating rank-based metrics with mini-batch gradient descent. In addition, we address optimization instability and sparsity of the supervision signal that both arise from using rank-based metrics as optimization targets. Resulting losses based on recall and Average Precision are applied to image retrieval and object detection tasks. We obtain performance that is competitive with state-of-the-art on standard image retrieval datasets and consistently improve performance of near state-of-the-art object detectors.

al

Paper @ CVPR Long Oral Short Oral Arxiv Code Pdf Project Page [BibTex]

Paper @ CVPR Long Oral Short Oral Arxiv Code Pdf Project Page [BibTex]


no image
DirectShape: Photometric Alignment of Shape Priors for Visual Vehicle Pose and Shape Estimation

Wang, R., Yang, N., Stückler, J., Cremers, D.

In Proceedings of the IEEE international Conference on Robotics and Automation (ICRA), 2020, arXiv:1904.10097 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Learning to Adapt Multi-View Stereo by Self-Supervision

Mallick, A., Stückler, J., Lensch, H.

Proceedings of the British Machine Vision Conference (BMVC), 2020, to appear (conference) To be published

ev

link (url) [BibTex]

link (url) [BibTex]

2015


3D-printed Soft Microrobot for Swimming in Biological Fluids
3D-printed Soft Microrobot for Swimming in Biological Fluids

Qiu, T., Palagi, S., Fischer, P.

In Conf. Proc. IEEE Eng. Med. Biol. Soc., pages: 4922-4925, August 2015 (inproceedings)

Abstract
Microscopic artificial swimmers hold the potential to enable novel non-invasive medical procedures. In order to ease their translation towards real biomedical applications, simpler designs as well as cheaper yet more reliable materials and fabrication processes should be adopted, provided that the functionality of the microrobots can be kept. A simple single-hinge design could already enable microswimming in non-Newtonian fluids, which most bodily fluids are. Here, we address the fabrication of such single-hinge microrobots with a 3D-printed soft material. Firstly, a finite element model is developed to investigate the deformability of the 3D-printed microstructure under typical values of the actuating magnetic fields. Then the microstructures are fabricated by direct 3D-printing of a soft material and their swimming performances are evaluated. The speeds achieved with the 3D-printed microrobots are comparable to those obtained in previous work with complex fabrication procedures, thus showing great promise for 3D-printed microrobots to be operated in biological fluids.

pf

link (url) DOI [BibTex]

2015


link (url) DOI [BibTex]


no image
Assessing human-human therapy kinematics for retargeting to human-robot therapy

Johnson, M. J., Christopher, S. M., Mohan, M., Mendonca, R.

In Proceedings of the IEEE International Conference on Rehabilitation Robotics (ICORR), Singapore, August 2015 (inproceedings)

Abstract
In this paper, we present experiments examining the accuracy of data collected from a Kinect sensor for capturing close interactive actions of a therapist with a patient during stroke rehabilitation. Our long-term goal is to map human-human interactions such as these patient-therapist ones onto human-robot interactions. In many robot interaction scenarios, the robot does not mimic interaction between two or more humans, which is a major part of stroke therapy. The Kinect works for functional tasks such as a reaching task where the interaction to be retargeted by the robot is minimal to none; though this data is not good for a functional task involving touching another person. We demonstrate that the noisy data from Kinect does not produce a system robust enough to be for remapping to a humanoid robot a therapit's movements when in contact with a person.

hi

DOI [BibTex]

DOI [BibTex]


no image
Toward a large-scale visuo-haptic dataset for robotic learning

Burka, A., Hu, S., Krishnan, S., Kuchenbecker, K. J., Hendricks, L. A., Gao, Y., Darrell, T.

In Proc. CVPR Workshop on the Future of Datasets in Vision, 2015 (inproceedings)

hi

Project Page [BibTex]

Project Page [BibTex]


no image
Detecting Lumps in Simulated Tissue via Palpation with a BioTac

Hui, J., Block, A., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, 2015, Work-in-progress paper. Poster presentation given by Hui (inproceedings)

hi

[BibTex]

[BibTex]


no image
Analysis of the Instrument Vibrations and Contact Forces Caused by an Expert Robotic Surgeon Doing FRS Tasks

Brown, J. D., O’Brien, C., Miyasaka, K., Dumon, K. R., Kuchenbecker, K. J.

In Proc. Hamlyn Symposium on Medical Robotics, pages: 75-76, London, England, June 2015, Poster presentation given by Brown (inproceedings)

hi

[BibTex]

[BibTex]


no image
Should Haptic Texture Vibrations Respond to User Force and Speed?

Culbertson, H., Kuchenbecker, K. J.

In IEEE World Haptics Conference, pages: 106 - 112, Evanston, Illinois, USA, June 2015, Oral presentation given by Culbertson (inproceedings)

hi

[BibTex]

[BibTex]


no image
Enabling the Baxter Robot to Play Hand-Clapping Games

Fitter, N. T., Neuburger, M., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, June 2015, Work-in-progress paper. Poster presentation given by Fitter (inproceedings)

hi

[BibTex]

[BibTex]


no image
Using IMU Data to Teach a Robot Hand-Clapping Games

Fitter, N. T., Kuchenbecker, K. J.

In Proc. IEEE Haptics Symposium, pages: 353-355, April 2015, Work-in-progress paper. Poster presentation given by Fitter (inproceedings)

hi

[BibTex]

[BibTex]


no image
Haptic Feedback in Transoral Robotic Surgery: A Feasibility Study

Bur, A. M., Gomez, E. D., Rassekh, C. H., Newman, J. G., Weinstein, G. S., Kuchenbecker, K. J.

In Proc. Annual Meeting of the Triological Society at COSM, April 2015, Poster presentation given by Bur (inproceedings)

hi

[BibTex]

[BibTex]


no image
Human Machine Interface for Dexto Eka: - The humanoid robot

Kumra, S., Mohan, M., Gupta, S., Vaswani, H.

In Proceedings of the IEEE International Conference on Robotics, Automation, Control and Embedded Systems (RACE), Chennai, India, Febuary 2015 (inproceedings)

Abstract
This paper illustrates hybrid control system of the humanoid robot, Dexto:Eka: focusing on the dependent or slave mode. Efficiency of any system depends on the fluid operation of its control system. Here, we elucidate the control of 12 DoF robotic arms and an omnidirectional mecanum wheel drive using an exo-frame, and a Graphical User Interface (GUI) and a control column. This paper comprises of algorithms, control mechanisms and overall flow of execution for the regulation of robotic arms, graphical user interface and locomotion.

hi

DOI [BibTex]

DOI [BibTex]


no image
Conception and development of Dexto:Eka: The Humanoid Robot - Part IV

Kumra, S., Mohan, M., Vaswani, H., Gupta, S.

In Proceedings of the IEEE International Conference on Robotics, Automation, Control and Embedded Systems (RACE), Febuary 2015 (inproceedings)

Abstract
This paper elucidates the fourth phase of the development of `Dexto:Eka: - The Humanoid Robot'. It lays special emphasis on the conception of the locomotion drive and the development of vision based system that aids navigation and tele-operation. The first three phases terminated with the completion of two robotic arms with six degrees of freedom each, structural development and the creation of a human machine interface that included an exo-frame, a control column and a graphical user interface. This phase also involved the enhancement of the exo-frame to a vision based system using a Kinect camera. The paper also focuses on the reasons behind choosing the locomotion drive and the benefits it has.

hi

DOI [BibTex]

DOI [BibTex]


no image
Design and Validation of a Practical Simulator for Transoral Robotic Surgery

Bur, A. M., Gomez, E. D., Chalian, A. A., Newman, J. G., Weinstein, G. S., Kuchenbecker, K. J.

In Proc. Society for Robotic Surgery Annual Meeting: Transoral Program, (T8), February 2015, Oral presentation given by Bur (inproceedings)

hi

[BibTex]

[BibTex]


no image
Real-Time Object Detection, Localization and Verification for Fast Robotic Depalletizing

Holz, D., Topalidou-Kyniazopoulou, A., Stueckler, J., Behnke, S.

In IEEE International Conference on Intelligent Robots and Systems (IROS), 2015 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Dense Continuous-Time Tracking and Mapping with Rolling Shutter RGB-D Cameras

Kerl, C., Stueckler, J., Cremers, D.

In IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 2015, {[video][supplementary][datasets]} (inproceedings)

ev

[BibTex]

[BibTex]


no image
Large-Scale Direct SLAM with Stereo Cameras

Engel, J., Stueckler, J., Cremers, D.

In IEEE International Conference on Intelligent Robots and Systems (IROS), 2015 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Motion Cooperation: Smooth Piece-Wise Rigid Scene Flow from RGB-D Images

Jaimez, M., Souiai, M., Stueckler, J., Gonzalez-Jimenez, J., Cremers, D.

In Proc. of the Int. Conference on 3D Vision (3DV), October 2015, {[video]} (inproceedings)

ev

[BibTex]

[BibTex]


no image
Super-Resolution Keyframe Fusion for 3D Modeling with High-Quality Textures

Maier, R., Stueckler, J., Cremers, D.

In International Conference on 3D Vision (3DV), October 2015, {[slides] [poster]} (inproceedings)

ev

[BibTex]

[BibTex]


no image
Reconstructing Street-Scenes in Real-Time From a Driving Car

Usenko, V., Engel, J., Stueckler, J., Cremers, D.

In Proc. of the Int. Conference on 3D Vision (3DV), October 2015 (inproceedings)

ev

[BibTex]

[BibTex]

2011


no image
Planning manipulation and grasping tasks with a redundant arm

Gray, S. R., Romano, J. M., Brindza, J., Kim, S., Kuchenbecker, K. J., Kumar, V.

In Proc. ASME International Design Engineering Technical Conferences, Washington, D.C., USA, 2011, DETC2011-47453. Oral presentation given by Gray (inproceedings)

hi

[BibTex]

2011


[BibTex]


no image
Lessons in Using Vibrotactile Feedback to Guide Fast Arm Motions

Bark, K., Khanna, P., Irwin, R., Kapur, P., Jax, S. A., Buxbaum, L. J., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, pages: 355-360, Istanbul, Turkey, June 2011, Poster presentation given by Bark (inproceedings)

hi

[BibTex]

[BibTex]


no image
Haptically Assisted Golf Putting Through a Planar Four-Cable System

Huang, P. Y., Kunkel, J. A., Brindza, J., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, pages: 191-196, Istanbul, Turkey, June 2011, Poster presentation given by Kuchenbecker (inproceedings)

hi

[BibTex]

[BibTex]


no image
Design of Body-Grounded Tactile Actuators for Playback of Human Physical Contact

Stanley, A. A., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, pages: 563-568, Istanbul, Turkey, June 2011, Poster presentation given by Stanley (inproceedings)

hi

[BibTex]

[BibTex]


no image
Tool Vibration Feedback May Help Expert Robotic Surgeons Apply Less Force During Manipulation Tasks

McMahan, W., Bark, K., Gewirtz, J., Standish, D., Martin, P. D., Kunkel, J. A., Lilavois, M., Wedmid, A., Lee, D. I., Kuchenbecker, K. J.

In Proc. Hamlyn Symposium on Medical Robotics, pages: 37-38, London, England, June 2011, Oral Presentation given by Kuchenbecker (inproceedings)

hi

[BibTex]

[BibTex]


no image
Haptography: Capturing and Recreating the Rich Feel of Real Surfaces

Kuchenbecker, K. J., Romano, J. M., McMahan, W.

In Proceedings of the International Symposium on Robotics Research (ISRR), 70, pages: 245-260, Springer Tracts in Advanced Robotics, Springer, 2011, Oral presentation given by Kuchenbecker in August of 2009 (inproceedings)

hi

[BibTex]

[BibTex]


no image
Following human guidance to cooperatively carry a large object

Stueckler, J., Behnke, S.

In Proc. of the 11th IEEE-RAS Int. Conf. on Humanoid Robots (Humanoids), pages: 218-223, October 2011 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Real-Time 3D Perception and Efficient Grasp Planning for Everyday Manipulation Tasks.

Stueckler, J., Steffens, R., Holz, D., Behnke, S.

In Proc. of the European Conf. on Mobile Robots (ECMR), pages: 177-182, 2011 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Towards joint attention for a domestic service robot - person awareness and gesture recognition using Time-of-Flight cameras

Droeschel, D., Stueckler, J., Holz, D., Behnke, S.

In Proc. of the IEEE Int. Conf. on Robotics and Automation (ICRA), pages: 1205-1210, May 2011 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Compliant Task-Space Control with Back-Drivable Servo Actuators

Stueckler, J., Behnke, S.

In RoboCup, 7416, pages: 78-89, Lecture Notes in Computer Science, Springer, 2011 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Interest point detection in depth images through scale-space surface analysis

Stueckler, J., Behnke, S.

In Proc. of the IEEE Int. Conf. on Robotics and Automation (ICRA), pages: 3568-3574, May 2011 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Learning to Interpret Pointing Gestures with a Time-of-flight Camera

Droeschel, D., Stueckler, J., Behnke, S.

In Proceedings of the 6th International Conference on Human-robot Interaction, pages: 481-488, ACM, 2011 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Efficient Multi-resolution Plane Segmentation of 3D Point Clouds

Oehler, B., Stueckler, J., Welle, J., Schulz, D., Behnke, S.

In Proc. of the Int. Conf. on Intelligent Robotics and Applications (ICIRA), 7102, pages: 145-156, Lecture Notes in Computer Science, Springer Berlin Heidelberg, 2011 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]

2007


no image
The power of external mentors for women pursuing academic careers in engineering and science: Stories of MentorNet ACE and its Proteges and Mentors

Muller, C. B., Smith, E. H. B., Chou-Green, J., Daniels-Race, T., Drummond, A., Kuchenbecker, K. J.

In Proc. Women in Engineering Programs and Advocates Network (WEPAN) National Conference, Lake Buena Vista, Florida, USA, June 2007, Oral presentation given by Muller (inproceedings)

hi

[BibTex]

2007


[BibTex]


no image
Effects of Visual and Proprioceptive Position Feedback on Human Control of Targeted Movement

Kuchenbecker, K. J., Gurari, N., Okamura, A. M.

In Proc. IEEE International Conference on Rehabilitation Robotics, pages: 513-524, Noordwijk, Netherlands, June 2007, Oral and poster presentations given by Kuchenbecker (inproceedings)

hi

[BibTex]

[BibTex]


no image
Quantifying the value of visual and haptic position feedback in force-based motion control

Kuchenbecker, K. J., Gurari, N., Okamura, A. M.

In Proc. IEEE World Haptics Conference, pages: 561-562, Tsukuba, Japan, March 2007, Poster presentation given by Kuchenbecker (inproceedings)

hi

[BibTex]

[BibTex]


no image
Shaping event-based haptic transients via an improved understanding of real contact dynamics

Fiene, J. P., Kuchenbecker, K. J.

In Proc. IEEE World Haptics Conference, pages: 170-175, Tsukuba, Japan, March 2007, Oral presentation given by Fiene. {B}est Haptic Technology Paper Award (inproceedings)

hi

[BibTex]

[BibTex]


no image
Guided Self-organisation for Autonomous Robot Development

Martius, G., Herrmann, J. M., Der, R.

In Advances in Artificial Life 9th European Conference, ECAL 2007, 4648, pages: 766-775, LNCS, Springer, 2007 (inproceedings)

al

[BibTex]

[BibTex]


no image
Hierarchical reactive control for a team of humanoid soccer robots

Behnke, S., Stueckler, J., Schreiber, M., Schulz, H., Böhnert, M., Meier, K.

In Proc. of the IEEE-RAS Int. Conf. on Humanoid Robots (Humanoids), pages: 622-629, November 2007 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]

2005


no image
Perception of Curvature and Object Motion Via Contact Location Feedback

Provancher, W. R., Kuchenbecker, K. J., Niemeyer, G., Cutkosky, M. R.

In Proceedings of the International Symposium on Robotics Research (ISRR), 15, pages: 456-465, Springer Tracts in Advanced Robotics, Springer, Siena, Italy, 2005, Oral presentation given by Provancher in October of 2003 (inproceedings)

hi

[BibTex]

2005


[BibTex]


no image
Modeling Induced Master Motion in Force-Reflecting Teleoperation

Kuchenbecker, K. J., Niemeyer, G.

In Proc. IEEE International Conference on Robotics and Automation, pages: 348-353, Barcelona, Spain, April 2005, Oral presentation given by Kuchenbecker (inproceedings)

hi

[BibTex]

[BibTex]