Header logo is


2016


no image
Dynamical self-consistency leads to behavioral development and emergent social interactions in robots.

Der, R., Martius, G.

In Proc. IEEE Int. Conf. on Development and Learning and Epigenetic Robotics, pages: 49-56, IEEE, September 2016, in press (inproceedings)

al

DOI [BibTex]

2016


DOI [BibTex]


Soft continuous microrobots with multiple intrinsic degrees of freedom
Soft continuous microrobots with multiple intrinsic degrees of freedom

Palagi, S., Mark, A. G., Melde, K., Zeng, H., Parmeggiani, C., Martella, D., Wiersma, D. S., Fischer, P.

In 2016 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS), pages: 1-5, July 2016 (inproceedings)

Abstract
One of the main challenges in the development of microrobots, i.e. robots at the sub-millimeter scale, is the difficulty of adopting traditional solutions for power, control and, especially, actuation. As a result, most current microrobots are directly manipulated by external fields, and possess only a few passive degrees of freedom (DOFs). We have reported a strategy that enables embodiment, remote powering and control of a large number of DOFs in mobile soft microrobots. These consist of photo-responsive materials, such that the actuation of their soft continuous body can be selectively and dynamically controlled by structured light fields. Here we use finite-element modelling to evaluate the effective number of DOFs that are addressable in our microrobots. We also demonstrate that by this flexible approach different actuation patterns can be obtained, and thus different locomotion performances can be achieved within the very same microrobot. The reported results confirm the versatility of the proposed approach, which allows for easy application-specific optimization and online reconfiguration of the microrobot's behavior. Such versatility will enable advanced applications of robotics and automation at the micro scale.

pf

DOI [BibTex]

DOI [BibTex]


Wireless actuator based on ultrasonic bubble streaming
Wireless actuator based on ultrasonic bubble streaming

Qiu, T., Palagi, S., Mark, A. G., Melde, K., Fischer, P.

In 2016 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS), pages: 1-5, July 2016 (inproceedings)

Abstract
Miniaturized actuators are a key element for the manipulation and automation at small scales. Here, we propose a new miniaturized actuator, which consists of an array of micro gas bubbles immersed in a fluid. Under ultrasonic excitation, the oscillation of micro gas bubbles results in acoustic streaming and provides a propulsive force that drives the actuator. The actuator was fabricated by lithography and fluidic streaming was observed under ultrasound excitation. Theoretical modelling and numerical simulations were carried out to show that lowing the surface tension results in a larger amplitude of the bubble oscillation, and thus leads to a higher propulsive force. Experimental results also demonstrate that the propulsive force increases 3.5 times when the surface tension is lowered by adding a surfactant. An actuator with a 4×4 mm 2 surface area provides a driving force of about 0.46 mN, suggesting that it is possible to be used as a wireless actuator for small-scale robots and medical instruments.

pf

link (url) DOI [BibTex]

link (url) DOI [BibTex]


Patches, Planes and Probabilities: A Non-local Prior for Volumetric {3D} Reconstruction
Patches, Planes and Probabilities: A Non-local Prior for Volumetric 3D Reconstruction

Ulusoy, A. O., Black, M. J., Geiger, A.

In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2016 (inproceedings)

Abstract
In this paper, we propose a non-local structured prior for volumetric multi-view 3D reconstruction. Towards this goal, we present a novel Markov random field model based on ray potentials in which assumptions about large 3D surface patches such as planarity or Manhattan world constraints can be efficiently encoded as probabilistic priors. We further derive an inference algorithm that reasons jointly about voxels, pixels and image segments, and estimates marginal distributions of appearance, occupancy, depth, normals and planarity. Key to tractable inference is a novel hybrid representation that spans both voxel and pixel space and that integrates non-local information from 2D image segmentations in a principled way. We compare our non-local prior to commonly employed local smoothness assumptions and a variety of state-of-the-art volumetric reconstruction baselines on challenging outdoor scenes with textureless and reflective surfaces. Our experiments indicate that regularizing over larger distances has the potential to resolve ambiguities where local regularizers fail.

avg ps

YouTube pdf poster suppmat Project Page [BibTex]

YouTube pdf poster suppmat Project Page [BibTex]


Semantic Instance Annotation of Street Scenes by 3D to 2D Label Transfer
Semantic Instance Annotation of Street Scenes by 3D to 2D Label Transfer

Xie, J., Kiefel, M., Sun, M., Geiger, A.

In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2016 (inproceedings)

Abstract
Semantic annotations are vital for training models for object recognition, semantic segmentation or scene understanding. Unfortunately, pixelwise annotation of images at very large scale is labor-intensive and only little labeled data is available, particularly at instance level and for street scenes. In this paper, we propose to tackle this problem by lifting the semantic instance labeling task from 2D into 3D. Given reconstructions from stereo or laser data, we annotate static 3D scene elements with rough bounding primitives and develop a probabilistic model which transfers this information into the image domain. We leverage our method to obtain 2D labels for a novel suburban video dataset which we have collected, resulting in 400k semantic and instance image annotations. A comparison of our method to state-of-the-art label transfer baselines reveals that 3D information enables more efficient annotation while at the same time resulting in improved accuracy and time-coherent labels.

avg ps

pdf suppmat Project Page Project Page [BibTex]

pdf suppmat Project Page Project Page [BibTex]


Auxetic Metamaterial Simplifies Soft Robot Design
Auxetic Metamaterial Simplifies Soft Robot Design

Mark, A. G., Palagi, S., Qiu, T., Fischer, P.

In 2016 IEEE Int. Conf. on Robotics and Automation (ICRA), pages: 4951-4956, May 2016 (inproceedings)

Abstract
Soft materials are being adopted in robotics in order to facilitate biomedical applications and in order to achieve simpler and more capable robots. One route to simplification is to design the robot's body using `smart materials' that carry the burden of control and actuation. Metamaterials enable just such rational design of the material properties. Here we present a soft robot that exploits mechanical metamaterials for the intrinsic synchronization of two passive clutches which contact its travel surface. Doing so allows it to move through an enclosed passage with an inchworm motion propelled by a single actuator. Our soft robot consists of two 3D-printed metamaterials that implement auxetic and normal elastic properties. The design, fabrication and characterization of the metamaterials are described. In addition, a working soft robot is presented. Since the synchronization mechanism is a feature of the robot's material body, we believe that the proposed design will enable compliant and robust implementations that scale well with miniaturization.

pf

link (url) DOI [BibTex]

link (url) DOI [BibTex]


Towards Photo-Induced Swimming: Actuation of Liquid Crystalline  Elastomer in Water
Towards Photo-Induced Swimming: Actuation of Liquid Crystalline Elastomer in Water

cerretti, G., Martella, D., Zeng, H., Parmeggiani, C., Palagi, S., Mark, A. G., Melde, K., Qiu, T., Fischer, P., Wiersma, D.

In Proc. of SPIE 9738, pages: Laser 3D Manufacturing III, 97380T, April 2016 (inproceedings)

Abstract
Liquid Crystalline Elastomers (LCEs) are very promising smart materials that can be made sensitive to different external stimuli, such as heat, pH, humidity and light, by changing their chemical composition. In this paper we report the implementation of a nematically aligned LCE actuator able to undergo large light-induced deformations. We prove that this property is still present even when the actuator is submerged in fresh water. Thanks to the presence of azo-dye moieties, capable of going through a reversible trans-cis photo-isomerization, and by applying light with two different wavelengths we managed to control the bending of such actuator in the liquid environment. The reported results represent the first step towards swimming microdevices powered by light.

pf

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Robust calibration marker detection in powder bed images from laser beam melting processes

zur Jacobsmühlen, J., Achterhold, J., Kleszczynski, S., Witt, G., Merhof, D.

In 2016 IEEE International Conference on Industrial Technology (ICIT), pages: 910-915, March 2016 (inproceedings)

ev

DOI [BibTex]

DOI [BibTex]


Deep Discrete Flow
Deep Discrete Flow

Güney, F., Geiger, A.

Asian Conference on Computer Vision (ACCV), 2016 (conference) Accepted

avg ps

pdf suppmat Project Page [BibTex]

pdf suppmat Project Page [BibTex]


no image
Helping people make better decisions using optimal gamification

Lieder, F., Griffiths, T. L.

In Proceedings of the 38th Annual Conference of the Cognitive Science Society, 2016 (inproceedings)

Abstract
Game elements like points and levels are a popular tool to nudge and engage students and customers. Yet, no theory can tell us which incentive structures work and how to design them. Here we connect the practice of gamification to the theory of reward shaping in reinforcement learning. We leverage this connection to develop a method for designing effective incentive structures and delineating when gamification will succeed from when it will fail. We evaluate our method in two behavioral experiments. The results of the first experiment demonstrate that incentive structures designed by our method help people make better, less short-sighted decisions and avoid the pitfalls of less principled approaches. The results of the second experiment illustrate that such incentive structures can be effectively implemented using game elements like points and badges. These results suggest that our method provides a principled way to leverage gamification to help people make better decisions.

re

link (url) Project Page [BibTex]

link (url) Project Page [BibTex]


no image
On designing an active tail for body-pitch control in legged robots via decoupling of control objectives

Heim, S. W., Ajallooeian, M., Eckert, P., Vespignani, M., Ijspeert, A.

In ASSISTIVE ROBOTICS: Proceedings of the 18th International Conference on CLAWAR 2015, pages: 256-264, 2016 (inproceedings)

dlg

[BibTex]

[BibTex]


no image
Direct Visual-Inertial Odometry with Stereo Cameras

Usenko, V., Engel, J., Stueckler, J., Cremers, D.

In IEEE International Conference on Robotics and Automation (ICRA), 2016 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Compliant control for soft robots: emergent behavior of a tendon driven anthropomorphic arm.

Martius, G., Hostettler, R., Knoll, A., Der, R.

In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages: 767-773, 2016 (inproceedings)

al

DOI [BibTex]

DOI [BibTex]


no image
CPA-SLAM: Consistent Plane-Model Alignment for Direct RGB-D SLAM

Ma, L., Kerl, C., Stueckler, J., Cremers, D.

In IEEE International Conference on Robotics and Automation (ICRA), 2016 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Unsupervised Learning of Shape-Motion Patterns for Objects in Urban Street Scenes

Klostermann, D., Osep, A., Stueckler, J., Leibe, B.

In British Machine Vision Conference (BMVC), 2016 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Scene Flow Propagation for Semantic Mapping and Object Discovery in Dynamic Street Scenes

Kochanov, D., Osep, A., Stueckler, J., Leibe, B.

In IEEE/RSJ Int. Conference on Intelligent Robots and Systems, IROS, 2016 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Joint Object Pose Estimation and Shape Reconstruction in Urban Street Scenes Using 3D Shape Priors

Engelmann, F., Stueckler, J., Leibe, B.

In Proc. of the German Conference on Pattern Recognition (GCPR), 2016 (inproceedings)

ev

[BibTex]

[BibTex]

2015


Exploiting Object Similarity in 3D Reconstruction
Exploiting Object Similarity in 3D Reconstruction

Zhou, C., Güney, F., Wang, Y., Geiger, A.

In International Conference on Computer Vision (ICCV), December 2015 (inproceedings)

Abstract
Despite recent progress, reconstructing outdoor scenes in 3D from movable platforms remains a highly difficult endeavor. Challenges include low frame rates, occlusions, large distortions and difficult lighting conditions. In this paper, we leverage the fact that the larger the reconstructed area, the more likely objects of similar type and shape will occur in the scene. This is particularly true for outdoor scenes where buildings and vehicles often suffer from missing texture or reflections, but share similarity in 3D shape. We take advantage of this shape similarity by locating objects using detectors and jointly reconstructing them while learning a volumetric model of their shape. This allows us to reduce noise while completing missing surfaces as objects of similar shape benefit from all observations for the respective category. We evaluate our approach with respect to LIDAR ground truth on a novel challenging suburban dataset and show its advantages over the state-of-the-art.

avg ps

pdf suppmat [BibTex]

2015


pdf suppmat [BibTex]


FollowMe: Efficient Online Min-Cost Flow Tracking with Bounded Memory and Computation
FollowMe: Efficient Online Min-Cost Flow Tracking with Bounded Memory and Computation

Lenz, P., Geiger, A., Urtasun, R.

In International Conference on Computer Vision (ICCV), International Conference on Computer Vision (ICCV), December 2015 (inproceedings)

Abstract
One of the most popular approaches to multi-target tracking is tracking-by-detection. Current min-cost flow algorithms which solve the data association problem optimally have three main drawbacks: they are computationally expensive, they assume that the whole video is given as a batch, and they scale badly in memory and computation with the length of the video sequence. In this paper, we address each of these issues, resulting in a computationally and memory-bounded solution. First, we introduce a dynamic version of the successive shortest-path algorithm which solves the data association problem optimally while reusing computation, resulting in faster inference than standard solvers. Second, we address the optimal solution to the data association problem when dealing with an incoming stream of data (i.e., online setting). Finally, we present our main contribution which is an approximate online solution with bounded memory and computation which is capable of handling videos of arbitrary length while performing tracking in real time. We demonstrate the effectiveness of our algorithms on the KITTI and PETS2009 benchmarks and show state-of-the-art performance, while being significantly faster than existing solvers.

avg ps

pdf suppmat video project [BibTex]

pdf suppmat video project [BibTex]


Towards Probabilistic Volumetric Reconstruction using Ray Potentials
Towards Probabilistic Volumetric Reconstruction using Ray Potentials

(Best Paper Award)

Ulusoy, A. O., Geiger, A., Black, M. J.

In 3D Vision (3DV), 2015 3rd International Conference on, pages: 10-18, Lyon, October 2015 (inproceedings)

Abstract
This paper presents a novel probabilistic foundation for volumetric 3-d reconstruction. We formulate the problem as inference in a Markov random field, which accurately captures the dependencies between the occupancy and appearance of each voxel, given all input images. Our main contribution is an approximate highly parallelized discrete-continuous inference algorithm to compute the marginal distributions of each voxel's occupancy and appearance. In contrast to the MAP solution, marginals encode the underlying uncertainty and ambiguity in the reconstruction. Moreover, the proposed algorithm allows for a Bayes optimal prediction with respect to a natural reconstruction loss. We compare our method to two state-of-the-art volumetric reconstruction algorithms on three challenging aerial datasets with LIDAR ground truth. Our experiments demonstrate that the proposed algorithm compares favorably in terms of reconstruction accuracy and the ability to expose reconstruction uncertainty.

avg ps

code YouTube pdf suppmat DOI Project Page [BibTex]

code YouTube pdf suppmat DOI Project Page [BibTex]


3D-printed Soft Microrobot for Swimming in Biological Fluids
3D-printed Soft Microrobot for Swimming in Biological Fluids

Qiu, T., Palagi, S., Fischer, P.

In Conf. Proc. IEEE Eng. Med. Biol. Soc., pages: 4922-4925, August 2015 (inproceedings)

Abstract
Microscopic artificial swimmers hold the potential to enable novel non-invasive medical procedures. In order to ease their translation towards real biomedical applications, simpler designs as well as cheaper yet more reliable materials and fabrication processes should be adopted, provided that the functionality of the microrobots can be kept. A simple single-hinge design could already enable microswimming in non-Newtonian fluids, which most bodily fluids are. Here, we address the fabrication of such single-hinge microrobots with a 3D-printed soft material. Firstly, a finite element model is developed to investigate the deformability of the 3D-printed microstructure under typical values of the actuating magnetic fields. Then the microstructures are fabricated by direct 3D-printing of a soft material and their swimming performances are evaluated. The speeds achieved with the 3D-printed microrobots are comparable to those obtained in previous work with complex fabrication procedures, thus showing great promise for 3D-printed microrobots to be operated in biological fluids.

pf

link (url) DOI [BibTex]

link (url) DOI [BibTex]


Displets: Resolving Stereo Ambiguities using Object Knowledge
Displets: Resolving Stereo Ambiguities using Object Knowledge

Güney, F., Geiger, A.

In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) 2015, pages: 4165-4175, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2015 (inproceedings)

Abstract
Stereo techniques have witnessed tremendous progress over the last decades, yet some aspects of the problem still remain challenging today. Striking examples are reflecting and textureless surfaces which cannot easily be recovered using traditional local regularizers. In this paper, we therefore propose to regularize over larger distances using object-category specific disparity proposals (displets) which we sample using inverse graphics techniques based on a sparse disparity estimate and a semantic segmentation of the image. The proposed displets encode the fact that objects of certain categories are not arbitrarily shaped but typically exhibit regular structures. We integrate them as non-local regularizer for the challenging object class 'car' into a superpixel based CRF framework and demonstrate its benefits on the KITTI stereo evaluation.

avg ps

pdf abstract suppmat [BibTex]

pdf abstract suppmat [BibTex]


Object Scene Flow for Autonomous Vehicles
Object Scene Flow for Autonomous Vehicles

Menze, M., Geiger, A.

In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) 2015, pages: 3061-3070, IEEE, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2015 (inproceedings)

Abstract
This paper proposes a novel model and dataset for 3D scene flow estimation with an application to autonomous driving. Taking advantage of the fact that outdoor scenes often decompose into a small number of independently moving objects, we represent each element in the scene by its rigid motion parameters and each superpixel by a 3D plane as well as an index to the corresponding object. This minimal representation increases robustness and leads to a discrete-continuous CRF where the data term decomposes into pairwise potentials between superpixels and objects. Moreover, our model intrinsically segments the scene into its constituting dynamic components. We demonstrate the performance of our model on existing benchmarks as well as a novel realistic dataset with scene flow ground truth. We obtain this dataset by annotating 400 dynamic scenes from the KITTI raw data collection using detailed 3D CAD models for all vehicles in motion. Our experiments also reveal novel challenges which can't be handled by existing methods.

avg ps

pdf abstract suppmat DOI [BibTex]

pdf abstract suppmat DOI [BibTex]


no image
Real-Time Object Detection, Localization and Verification for Fast Robotic Depalletizing

Holz, D., Topalidou-Kyniazopoulou, A., Stueckler, J., Behnke, S.

In IEEE International Conference on Intelligent Robots and Systems (IROS), 2015 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Dense Continuous-Time Tracking and Mapping with Rolling Shutter RGB-D Cameras

Kerl, C., Stueckler, J., Cremers, D.

In IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 2015, {[video][supplementary][datasets]} (inproceedings)

ev

[BibTex]

[BibTex]


Joint 3D Object and Layout Inference from a single RGB-D Image
Joint 3D Object and Layout Inference from a single RGB-D Image

(Best Paper Award)

Geiger, A., Wang, C.

In German Conference on Pattern Recognition (GCPR), 9358, pages: 183-195, Lecture Notes in Computer Science, Springer International Publishing, 2015 (inproceedings)

Abstract
Inferring 3D objects and the layout of indoor scenes from a single RGB-D image captured with a Kinect camera is a challenging task. Towards this goal, we propose a high-order graphical model and jointly reason about the layout, objects and superpixels in the image. In contrast to existing holistic approaches, our model leverages detailed 3D geometry using inverse graphics and explicitly enforces occlusion and visibility constraints for respecting scene properties and projective geometry. We cast the task as MAP inference in a factor graph and solve it efficiently using message passing. We evaluate our method with respect to several baselines on the challenging NYUv2 indoor dataset using 21 object categories. Our experiments demonstrate that the proposed method is able to infer scenes with a large degree of clutter and occlusions.

avg ps

pdf suppmat video project DOI [BibTex]

pdf suppmat video project DOI [BibTex]


no image
When to use which heuristic: A rational solution to the strategy selection problem

Lieder, F., Griffiths, T. L.

In Proceedings of the 37th Annual Conference of the Cognitive Science Society, 2015 (inproceedings)

Abstract
The human mind appears to be equipped with a toolbox full of cognitive strategies, but how do people decide when to use which strategy? We leverage rational metareasoning to derive a rational solution to this problem and apply it to decision making under uncertainty. The resulting theory reconciles the two poles of the debate about human rationality by proposing that people gradually learn to make rational use of fallible heuristics. We evaluate this theory against empirical data and existing accounts of strategy selection (i.e. SSL and RELACS). Our results suggest that while SSL and RELACS can explain people's ability to adapt to homogeneous environments in which all decision problems are of the same type, rational metareasoning can additionally explain people's ability to adapt to heterogeneous environments and flexibly switch strategies from one decision to the next.

re

link (url) Project Page [BibTex]

link (url) Project Page [BibTex]


no image
Large-Scale Direct SLAM with Stereo Cameras

Engel, J., Stueckler, J., Cremers, D.

In IEEE International Conference on Intelligent Robots and Systems (IROS), 2015 (inproceedings)

ev

[BibTex]

[BibTex]


Discrete Optimization for Optical Flow
Discrete Optimization for Optical Flow

Menze, M., Heipke, C., Geiger, A.

In German Conference on Pattern Recognition (GCPR), 9358, pages: 16-28, Springer International Publishing, 2015 (inproceedings)

Abstract
We propose to look at large-displacement optical flow from a discrete point of view. Motivated by the observation that sub-pixel accuracy is easily obtained given pixel-accurate optical flow, we conjecture that computing the integral part is the hardest piece of the problem. Consequently, we formulate optical flow estimation as a discrete inference problem in a conditional random field, followed by sub-pixel refinement. Naive discretization of the 2D flow space, however, is intractable due to the resulting size of the label set. In this paper, we therefore investigate three different strategies, each able to reduce computation and memory demands by several orders of magnitude. Their combination allows us to estimate large-displacement optical flow both accurately and efficiently and demonstrates the potential of discrete optimization for optical flow. We obtain state-of-the-art performance on MPI Sintel and KITTI.

avg ps

pdf suppmat project DOI [BibTex]

pdf suppmat project DOI [BibTex]


no image
Children and Adults Differ in their Strategies for Social Learning

Lieder, F., Sim, Z. L., Hu, J. C., Griffiths, T. L., Xu, F.

In Proceedings of the 37th Annual Conference of the Cognitive Science Society, 2015 (inproceedings)

Abstract
Adults and children rely heavily on other people’s testimony. However, domains of knowledge where there is no consensus on the truth are likely to result in conflicting testimonies. Previous research has demonstrated that in these cases, learners look towards the majority opinion to make decisions. However, it remains unclear how learners evaluate social information, given that considering either the overall valence, or the number of testimonies, or both may lead to different conclusions. We therefore formalized several social learning strategies and compared them to the performance of adults and children. We find that children use different strategies than adults. This suggests that the development of social learning may involve the acquisition of cognitive strategies.

re

link (url) [BibTex]

link (url) [BibTex]


Comparing the effect of different spine and leg designs for a small bounding quadruped robot
Comparing the effect of different spine and leg designs for a small bounding quadruped robot

Eckert, P., Spröwitz, A., Witte, H., Ijspeert, A. J.

In Proceedings of ICRA, pages: 3128-3133, Seattle, Washington, USA, 2015 (inproceedings)

Abstract
We present Lynx-robot, a quadruped, modular, compliant machine. It alternately features a directly actuated, single-joint spine design, or an actively supported, passive compliant, multi-joint spine configuration. Both spine con- figurations bend in the sagittal plane. This study aims at characterizing these two, largely different spine concepts, for a bounding gait of a robot with a three segmented, pantograph leg design. An earlier, similar-sized, bounding, quadruped robot named Bobcat with a two-segment leg design and a directly actuated, single-joint spine design serves as a comparison robot, to study and compare the effect of the leg design on speed, while keeping the spine design fixed. Both proposed spine designs (single rotatory and active and multi-joint compliant) reach moderate, self-stable speeds.

dlg

link (url) DOI Project Page [BibTex]

link (url) DOI Project Page [BibTex]


Joint 3D Estimation of Vehicles and Scene Flow
Joint 3D Estimation of Vehicles and Scene Flow

Menze, M., Heipke, C., Geiger, A.

In Proc. of the ISPRS Workshop on Image Sequence Analysis (ISA), 2015 (inproceedings)

Abstract
Three-dimensional reconstruction of dynamic scenes is an important prerequisite for applications like mobile robotics or autonomous driving. While much progress has been made in recent years, imaging conditions in natural outdoor environments are still very challenging for current reconstruction and recognition methods. In this paper, we propose a novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene. Towards this goal, we incorporate a deformable CAD model into a slanted-plane conditional random field for scene flow estimation and enforce shape consistency between the rendered 3D models and the parameters of all superpixels in the image. The association of superpixels to objects is established by an index variable which implicitly enables model selection. We evaluate our approach on the challenging KITTI scene flow dataset in terms of object and scene flow estimation. Our results provide a prove of concept and demonstrate the usefulness of our method.

avg ps

PDF [BibTex]

PDF [BibTex]


no image
Motion Cooperation: Smooth Piece-Wise Rigid Scene Flow from RGB-D Images

Jaimez, M., Souiai, M., Stueckler, J., Gonzalez-Jimenez, J., Cremers, D.

In Proc. of the Int. Conference on 3D Vision (3DV), October 2015, {[video]} (inproceedings)

ev

[BibTex]

[BibTex]


no image
Learning from others: Adult and child strategies in assessing conflicting ratings

Hu, J., Lieder, F., Griffiths, T. L., Xu, F.

In Biennial Meeting of the Society for Research in Child Development, Philadelphia, Pennsylvania, USA, 2015 (inproceedings)

re

[BibTex]

[BibTex]


no image
Super-Resolution Keyframe Fusion for 3D Modeling with High-Quality Textures

Maier, R., Stueckler, J., Cremers, D.

In International Conference on 3D Vision (3DV), October 2015, {[slides] [poster]} (inproceedings)

ev

[BibTex]

[BibTex]


no image
Utility-weighted sampling in decisions from experience

Lieder, F., Griffiths, T. L., Hsu, M.

In The 2nd Multidisciplinary Conference on Reinforcement Learning and Decision Making, 2015 (inproceedings)

re

[BibTex]

[BibTex]


no image
Reconstructing Street-Scenes in Real-Time From a Driving Car

Usenko, V., Engel, J., Stueckler, J., Cremers, D.

In Proc. of the Int. Conference on 3D Vision (3DV), October 2015 (inproceedings)

ev

[BibTex]

[BibTex]

2012


no image
Model Learning and Real-Time Tracking Using Multi-Resolution Surfel Maps

Stueckler, J., Behnke, S.

Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2012 (conference)

ev

link (url) [BibTex]

2012


link (url) [BibTex]


Development of a Minimalistic Pneumatic Quadruped Robot for Fast Locomotion
Development of a Minimalistic Pneumatic Quadruped Robot for Fast Locomotion

Narioka, K., Rosendo, A., Spröwitz, A., Hosoda, K.

In Proceedings of the 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2012, pages: 307-311, IEEE, Guangzhou, 2012 (inproceedings)

Abstract
In this paper, we describe the development of the quadruped robot ”Ken” with the minimalistic and lightweight body design for achieving fast locomotion. We use McKibben pneumatic artificial muscles as actuators, providing high frequency and wide stride motion of limbs, also avoiding problems with overheating. We conducted a preliminary experiment, finding out that the robot can swing its limb over 7.5 Hz without amplitude reduction, nor heat problems. Moreover, the robot realized a several steps of bouncing gait by using simple CPG-based open loop controller, indicating that the robot can generate enough torque to kick the ground and limb contraction to avoid stumbling.

dlg

DOI [BibTex]

DOI [BibTex]


Locomotion through Reconfiguration based on Motor Primitives for Roombots Self-Reconfigurable Modular Robots
Locomotion through Reconfiguration based on Motor Primitives for Roombots Self-Reconfigurable Modular Robots

Bonardi, S., Moeckel, R., Spröwitz, A., Vespignani, M., Ijspeert, A. J.

In Robotics; Proceedings of ROBOTIK 2012; 7th German Conference on, pages: 1-6, 2012 (inproceedings)

Abstract
We present the hardware and reconfiguration experiments for an autonomous self-reconfigurable modular robot called Roombots (RB). RB were designed to form the basis for self-reconfigurable furniture. Each RB module contains three degrees of freedom that have been carefully selected to allow a single module to reach any position on a 2-dimensional grid and to overcome concave corners in a 3-dimensional grid. For the first time we demonstrate locomotion capabilities of single RB modules through reconfiguration with real hardware. The locomotion through reconfiguration is controlled by a planner combining the well-known D* algorithm and composed motor primitives. The novelty of our approach is the use of an online running hierarchical planner closely linked to the real hardware.

dlg

link (url) [BibTex]

link (url) [BibTex]


no image
Bayesian calibration of the hand-eye kinematics of an anthropomorphic robot

Hubert, U., Stueckler, J., Behnke, S.

In Proc. of the 12th IEEE-RAS Int. Conf. on Humanoid Robots (Humanoids), pages: 618-624, November 2012 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Shape-Primitive Based Object Recognition and Grasping

Nieuwenhuisen, M., Stueckler, J., Berner, A., Klein, R., Behnke, S.

In Proc. of ROBOTIK, VDE-Verlag, 2012 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Semantic mapping using object-class segmentation of RGB-D images

Stueckler, J., Biresev, N., Behnke, S.

In Proc. of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), pages: 3005-3010, October 2012 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Efficient Mobile Robot Navigation using 3D Surfel Grid Maps

Kläß, J., Stueckler, J., Behnke, S.

In Proc. of ROBOTIK, VDE-Verlag, 2012 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Integrating depth and color cues for dense multi-resolution scene mapping using RGB-D cameras

Stueckler, J., Behnke, S.

In Proc. of the IEEE Int. Conf. on Multisensor Fusion and Integration for Intelligent Systems (MFI), pages: 162-167, sep 2012 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
SURE: Surface Entropy for Distinctive 3D Features

Fiolka, T., Stueckler, J., Klein, D. A., Schulz, D., Behnke, S.

In Proc. of Spatial Cognition, 2012 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Robust Real-Time Registration of RGB-D Images using Multi-Resolution Surfel Representations

Stueckler, J., Behnke, S.

In Proc. of ROBOTIK, VDE-Verlag, 2012 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Adjustable autonomy for mobile teleoperation of personal service robots

Muszynski, S., Stueckler, J., Behnke, S.

In Proc. of the IEEE Int. Symp. on Robot and Human Interactive Communication, pages: 933-940, sep 2012 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Adaptive Multi-cue 3D Tracking of Arbitrary Objects

Garcia, G. M., Klein, D. A., Stueckler, J., Frintrop, S., Cremers, A. B.

In DAGM/OAGM Symposium, 7476, pages: 357-366, Lecture Notes in Computer Science, Springer, 2012 (inproceedings)

ev

[BibTex]

[BibTex]

2009


Roombots-mechanical design of self-reconfiguring modular robots for adaptive furniture
Roombots-mechanical design of self-reconfiguring modular robots for adaptive furniture

Spröwitz, A., Billard, A., Dillenbourg, P., Ijspeert, A. J.

In Proceedings of the 2009 IEEE International Conference on Robotics and Automation (ICRA), pages: 4259-4264, IEEE, Kobe, 2009 (inproceedings)

Abstract
We aim at merging technologies from information technology, roomware, and robotics in order to design adaptive and intelligent furniture. This paper presents design principles for our modular robots, called Roombots, as future building blocks for furniture that moves and self-reconfigures. The reconfiguration is done using dynamic connection and disconnection of modules and rotations of the degrees of freedom. We are furthermore interested in applying Roombots towards adaptive behaviour, such as online learning of locomotion patterns. To create coordinated and efficient gait patterns, we use a Central Pattern Generator (CPG) approach, which can easily be optimized by any gradient-free optimization algorithm. To provide a hardware framework we present the mechanical design of the Roombots modules and an active connection mechanism based on physical latches. Further we discuss the application of our Roombots modules as pieces of a homogenic or heterogenic mix of building blocks for static structures.

dlg

DOI [BibTex]

2009


DOI [BibTex]