Header logo is


2016


Thumb xl capital
Patches, Planes and Probabilities: A Non-local Prior for Volumetric 3D Reconstruction

Ulusoy, A. O., Black, M. J., Geiger, A.

In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2016 (inproceedings)

Abstract
In this paper, we propose a non-local structured prior for volumetric multi-view 3D reconstruction. Towards this goal, we present a novel Markov random field model based on ray potentials in which assumptions about large 3D surface patches such as planarity or Manhattan world constraints can be efficiently encoded as probabilistic priors. We further derive an inference algorithm that reasons jointly about voxels, pixels and image segments, and estimates marginal distributions of appearance, occupancy, depth, normals and planarity. Key to tractable inference is a novel hybrid representation that spans both voxel and pixel space and that integrates non-local information from 2D image segmentations in a principled way. We compare our non-local prior to commonly employed local smoothness assumptions and a variety of state-of-the-art volumetric reconstruction baselines on challenging outdoor scenes with textureless and reflective surfaces. Our experiments indicate that regularizing over larger distances has the potential to resolve ambiguities where local regularizers fail.

avg ps

YouTube pdf poster suppmat Project Page [BibTex]

2016


YouTube pdf poster suppmat Project Page [BibTex]


Thumb xl jun teaser
Semantic Instance Annotation of Street Scenes by 3D to 2D Label Transfer

Xie, J., Kiefel, M., Sun, M., Geiger, A.

In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2016 (inproceedings)

Abstract
Semantic annotations are vital for training models for object recognition, semantic segmentation or scene understanding. Unfortunately, pixelwise annotation of images at very large scale is labor-intensive and only little labeled data is available, particularly at instance level and for street scenes. In this paper, we propose to tackle this problem by lifting the semantic instance labeling task from 2D into 3D. Given reconstructions from stereo or laser data, we annotate static 3D scene elements with rough bounding primitives and develop a probabilistic model which transfers this information into the image domain. We leverage our method to obtain 2D labels for a novel suburban video dataset which we have collected, resulting in 400k semantic and instance image annotations. A comparison of our method to state-of-the-art label transfer baselines reveals that 3D information enables more efficient annotation while at the same time resulting in improved accuracy and time-coherent labels.

avg ps

pdf suppmat Project Page Project Page [BibTex]

pdf suppmat Project Page Project Page [BibTex]


Thumb xl teaser
Deep Discrete Flow

Güney, F., Geiger, A.

Asian Conference on Computer Vision (ACCV), 2016 (conference) Accepted

avg ps

pdf suppmat Project Page [BibTex]

pdf suppmat Project Page [BibTex]


Thumb xl img02
Probabilistic Duality for Parallel Gibbs Sampling without Graph Coloring

Mescheder, L., Nowozin, S., Geiger, A.

Arxiv, 2016 (article)

Abstract
We present a new notion of probabilistic duality for random variables involving mixture distributions. Using this notion, we show how to implement a highly-parallelizable Gibbs sampler for weakly coupled discrete pairwise graphical models with strictly positive factors that requires almost no preprocessing and is easy to implement. Moreover, we show how our method can be combined with blocking to improve mixing. Even though our method leads to inferior mixing times compared to a sequential Gibbs sampler, we argue that our method is still very useful for large dynamic networks, where factors are added and removed on a continuous basis, as it is hard to maintain a graph coloring in this setup. Similarly, our method is useful for parallelizing Gibbs sampling in graphical models that do not allow for graph colorings with a small number of colors such as densely connected graphs.

avg

pdf [BibTex]


no image
γ‐Conicein und Coniin aus Geflecktem Schierling

Puidokait, M., Graefe, J., Sehl, A., Steinke, K., Siehl, H., Zeller, K., Sicker, D., Berger, S.

Chemie in unserer Zeit, 50(6):382-391, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


Thumb xl pami
Map-Based Probabilistic Visual Self-Localization

Brubaker, M. A., Geiger, A., Urtasun, R.

IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), 2016 (article)

Abstract
Accurate and efficient self-localization is a critical problem for autonomous systems. This paper describes an affordable solution to vehicle self-localization which uses odometry computed from two video cameras and road maps as the sole inputs. The core of the method is a probabilistic model for which an efficient approximate inference algorithm is derived. The inference algorithm is able to utilize distributed computation in order to meet the real-time requirements of autonomous systems in some instances. Because of the probabilistic nature of the model the method is capable of coping with various sources of uncertainty including noise in the visual odometry and inherent ambiguities in the map (e.g., in a Manhattan world). By exploiting freely available, community developed maps and visual odometry measurements, the proposed method is able to localize a vehicle to 4m on average after 52 seconds of driving on maps which contain more than 2,150km of drivable roads.

avg ps

pdf Project Page [BibTex]

pdf Project Page [BibTex]


no image
Ab initio theory for ultrafast magnetization dynamics with a dynamic band structure

Müller, B. Y., Haag, M., Fähnle, M.

{Journal of Magnetism and Magnetic Materials}, 414, pages: 14-18, North-Holland, Amsterdam, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
High-resolution analysis of currents at low-angle grain boundaries in YBCO thin films using magnetooptics and magnetic x-ray microscopy

Ruoß, S., Stahl, C., Bayer, J., Schütz, G., Albrecht, J., Laviano, F.

{IEEE Transactions on Applied Superconductivity}, 26(3), IEEE, New York, NY, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Three-dimensional character of the magnetization dynamics in magnetic vortex structures: Hybridization of flexure gyromodes with spin waves

Noske, M., Stoll, H., Fähnle, M., Gangwar, A., Woltersdorf, G., Slavin, A., Weigand, M., Dieterle, G., Förster, J., Back, C. H., Schütz, G.

{Physical Review Letters}, 117(3), American Physical Society, Woodbury, N.Y., 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Coercivity scaling in antidot lattices in Fe, Ni, and NiFe thin films

Gräfe, J., Schütz, G., Goering, E. J.

{Journal of Magnetism and Magnetic Materials}, 419, pages: 517-520, North-Holland, Amsterdam, 2016 (article)

mms

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Nanostructured materials for solid-state hydrogen storage: A review of the achievement of COST Action MP1103

Callini, E., Aguey-Zinsou, K., Ahuja, R., Ares, J. R., Bals, S., Biliskov, N., Chakraborty, S., Charalambopoulou, G., Chaudhary, A., Cuevas, F., Dam, B., de Jongh, P., Dornheim, M., Filinchuk, Y., Grbovic-Novakovic, J., Hirscher, M., Jensen, T. R., Jensen, P. B., Novakovic, N., Lai, Q., Leardini, F., Gattia, D. M., Pasquini, L., Steriotis, T., Turner, S., Vegge, T., Züttel, A., Montone, A.

{International Journal of Hydrogen Energy}, 41(32):14404-14428, Elsevier, Amsterdam, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetic X-ray microscopy at low temperatures - Visualization of flux distributions in superconductors

Stahl, C., Ruoß, S., Weigand, M., Bechtel, M., Schütz, G., Albrecht, J.

{AIP Conference Proceedings}, 1696, AIP Publishing, Melville, NY, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Enhanced non-adiabaticity in vortex cores due to the emergent Hall effect

Bisig, A., Akosa, C. A., Moon, J., Rhensius, J., Moutafis, C., von Bieren, A., Heidler, J., Kiliani, G., Kammerer, M., Curcic, M., Weigand, M., Tyliszczak, T., Van Waeyenberge, B., Stoll, H., Schütz, G., Lee, K., Manchon, A., Kläui, M.

{Physical Review Letters}, 117(27), American Physical Society, Woodbury, N.Y., 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Quantitative magneto-optical analysis of the role of finite temperatures on the critical state in YBCO thin films

Albrecht, J., Brück, S., Stahl, C., Ruoß, S.

{Superconductor Science and Technology}, 29(11), IOP Pub., Bristol, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Collective modes in three-dimensional magnonic vortex crystals

Hänze, M., Adolff, C. F., Schulte, B., Möller, J., Weigand, M., Meier, G.

{Scientific Reports}, 6, Nature Publishing Group, London, UK, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Spin wave mediated unidirectional vortex core reversal by two orthogonal monopolar field pulses: The essential role of three-dimensional magnetization dynamics

Noske, M., Stoll, H., Fähnle, M., Gangwar, A., Woltersdorf, G., Slavin, A., Weigand, M., Dieterle, G., Förster, J., Back, C. H., Schütz, G.

{Journal of Applied Physics}, 119(17), AIP Publishing, New York, NY, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetic vortex cores as tunable spin-wave emitters

Wintz, S., Tiberkevich, V., Weigand, M., Raabe, J., Lindner, J., Erbe, A., Slavin, A., Fassbender, J.

{Nature Nanotechnology}, 11(11):948-953, Nature Publishing Group, London, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
The usable capacity of porous materials for hydrogen storage

Schlichtenmayer, M., Hirscher, M.

{Applied Physics A}, 122(4), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Ferromagnetic behaviour of ZnO: the role of grain boundaries

Straumal, B. B., Protasova, S. G., Mazilkin, A. A., Goering, E., Schütz, G., Straumal, P. B., Baretzky, B.

{Beilstein Journal of Nanotechnology}, 7, pages: 1936-1947, Beilstein-Institut, Frankfurt am Main, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Localized domain wall nucleation dynamics in asymmetric ferromagnetic rings revealed by direct time-resolved magnetic imaging

Richter, K., Krone, A., Mawass, M., Krüger, B., Weigand, M., Stoll, H., Schütz, G., Kläui, M.

{Physical Review B}, 94(2), American Physical Society, Woodbury, NY, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Observation of room-temperature magnetic skyrmions and their current-driven dynamics in ultrathin metallic ferromagnets

Woo, S., Litzius, K., Krüger, B., Im, M., Caretta, L., Richter, K., Mann, M., Krone, A., Reeve, R. M., Weigand, M., Agrawal, P., Lemesh, I., Mawass, M., Fischer, P., Kläui, M., Beach, G. S. D.

{Nature Materials}, 15(5):501-506, Nature Pub. Group, London, UK, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Outlook and challenges for hydrogen storage in nanoporous materials

Broom, D. P., Webb, C. J., Hurst, K. E., Parilla, P. A., Gennett, T., Brown, C. M., Zacharia, R., Tylianakis, E., Klontzas, E., Froudakis, G. E., Steriotis, T. A., Trikalitis, P. N., Anton, D. L., Hardy, B., Tamburello, D., Corgnale, C., van Hassel, B. A., Cossement, D., Chahine, R., Hirscher, M.

{Applied Physics A}, 122(3), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Quantum sieving for separation of hydrogen isotopes using MOFs

Oh, H., Hirscher, M.

{European Journal of Inorganic Chemistry}, 2016(27):4278-4289, Wiley-VCH, Weinheim, Germany, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Direct patterning of vortex generators on a fiber tip using a focused ion beam

Vayalamkuzhi, P., Bhattacharya, S., Eigenthaler, U., Keskinbora, K., Salman, C. T., Hirscher, M., Spatz, J. P., Viswanathan, N. K.

{Optics Letters}, 41(10):2133-2136, Optical Society of America, Washington, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Two-body problem of core-region coupled magnetic vortex stacks

Hänze, M., Adolff, C. F., Velten, S., Weigand, M., Meier, G.

{Physical Review B}, 93(5), American Physical Society, Woodbury, NY, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Irreproducibility in hydrogen storage material research

Broom, D. P., Hirscher, M.

{Energy \& Environmental Science}, 9(11):3368-3380, Royal Society of Chemistry, Cambridge, UK, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Effect of surface configurations on the room-temperature magnetism of pure ZnO

Chen, Y., Wang, Z., Leineweber, A., Baier, J., Tietze, T., Phillipp, F., Schütz, G., Goering, E.

{Journal of Materials Chemistry C}, 4(19):4166-4175, Royal Society of Chemistry, London, UK, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
On the synthesis and microstructure analysis of high performance MnBi

Chen, Y., Sawatzki, S., Ener, S., Sepehri-Amin, H., Leineweber, A., Gregori, G., Qu, F., Muralidhar, S., Ohkubo, T., Hono, K., Gutfleisch, O., Kronmüller, H., Schütz, G., Goering, E.

{AIP Advances}, 6(12), 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
The role of individual defects on the magnetic screening of HTSC films

Ruoß, S., Stahl, C., Weigand, M., Zahn, P., Bayer, J., Schütz, G., Albrecht, J.

{New Journal of Physics}, 18(10), IOP Publishing, Bristol, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetic switching of nanoscale antidot lattices

Wiedwald, U., Gräfe, J., Lebecki, K. M., Skripnik, M., Haering, F., Schütz, G., Ziemann, P., Goering, E., Nowak, U.

{Beilstein Journal of Nanotechnology}, 7, pages: 733-750, Beilstein-Institut, Frankfurt am Main, 2016 (article)

mms

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Hydrogen-based energy storage (IEA-HIA Task 32)

Buckley, C. E., Chen, P., van Hassel, B. A., Hirscher, M.

{Applied Physics A}, 122(2), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Local domain-wall velocity engineering via tailored potential landscapes in ferromagnetic rings

Richter, K., Krone, A., Mawass, M., Krüger, B., Weigand, M., Stoll, H., Schütz, G., Kläui, M.

{Physical Review Applied}, 5(2), American Physical Society, College Park, Md. [u.a.], 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Geometric control of the magnetization reversal in antidot lattices with perpendicular magnetic anisotropy

Gräfe, J., Weigand, M., Träger, N., Schütz, G., Goering, E. J., Skripnik, M., Nowak, U., Haering, F., Ziemann, P., Wiedwald, U.

{Physical Review B}, 93(10), American Physical Society, Woodbury, NY, 2016 (article)

mms

DOI Project Page Project Page [BibTex]

DOI Project Page Project Page [BibTex]


no image
Growth and characterizationof large weak topological insulator Bi2Tel single crystal by Bismuth self-flux method

Ryu, G., Son, K., Schütz, G.

{Journal of Crystal Growth}, 440, pages: 26-30, North-Holland, Amsterdam, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Additive interfacial chiral interaction in multilayers for stabilization of small individual skyrmions at room temperature

Moreau-Luchaire, C., Moutafis, C., Reyren, N., Sampaio, J., Vaz, C. A. F., Van Horne, N., Bouzehouane, K., Garcia, K., Deranlot, C., Warnicke, P., Wohlhüter, P., George, J.-M., Weigand, M., Raabe, J., Cros, V., Fert, A.

{Nature Nanotechnology}, 11(5):444-448, Nature Publishing Group, London, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Surface defect free growth of a spin dimer TlCuCl3 compound crystals and investigations on its optical and magnetic properties

Ryu, G., Son, K.

{Journal of Solid State Chemistry}, 237, pages: 358-363, Academic Press, Orlando, Fla., 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Physical and mathematical justification of the numerical Brillouin zone integration of the Boltzmann rate equation by Gaussian smearing

Illg, C., Haag, M., Teeny, N., Wirth, J., Fähnle, M.

{Journal of Theoretical and Applied Physics}, 10(1):1-6, Springer, Berlin, Heidelberg, Tehran, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Pinned orbital moments - A new contribution to magnetic anisotropy

Audehm, P., Schmidt, M., Brück, S., Tietze, T., Gräfe, J., Macke, S., Schütz, G., Goering, E.

{Scientific Reports}, 6, Nature Publishing Group, London, UK, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Comparative study of ALD SiO2 thin films for optical applications

Pfeiffer, K., Shestaeva, S., Bingel, A., Munzert, P., Ghazaryan, L., van Helvoirt, C., Kessels, W. M. M., Sanli, U. T., Grévent, C., Schütz, G., Putkonen, M., Buchanan, I., Jensen, L., Ristau, D., Tünnermann, A., Szeghalmi, A.

{Optical materials express}, 6(2):660-670, OSA, Washington, DC, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Combined first-order reversal curve and x-ray microscopy investigation of magnetization reversal mechanisms in hexagonal antidot lattices

Gräfe, J., Weigand, M., Stahl, C., Träger, N., Kopp, M., Schütz, G., Goering, E. J., Haering, F., Ziemann, P., Wiedwald, U.

{Physical Review B}, 93(1), American Physical Society, Woodbury, NY, 2016 (article)

mms

DOI Project Page Project Page [BibTex]

DOI Project Page Project Page [BibTex]


no image
Switching probabilities of magnetic vortex core reversal studied by table top magneto optic Kerr microscopy

Dieterle, G., Gangwar, A., Gräfe, J., Noske, M., Förster, J., Woltersdorf, G., Stoll, H., Back, C. H., Schütz, G.

{Applied Physics Letters}, 108(2), American Institute of Physics, Melville, NY, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Ultrafast demagnetization after femtosecond laser pulses: Transfer of angular momentum from the electronic system to magnetoelastic spin-phonon modes

Tsatsoulis, T., Illg, C., Haag, M., Müller, B. Y., Zhang, L., Fähnle, M.

{Physical Review B}, 93(13), American Physical Society, Woodbury, NY, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Developments in the Ni-Nb-Zr amorphous alloy membranes

Sarker, S., Chandra, D., Hirscher, M., Dolan, M., Isheim, D., Wermer, J., Viano, D., Baricco, M., Udovic, T. J., Grant, D., Palumbo, O., Paolone, A., Cantelli, R.

{Applied Physics A}, 122(3), Springer-Verlag Heidelberg, Heidelberg, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Resistance to the transport of H2 through the external surface of as-made and modified silicalite-1 (MFI)

Kalantzopoulos, G. N., Policicchio, A., Maccallini, E., Krkljus, I., Ciuchi, F., Hirscher, M., Agostino, R. G., Golemme, G.

{Microporous and Mesoporous Materials}, 220, pages: 290-297, Elsevier, Amsterdam, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Observation of pseudopartial grain boundary wetting in the NdFeB-based alloy

Straumal, B. B., Mazilkin, A. A., Protasova, S. G., Schütz, G., Straumal, A. B., Baretzky, B.

{Journal of Materials Engineering and Performance}, 25(8):3303-3309, 2016 (article)

mms

DOI [BibTex]

DOI [BibTex]

2015


Thumb xl zhou
Exploiting Object Similarity in 3D Reconstruction

Zhou, C., Güney, F., Wang, Y., Geiger, A.

In International Conference on Computer Vision (ICCV), December 2015 (inproceedings)

Abstract
Despite recent progress, reconstructing outdoor scenes in 3D from movable platforms remains a highly difficult endeavor. Challenges include low frame rates, occlusions, large distortions and difficult lighting conditions. In this paper, we leverage the fact that the larger the reconstructed area, the more likely objects of similar type and shape will occur in the scene. This is particularly true for outdoor scenes where buildings and vehicles often suffer from missing texture or reflections, but share similarity in 3D shape. We take advantage of this shape similarity by locating objects using detectors and jointly reconstructing them while learning a volumetric model of their shape. This allows us to reduce noise while completing missing surfaces as objects of similar shape benefit from all observations for the respective category. We evaluate our approach with respect to LIDAR ground truth on a novel challenging suburban dataset and show its advantages over the state-of-the-art.

avg ps

pdf suppmat [BibTex]

2015


pdf suppmat [BibTex]


Thumb xl philip
FollowMe: Efficient Online Min-Cost Flow Tracking with Bounded Memory and Computation

Lenz, P., Geiger, A., Urtasun, R.

In International Conference on Computer Vision (ICCV), International Conference on Computer Vision (ICCV), December 2015 (inproceedings)

Abstract
One of the most popular approaches to multi-target tracking is tracking-by-detection. Current min-cost flow algorithms which solve the data association problem optimally have three main drawbacks: they are computationally expensive, they assume that the whole video is given as a batch, and they scale badly in memory and computation with the length of the video sequence. In this paper, we address each of these issues, resulting in a computationally and memory-bounded solution. First, we introduce a dynamic version of the successive shortest-path algorithm which solves the data association problem optimally while reusing computation, resulting in faster inference than standard solvers. Second, we address the optimal solution to the data association problem when dealing with an incoming stream of data (i.e., online setting). Finally, we present our main contribution which is an approximate online solution with bounded memory and computation which is capable of handling videos of arbitrary length while performing tracking in real time. We demonstrate the effectiveness of our algorithms on the KITTI and PETS2009 benchmarks and show state-of-the-art performance, while being significantly faster than existing solvers.

avg ps

pdf suppmat video project [BibTex]

pdf suppmat video project [BibTex]


Thumb xl teaser
Towards Probabilistic Volumetric Reconstruction using Ray Potentials

(Best Paper Award)

Ulusoy, A. O., Geiger, A., Black, M. J.

In 3D Vision (3DV), 2015 3rd International Conference on, pages: 10-18, Lyon, October 2015 (inproceedings)

Abstract
This paper presents a novel probabilistic foundation for volumetric 3-d reconstruction. We formulate the problem as inference in a Markov random field, which accurately captures the dependencies between the occupancy and appearance of each voxel, given all input images. Our main contribution is an approximate highly parallelized discrete-continuous inference algorithm to compute the marginal distributions of each voxel's occupancy and appearance. In contrast to the MAP solution, marginals encode the underlying uncertainty and ambiguity in the reconstruction. Moreover, the proposed algorithm allows for a Bayes optimal prediction with respect to a natural reconstruction loss. We compare our method to two state-of-the-art volumetric reconstruction algorithms on three challenging aerial datasets with LIDAR ground truth. Our experiments demonstrate that the proposed algorithm compares favorably in terms of reconstruction accuracy and the ability to expose reconstruction uncertainty.

avg ps

code YouTube pdf suppmat DOI Project Page [BibTex]

code YouTube pdf suppmat DOI Project Page [BibTex]


Thumb xl img displet
Displets: Resolving Stereo Ambiguities using Object Knowledge

Güney, F., Geiger, A.

In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) 2015, pages: 4165-4175, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2015 (inproceedings)

Abstract
Stereo techniques have witnessed tremendous progress over the last decades, yet some aspects of the problem still remain challenging today. Striking examples are reflecting and textureless surfaces which cannot easily be recovered using traditional local regularizers. In this paper, we therefore propose to regularize over larger distances using object-category specific disparity proposals (displets) which we sample using inverse graphics techniques based on a sparse disparity estimate and a semantic segmentation of the image. The proposed displets encode the fact that objects of certain categories are not arbitrarily shaped but typically exhibit regular structures. We integrate them as non-local regularizer for the challenging object class 'car' into a superpixel based CRF framework and demonstrate its benefits on the KITTI stereo evaluation.

avg ps

pdf abstract suppmat [BibTex]

pdf abstract suppmat [BibTex]


Thumb xl img sceneflow
Object Scene Flow for Autonomous Vehicles

Menze, M., Geiger, A.

In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) 2015, pages: 3061-3070, IEEE, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2015 (inproceedings)

Abstract
This paper proposes a novel model and dataset for 3D scene flow estimation with an application to autonomous driving. Taking advantage of the fact that outdoor scenes often decompose into a small number of independently moving objects, we represent each element in the scene by its rigid motion parameters and each superpixel by a 3D plane as well as an index to the corresponding object. This minimal representation increases robustness and leads to a discrete-continuous CRF where the data term decomposes into pairwise potentials between superpixels and objects. Moreover, our model intrinsically segments the scene into its constituting dynamic components. We demonstrate the performance of our model on existing benchmarks as well as a novel realistic dataset with scene flow ground truth. We obtain this dataset by annotating 400 dynamic scenes from the KITTI raw data collection using detailed 3D CAD models for all vehicles in motion. Our experiments also reveal novel challenges which can't be handled by existing methods.

avg ps

pdf abstract suppmat DOI [BibTex]

pdf abstract suppmat DOI [BibTex]