Header logo is


2019


Towards Geometric Understanding of Motion
Towards Geometric Understanding of Motion

Ranjan, A.

University of Tübingen, December 2019 (phdthesis)

Abstract

The motion of the world is inherently dependent on the spatial structure of the world and its geometry. Therefore, classical optical flow methods try to model this geometry to solve for the motion. However, recent deep learning methods take a completely different approach. They try to predict optical flow by learning from labelled data. Although deep networks have shown state-of-the-art performance on classification problems in computer vision, they have not been as effective in solving optical flow. The key reason is that deep learning methods do not explicitly model the structure of the world in a neural network, and instead expect the network to learn about the structure from data. We hypothesize that it is difficult for a network to learn about motion without any constraint on the structure of the world. Therefore, we explore several approaches to explicitly model the geometry of the world and its spatial structure in deep neural networks.

The spatial structure in images can be captured by representing it at multiple scales. To represent multiple scales of images in deep neural nets, we introduce a Spatial Pyramid Network (SpyNet). Such a network can leverage global information for estimating large motions and local information for estimating small motions. We show that SpyNet significantly improves over previous optical flow networks while also being the smallest and fastest neural network for motion estimation. SPyNet achieves a 97% reduction in model parameters over previous methods and is more accurate.

The spatial structure of the world extends to people and their motion. Humans have a very well-defined structure, and this information is useful in estimating optical flow for humans. To leverage this information, we create a synthetic dataset for human optical flow using a statistical human body model and motion capture sequences. We use this dataset to train deep networks and see significant improvement in the ability of the networks to estimate human optical flow.

The structure and geometry of the world affects the motion. Therefore, learning about the structure of the scene together with the motion can benefit both problems. To facilitate this, we introduce Competitive Collaboration, where several neural networks are constrained by geometry and can jointly learn about structure and motion in the scene without any labels. To this end, we show that jointly learning single view depth prediction, camera motion, optical flow and motion segmentation using Competitive Collaboration achieves state-of-the-art results among unsupervised approaches.

Our findings provide support for our hypothesis that explicit constraints on structure and geometry of the world lead to better methods for motion estimation.

ps

PhD Thesis [BibTex]

2019


PhD Thesis [BibTex]


The acoustic hologram and particle manipulation with structured acoustic fields
The acoustic hologram and particle manipulation with structured acoustic fields

Melde, K.

Karlsruher Institut für Technologie (KIT), May 2019 (phdthesis)

Abstract
This thesis presents holograms as a novel approach to create arbitrary ultrasound fields. It is shown how any wavefront can simply be encoded in the thickness profile of a phase plate. Contemporary 3D-printers enable fabrication of structured surfaces with feature sizes corresponding to wavelengths of ultrasound up to 7.5 MHz in water—covering the majority of medical and industrial applications. The whole workflow for designing and creating acoustic holograms has been developed and is presented in this thesis. To reconstruct the encoded fields a single transducer element is sufficient. Arbitrary fields are demonstrated in transmission and reflection configurations in water and air and validated by extensive hydrophone scans. To complement these time-consuming measurements a new approach, based on thermography, is presented, which enables volumetric sound field scans in just a few seconds. Several original experiments demonstrate the advantages of using acoustic holograms for particle manipulation. Most notably, directed parallel assembly of microparticles in the shape of a projected acoustic image has been shown and extended to a fabrication method by fusing the particles in a polymerization reaction. Further, seemingly dynamic propulsion from a static hologram is demonstrated by controlling the phase gradient along a projected track. The necessary complexity to create ultrasound fields with set amplitude and phase distributions is easily managed using acoustic holograms. The acoustic hologram is a simple and cost-effective tool for shaping ultrasound fields with high-fidelity. It is expected to have an impact in many applications where ultrasound is employed.

pf

link (url) DOI [BibTex]


no image
X-ray microscopic characterization of high-Tc-supercoductors using image processing

Bihler, M.

Universität Stuttgart, Stuttgart, 2019 (mastersthesis)

mms

[BibTex]


no image
Novel X-ray lenses for direct and coherent imaging

Sanli, U. T.

Universität Stuttgart, Stuttgart, 2019 (phdthesis)

mms

link (url) DOI [BibTex]

link (url) DOI [BibTex]


Dynamics of self-propelled colloids and their application as active matter
Dynamics of self-propelled colloids and their application as active matter

Choudhury, U.

University of Groningen, Zernike Institute for Advanced Materials, 2019 (phdthesis)

Abstract
In this thesis, the behavior of active particles spanning from single particle dynamics to collective behavior of many particles is explored. Active colloids are out-of equilibrium systems that have been studied extensively over the past 15 years. This thesis addresses several phenomena that arise in the field of active colloids.

pf

link (url) [BibTex]

link (url) [BibTex]

2014


no image
Pole Balancing with Apollo

Holger Kaden

Eberhard Karls Universität Tübingen, December 2014 (mastersthesis)

am

[BibTex]

2014


[BibTex]


no image
Learning Coupling Terms for Obstacle Avoidance

Rai, A.

École polytechnique fédérale de Lausanne, August 2014 (mastersthesis)

am

Project Page [BibTex]

Project Page [BibTex]


no image
Object Tracking in Depth Images Using Sigma Point Kalman Filters

Issac, J.

Karlsruhe Institute of Technology, July 2014 (mastersthesis)

am

Project Page [BibTex]

Project Page [BibTex]


Modeling the Human Body in 3D: Data Registration and Human Shape Representation
Modeling the Human Body in 3D: Data Registration and Human Shape Representation

Tsoli, A.

Brown University, Department of Computer Science, May 2014 (phdthesis)

ps

pdf [BibTex]

pdf [BibTex]


no image
Learning objective functions for autonomous motion generation

Kalakrishnan, M.

University of Southern California, University of Southern California, Los Angeles, CA, 2014 (phdthesis)

am

Project Page Project Page [BibTex]

Project Page Project Page [BibTex]


no image
Data-driven autonomous manipulation

Pastor, P.

University of Southern California, University of Southern California, Los Angeles, CA, 2014 (phdthesis)

am

Project Page Project Page [BibTex]

Project Page Project Page [BibTex]


no image
Efficient Dense Registration, Segmentation, and Modeling Methods for RGB-D Environment Perception

Stueckler, J.

Faculty of Mathematics and Natural Sciences, University of Bonn, Germany, 2014 (phdthesis)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Schalten der Polarität magnetischer Vortexkerne durch eine Zwei-Frequenzen Anregung und mittels direkter Einkopplung eines Stroms

Sproll, M.

Universität Stuttgart, Stuttgart (und Cuvillier Verlag, Göttingen), Stuttgart, 2014 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Vortex-Kern-Korrelation in gekoppelten Systemen

Jüllig, P.

Universität Stuttgart, Stuttgart, 2014 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Realization of a new Magnetic Scanning X-ray Microscope and Investigation of Landau Structures under Pulsed Field Excitation

Weigand, M.

Universität Stuttgart, Stuttgart (und Cuvillier Verlag, Göttingen), 2014 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Nanoporous Materials for Hydrogen Storage and H2/D2 Isotope Separation

Oh, H.

Universität Stuttgart, Stuttgart, 2014 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]

2009


no image
Magnetische L10-FePt Nanostrukturen für höchste Datenspeicherdichten

Breitling, A.

Universität Stuttgart, Stuttgart, 2009 (phdthesis)

mms

[BibTex]

2009


[BibTex]


no image
Ab-initio Elliott-Yafet modeling of ultrafast demagnetization after laser irradiation

Illg, C.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Element specific investigation of the magnetization profile at the CrO2/RuO2 interface

Zafar, K.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Bayesian Methods for Autonomous Learning Systems (Phd Thesis)

Ting, J.

Department of Computer Science, University of Southern California, Los Angeles, CA, 2009, clmc (phdthesis)

am

PDF [BibTex]

PDF [BibTex]


no image
Magnetic resonant reflectometry on exchange bias systems

Brück, S.

Universität Stuttgart, Stuttgart, 2009 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
In-situ - Untersuchungen zu Interdiffusion und Magnetismus in magnetischen Multilayern

Schmidt, M.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Theorie der elektronischen Zustände in oxidischen magnetischen Materialien

Kostoglou, C.

Universität Stuttgart, Stuttgart, 2009 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Magnetooptische Untersuchungen an Ferromagnet- und Supraleiter-Nanosystemen und deren Hybriden

Treiber, S.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

[BibTex]

[BibTex]

1992


Robust Incremental Optical Flow
Robust Incremental Optical Flow

Black, M. J.

Yale University, Department of Computer Science, New Haven, CT, 1992, Research Report YALEU-DCS-RR-923 (phdthesis)

ps

pdf Old C code (dense) Old C code (regression) Modern Code (Matlab) [BibTex]

1992


pdf Old C code (dense) Old C code (regression) Modern Code (Matlab) [BibTex]