Header logo is


2020


Learning Multi-Human Optical Flow
Learning Multi-Human Optical Flow

Ranjan, A., Hoffmann, D. T., Tzionas, D., Tang, S., Romero, J., Black, M. J.

International Journal of Computer Vision (IJCV), January 2020 (article)

Abstract
The optical flow of humans is well known to be useful for the analysis of human action. Recent optical flow methods focus on training deep networks to approach the problem. However, the training data used by them does not cover the domain of human motion. Therefore, we develop a dataset of multi-human optical flow and train optical flow networks on this dataset. We use a 3D model of the human body and motion capture data to synthesize realistic flow fields in both single-and multi-person images. We then train optical flow networks to estimate human flow fields from pairs of images. We demonstrate that our trained networks are more accurate than a wide range of top methods on held-out test data and that they can generalize well to real image sequences. The code, trained models and the dataset are available for research.

ps

Paper Publisher Version poster link (url) DOI [BibTex]


no image
Effect of the soft layer thickness of magnetization reversal process of exchange-spring nanomagnet patterns

Son, K., Schütz, G., Goering, E.

{Current Applied Physics}, 20(4):477-483, Elsevier B.V., Amsterdam, 2020 (article)

mms

DOI [BibTex]


no image
Tuning the magnetic properties of permalloy-based magnetoplasmonic crystals for sensor applications

Murzin, D. V., Belyaev, V. K., Groß, F., Gräfe, J., Rivas, M., Rodionova, V. V.

{Japanese Journal of Applied Physics}, 59(SE), IOP Publishing Ltd, Bristol, England, 2020 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Creating zero-field skyrmions in exchange-biased multilayers through X-ray illumination

Guang, Y., Bykova, I., Liu, Y., Yu, G., Goering, E., Weigand, M., Gräfe, J., Kim, S. K., Zhang, J., Zhang, H., Yan, Z., Wan, C., Feng, J., Wang, X., Guo, C., Wei, H., Peng, Y., Tserkovnyak, Y., Han, X., Schütz, G.

{Nature Communications}, 11, Nature Publishing Group, London, 2020 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Element-resolved study of the evolution of magnetic response in FexN compounds

Chen, Y., Gölden, D., Dirba, I., Huang, M., Gutfleisch, O., Nagel, P., Merz, M., Schuppler, S., Schütz, G., Alff, L., Goering, E.

{Journal of Magnetism and Magnetic Materials}, 498, NH, Elsevier, Amsterdam, 2020 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
The role of temperature and drive current in skyrmion dynamics

Litzius, K., Leliaert, J., Bassirian, P., Rodrigues, D., Kromin, S., Lemesh, I., Zazvorka, J., Lee, K., Mulkers, J., Kerber, N., Heinze, D., Keil, N., Reeve, R. M., Weigand, M., Van Waeyenberge, B., Schütz, G., Everschor-Sitte, K., Beach, G. S. D., Kläui, M.

{Nature Electronics}, 3(1):30-36, Springer Nature, London, 2020 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetic flux penetration into micron-sized superconductor/ferromagnet bilayers

Simmendinger, J., Weigand, M., Schütz, G., Albrecht, J.

{Superconductor Science and Technology}, 33(2), IOP Pub., Bristol, 2020 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Fabrication and temperature-dependent magnetic properties of large-area L10-FePt/Co exchange-spring magnet nanopatterns

Son, K., Schütz, G.

{Physica E: Low-Dimensional Systems And Nanostructures}, 115, North-Holland, Amsterdam, 2020 (article)

mms

DOI [BibTex]

DOI [BibTex]


General Movement Assessment from videos of computed {3D} infant body models is equally effective compared to conventional {RGB} Video rating
General Movement Assessment from videos of computed 3D infant body models is equally effective compared to conventional RGB Video rating

Schroeder, S., Hesse, N., Weinberger, R., Tacke, U., Gerstl, L., Hilgendorff, A., Heinen, F., Arens, M., Bodensteiner, C., Dijkstra, L. J., Pujades, S., Black, M., Hadders-Algra, M.

Early Human Development, 2020 (article)

Abstract
Background: General Movement Assessment (GMA) is a powerful tool to predict Cerebral Palsy (CP). Yet, GMA requires substantial training hampering its implementation in clinical routine. This inspired a world-wide quest for automated GMA. Aim: To test whether a low-cost, marker-less system for three-dimensional motion capture from RGB depth sequences using a whole body infant model may serve as the basis for automated GMA. Study design: Clinical case study at an academic neurodevelopmental outpatient clinic. Subjects: Twenty-nine high-risk infants were recruited and assessed at their clinical follow-up at 2-4 month corrected age (CA). Their neurodevelopmental outcome was assessed regularly up to 12-31 months CA. Outcome measures: GMA according to Hadders-Algra by a masked GMA-expert of conventional and computed 3D body model (“SMIL motion”) videos of the same GMs. Agreement between both GMAs was assessed, and sensitivity and specificity of both methods to predict CP at ≥12 months CA. Results: The agreement of the two GMA ratings was substantial, with κ=0.66 for the classification of definitely abnormal (DA) GMs and an ICC of 0.887 (95% CI 0.762;0.947) for a more detailed GM-scoring. Five children were diagnosed with CP (four bilateral, one unilateral CP). The GMs of the child with unilateral CP were twice rated as mildly abnormal. DA-ratings of both videos predicted bilateral CP well: sensitivity 75% and 100%, specificity 88% and 92% for conventional and SMIL motion videos, respectively. Conclusions: Our computed infant 3D full body model is an attractive starting point for automated GMA in infants at risk of CP.

ps

[BibTex]

[BibTex]


no image
How to functionalise metal-organic frameworks to enable guest nanocluster embedment

King, J., Zhang, L., Doszczeczko, S., Sambalova, O., Luo, H., Rohman, F., Phillips, O., Borgschulte, A., Hirscher, M., Addicoat, M., Szilágyi, P. A.

{Journal of Materials Chemistry A}, 8(9):4889-4897, Royal Society of Chemistry, Cambridge, UK, 2020 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Thermal nucleation and high-resolution imaging of submicrometer magnetic bubbles in thin thulium iron garnet films with perpendicular anisotropy

Büttner, F., Mawass, M. A., Bauer, J., Rosenberg, E., Caretta, L., Avci, C. O., Gräfe, J., Finizio, S., Vaz, C. A. F., Novakovic, N., Weigand, M., Litzius, K., Förster, J., Träger, N., Groß, F., Suzuki, D., Huang, M., Bartell, J., Kronast, F., Raabe, J., Schütz, G., Ross, C. A., Beach, G. S. D.

{Physical Review Materials}, 4(1), American Physical Society, College Park, MD, 2020 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Generation and characterization of focused helical x-ray beams

Loetgering, L., Baluktsian, M., Keskinbora, K., Horstmeyer, R., Wilhein, T., Schütz, G., Eikema, K. S. E., Witte, S.

Science Advances, 6(7), American Association for the Advancement of Science, 2020 (article)

mms

Generation and characterization of focused helical x-ray beams link (url) DOI [BibTex]

Generation and characterization of focused helical x-ray beams link (url) DOI [BibTex]


no image
Materials for hydrogen-based energy storage - past, recent progress and future outlook

Hirscher, M., Yartys, V. A., Baricco, M., Bellosta von Colbe, J., Blanchard, D., Bowman Jr., R. C., Broom, D. P., Buckley, C. E., Chang, F., Chen, P., Cho, Y. W., Crivello, J., Cuevas, F., David, W. I. F., de Jongh, P. E., Denys, R. V., Dornheim, M., Felderhoff, M., Filinchuk, Y., Froudakis, G. E., Grant, D. M., Gray, E. M., Hauback, B. C., He, T., Humphries, T. D., Jensen, T. R., Kim, S., Kojima, Y., Latroche, M., Li, H., Lotostskyy, M. V., Makepeace, J. W., M\oller, K. T., Naheed, L., Ngene, P., Noréus, D., Nyg\aard, M. M., Orimo, S., Paskevicius, M., Pasquini, L., Ravnsbaek, D. B., Sofianos, M. V., Udovic, T. J., Vegge, T., Walker, G. S., Webb, C. J., Weidenthaler, C., Zlotea, C.

{Journal of Alloys and Compounds}, 827, Elsevier B.V., Lausanne, Switzerland, 2020 (article)

mms

DOI [BibTex]

DOI [BibTex]

2007


no image
Learning static Gestalt laws through dynamic experience

Ostrovsky, Y., Wulff, J., Sinha, P.

Journal of Vision, 7(9):315-315, ARVO, June 2007 (article)

Abstract
The Gestalt laws (Wertheimer 1923) are widely regarded as the rules that help us parse the world into objects. However, it is unclear as to how these laws are acquired by an infant's visual system. Classically, these “laws” have been presumed to be innate (Kellman and Spelke 1983). But, more recent work in infant development, showing the protracted time-course over which these grouping principles emerge (e.g., Johnson and Aslin 1995; Craton 1996), suggests that visual experience might play a role in their genesis. Specifically, our studies of patients with late-onset vision (Project Prakash; VSS 2006) and evidence from infant development both point to an early role of common motion cues for object grouping. Here we explore the possibility that the privileged status of motion in the developmental timeline is not happenstance, but rather serves to bootstrap the learning of static Gestalt cues. Our approach involves computational analyses of real-world motion sequences to investigate whether primitive optic flow information is correlated with static figural cues that could eventually come to serve as proxies for grouping in the form of Gestalt principles. We calculated local optic flow maps and then examined how similarity of motion across image patches co-varied with similarity of certain figural properties in static frames. Results indicate that patches with similar motion are much more likely to have similar luminance, color, and orientation as compared to patches with dissimilar motion vectors. This regularity suggests that, in principle, common motion extracted from dynamic visual experience can provide enough information to bootstrap region grouping based on luminance and color and contour continuation mechanisms in static scenes. These observations, coupled with the cited experimental studies, lend credence to the hypothesis that static Gestalt laws might be learned through a bootstrapping process based on early dynamic experience.

ps

link (url) DOI [BibTex]

2007


link (url) DOI [BibTex]


Neuromotor prosthesis development
Neuromotor prosthesis development

Donoghue, J., Hochberg, L., Nurmikko, A., Black, M., Simeral, J., Friehs, G.

Medicine & Health Rhode Island, 90(1):12-15, January 2007 (article)

Abstract
Article describes a neuromotor prosthesis (NMP), in development at Brown University, that records human brain signals, decodes them, and transforms them into movement commands. An NMP is described as a system consisting of a neural interface, a decoding system, and a user interface, also called an effector; a closed-loop system would be completed by a feedback signal from the effector to the brain. The interface is based on neural spiking, a source of information-rich, rapid, complex control signals from the nervous system. The NMP described, named BrainGate, consists of a match-head sized platform with 100 thread-thin electrodes implanted just into the surface of the motor cortex where commands to move the hand emanate. Neural signals are decoded by a rack of computers that displays the resultant output as the motion of a cursor on a computer monitor. While computer cursor motion represents a form of virtual device control, this same command signal could be routed to a device to command motion of paralyzed muscles or the actions of prosthetic limbs. The researchers’ overall goal is the development of a fully implantable, wireless multi-neuron sensor for broad research, neural prosthetic, and human neurodiagnostic applications.

ps

pdf [BibTex]

pdf [BibTex]


On the spatial statistics of optical flow
On the spatial statistics of optical flow

Roth, S., Black, M. J.

International Journal of Computer Vision, 74(1):33-50, 2007 (article)

Abstract
We present an analysis of the spatial and temporal statistics of "natural" optical flow fields and a novel flow algorithm that exploits their spatial statistics. Training flow fields are constructed using range images of natural scenes and 3D camera motions recovered from hand-held and car-mounted video sequences. A detailed analysis of optical flow statistics in natural scenes is presented and machine learning methods are developed to learn a Markov random field model of optical flow. The prior probability of a flow field is formulated as a Field-of-Experts model that captures the spatial statistics in overlapping patches and is trained using contrastive divergence. This new optical flow prior is compared with previous robust priors and is incorporated into a recent, accurate algorithm for dense optical flow computation. Experiments with natural and synthetic sequences illustrate how the learned optical flow prior quantitatively improves flow accuracy and how it captures the rich spatial structure found in natural scene motion.

ps

pdf preprint pdf from publisher [BibTex]

pdf preprint pdf from publisher [BibTex]


no image
Hydrogen storage in metal-organic frameworks

Hirscher, M., Panella, B.

{Scripta Materialia}, 56, pages: 809-812, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Substrate-induced current anisotropy in YBa2Cu3O7-δthin films

Djupmyr, M., Albrecht, J.

{Physica C}, 460-462, pages: 1190-1191, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
A micellar approach to magnetic ultrahigh-density data-storage media: extending the limits of current colloidal methods

Ethirajan, A., Wiedwald, U., Boyen, H.-G., Kern, B., Han, L., Klimmer, A., Weigl, F., Kästle, G., Ziemann, P., Fauth, K., Cai, J., Behm, J., Romanyuk, A., Oelhafen, P., Walther, P., Biskupek, J., Kaiser, U.

{Advanced Materials}, 19, pages: 406-410, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Size dependence in the magnetization reversal of Fe/Gd multilayers on self-assembled arrays of nanospheres

Amaladass, E., Ludescher, B., Schütz, G., Tyliszczak, T., Eimüller, T.

{Applied Physics Letters}, 91, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Ma\ssgeschneiderte Wasserstoffspeicher

Hirscher, M., Panella, B.

{Nachrichten aus der Gdch-Energieinitiative}, (Sonderheft April 2007):12-13, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Reconstruction of historical alloys for pipe organs brings true Baroque music back to life.

Baretzky, B., Friesel, M., Straumal, B.

{MRS Bulletin}, 32, pages: 249-255, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Analysis of results from X-ray magnetic reflectometry for magnetic multilayer systems

Fähnle, M., Steiauf, D., Martosiswoyo, L., Goering, E., Brück, S., Schütz, G.

{Physical Review B}, 75, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Dramatic role of critical current anisotropy on flux avalanches in MgB2 films

Albrecht, J., Matveev, A. T., Strempfer, J., Habermeier, H.-U., Shantsev, D. V., Galperin, Y. M., Johansen, T. H.

{Physical Review Letters}, 98, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Transport properties of LCMO/YBCO hybrid structures

Soltan, S., Albrecht, J., Habermeier, H.-U.

{Materials Science and Engineering B}, 144, pages: 15-18, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]


Assistive technology and robotic control using {MI} ensemble-based neural interface systems in humans with tetraplegia
Assistive technology and robotic control using MI ensemble-based neural interface systems in humans with tetraplegia

Donoghue, J. P., Nurmikko, A., Black, M. J., Hochberg, L.

Journal of Physiology, Special Issue on Brain Computer Interfaces, 579, pages: 603-611, 2007 (article)

Abstract
This review describes the rationale, early stage development, and initial human application of neural interface systems (NISs) for humans with paralysis. NISs are emerging medical devices designed to allowpersonswith paralysis to operate assistive technologies or to reanimatemuscles based upon a command signal that is obtained directly fromthe brain. Such systems require the development of sensors to detect brain signals, decoders to transformneural activity signals into a useful command, and an interface for the user.We review initial pilot trial results of an NIS that is based on an intracortical microelectrode sensor that derives control signals from the motor cortex.We review recent findings showing, first, that neurons engaged by movement intentions persist in motor cortex years after injury or disease to the motor system, and second, that signals derived from motor cortex can be used by persons with paralysis to operate a range of devices. We suggest that, with further development, this form of NIS holds promise as a useful new neurotechnology for those with limited motor function or communication.We also discuss the additional potential for neural sensors to be used in the diagnosis and management of various neurological conditions and as a new way to learn about human brain function.

ps

pdf preprint pdf from publisher DOI [BibTex]

pdf preprint pdf from publisher DOI [BibTex]


no image
Cluster expansions in multicomponent systems: precise expansions from noisy databases

Diaz-Ortiz, A., Dosch, H., Drautz, R.

{Journal of Physics: Condensed Matter}, 19, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Unusual propagation of magnetic avalanches in gold covered MgB2

Albrecht, J., Matveev, A. T., Habermeier, H.-U.

{Physica C}, 460-462, pages: 1245-1246, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Lowering of the L10 ordering temperature of FePt nanoparticles by He+ ion irradiation

Wiedwald, U., Klimmer, A., Kern, B., Han, L., Boyen, H.-G., Ziemann, P., Fauth, K.

{Applied Physics Letters}, 90, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Magnetic core shell nanoparticles characterized by X-ray absorption and magnetic circular dichroism

Fauth, K.

{Modern Physics Letters B}, 21(18):1179-1187, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Magnetic moment of Fe in oxide-free FePt nanoparticles

Dmitrieva, O., Spasova, M., Antoniak, C., Acet, M., Dumpich, G., Kästner, J., Farle, M., Fauth, K., Wiedwald, U., Boyen, H.-G., Ziemann, P.

{Physical Review B}, 76, 2007 (article)

mms

[BibTex]

[BibTex]


no image
The effect of bismuth segregation on the faceting of \Sigma3 and \Sigma9 coincidence boundaries in copper bicrystals

Straumal, B. B., Polyakov, S. A., Chang, L.-S., Mittemeijer, E. J.

{International Journal of Materials Research}, 98, pages: 451-456, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Hot isostatic pressing of Cu-Bi polycrystals with liquid-like grain boundary layers

Chang, L.-S., Straumal, B., Rabkin, E., Lojkowski, W., Gust, W.

{Acta Materialia}, 55, pages: 335-343, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Spatially resolved magnetic response in core shell nanoparticles

Fauth, K., Goering, E., Theil Kuhn, L.

{Modern Physics Letters B}, 21(18):1197-1200, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Interfaces in semiconductor/metal radial superlattices

Deneke, C., Sigle, W., Eigenthaler, U., van Aken, P. A., Schütz, G., Schmidt, O. G.

{Applied Physics Letters}, 90, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Live cell adhesion assay with attenuated total reflection infrared spectroscopy

Schmidt, M., Wolfram, T., Rumpler, M., Tripp, C. P., Grunze, M.

{Biointerphases}, 2(1):1-5, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Unusual Co moment reduction in the NiCoO/Co exchange bias system

Brück, S., Goering, E., Tang, Y. J., Schütz, G., Berkowitz, A. E.

{Journal of Magnetism and Magnetic Materials}, 310, pages: 2316-2318, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Ab initio calculations of adiabatic magnon spectra using the atomic-sphere aproximation for the spin direction

Singer, R., Dietermann, F., Steiauf, D., Fähnle, M.

{Physical Review B}, 76, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Low-temperature thermal-desorption mass spectroscopy applied to investigate the hydrogen adsorption on porous materials

Panella, B., Hirscher, M., Ludescher, B.

{Microporous and Mesoporous Materials}, 103, pages: 230-234, 2007 (article)

mms

[BibTex]


no image
Dependence of the critical temperature of YBCO thin films on spinpolarized quasiparticle injection

Habermeier, H.-U., Soltan, S., Albrecht, J.

{International Journal of Modern Physics B}, 21(18 \& 19):3303-3306, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Copper alloys for the restoration of reed pipes in historic organs

Straumal, B. B., Baretzky, B., Kalnins, J., Aslund, A., Friesel, M.

{Journal of Functional Materials}, 1, pages: 4-10, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Inhomogeneous vortex distribution and magnetic coupling in oxide superconductor-ferromagnet hybrids

Albrecht, J., Djupmyr, M., Soltan, S., Habermeier, H.-U., Connolly, M. R., Bending, S. J.

{New Journal of Physics}, 9, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Metal hydride materials for solid hydrogen storage: a review

Sakintuna, B., Lamari-Darkrim, F., Hirscher, M.

{International Journal of Hydrogen Energy}, 32, pages: 1121-1140, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Thermal reversal of exchange spring composite media in magnetic fields

Goll, D., Macke, S., Bertram, H. N.

{Applied Physics Letters}, 90, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Magnetism of Co-doped ZnO thin films

Gacic, M., Jakob, G., Herbort, C., Adrian, H., Tietze, T., Brück, S., Goering, E.

{Physical Review B}, 75, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Universal temperature scaling of flux line pinning in high-temperature superconducting thin films

Albrecht, J., Djupmyr, M., Brück, S.

{Journal of Physics: Condensed Matter}, 19, 2007 (article)

mms

[BibTex]

[BibTex]


no image
Dependence of the critical temperature of YBCO thin films on spin-polarized quasiparticle injection

Habermeier, H.-U., Soltan, S., Albrecht, J.

{Physica C}, 460-462, pages: 32-35, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Interaction of ferromagnetic LCMO layers through a superconducting YBCO spacer

Ravikumar, G., Yashwant, G., Singh, M. R., Gupta, S. K., Bhattacharya, S., Soltan, S., Albrecht, J., Habermeier, H.-U.

{Physica C}, 460-462, pages: 1375-1376, 2007 (article)

mms

DOI [BibTex]

DOI [BibTex]