Publications | Perceiving Systems - Max Planck Institute for Intelligent Systems

Jhuang, H. Dorsal Stream: From Algorithm to Neuroscience PhD Thesis, MIT, 2011 (techreport)

Context dependent changes in grip selectivity in primate ventral premotor cortex

Franquemont, L., Vargas-Irwin, C., Black, M., Donoghue, J.

2011 Abstract Viewer and Itinerary Planner, Online, Society for Neuroscience, 2011, Online (conference)

Franquemont, L., Vargas-Irwin, C., Black, M., Donoghue, J. Context dependent changes in grip selectivity in primate ventral premotor cortex 2011 Abstract Viewer and Itinerary Planner, Online, Society for Neuroscience, 2011, Online (conference)

Towards a freely moving animal model: Combining markerless multi-camera video capture and wirelessly transmitted neural recording for the analysis of walking

Foster, J., Freifeld, O., Nuyujukian, P., Ryu, S., Black, M., Shenoy, K.

2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Online (conference)

Project Page [BibTex]

Foster, J., Freifeld, O., Nuyujukian, P., Ryu, S., Black, M., Shenoy, K. Towards a freely moving animal model: Combining markerless multi-camera video capture and wirelessly transmitted neural recording for the analysis of walking 2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Online (conference)

Project Page [BibTex]

Modelling pipeline for subject-specific arterial blood flow—A review

Igor Sazonov, Si Yong Yeo, Rhodri Bevan, Xianghua Xie, Raoul van Loon, Perumal Nithiarasu

International Journal for Numerical Methods in Biomedical Engineering, 27(12):1868–1910, 2011 (article)

Abstract

In this paper, a robust and semi-automatic modelling pipeline for blood flow through subject-specific arterial geometries is presented. The framework developed consists of image segmentation, domain discretization (meshing) and fluid dynamics. All the three subtopics of the pipeline are explained using an example of flow through a severely stenosed human carotid artery. In the Introduction, the state-of-the-art of both image segmentation and meshing is presented in some detail, and wherever possible the advantages and disadvantages of the existing methods are analysed. Followed by this, the deformable model used for image segmentation is presented. This model is based upon a geometrical potential force (GPF), which is a function of the image. Both the GPF calculation and level set determination are explained. Following the image segmentation method, a semi-automatic meshing method used in the present study is explained in full detail. All the relevant techniques required to generate a valid domain discretization are presented. These techniques include generating a valid surface mesh, skeletonization, mesh cropping, boundary layer mesh construction and various mesh cosmetic methods that are essential for generating a high-quality domain discretization. After presenting the mesh generation procedure, how to generate flow boundary conditions for both the inlets and outlets of a geometry is explained in detail. This is followed by a brief note on the flow solver, before studying the blood flow through the carotid artery with a severe stenosis.

Igor Sazonov, Si Yong Yeo, Rhodri Bevan, Xianghua Xie, Raoul van Loon, Perumal Nithiarasu Modelling pipeline for subject-specific arterial blood flow—A review International Journal for Numerical Methods in Biomedical Engineering, 27(12):1868–1910, 2011 (article)

Geometrically Induced Force Interaction for Three-Dimensional Deformable Models

Si Yong Yeo, Xianghua Xie, Igor Sazonov, Perumal Nithiarasu

IEEE Transactions on Image Processing, 20(5):1373 - 1387, 2011 (article)

Abstract

In this paper, we propose a novel 3-D deformable model that is based upon a geometrically induced external force field which can be conveniently generalized to arbitrary dimensions. This external force field is based upon hypothesized interactions between the relative geometries of the deformable model and the object boundary characterized by image gradient. The evolution of the deformable model is solved using the level set method so that topological changes are handled automatically. The relative geometrical configurations between the deformable model and the object boundaries contribute to a dynamic vector force field that changes accordingly as the deformable model evolves. The geometrically induced dynamic interaction force has been shown to greatly improve the deformable model performance in acquiring complex geometries and highly concave boundaries, and it gives the deformable model a high invariancy in initialization configurations. The voxel interactions across the whole image domain provide a global view of the object boundary representation, giving the external force a long attraction range. The bidirectionality of the external force field allows the new deformable model to deal with arbitrary cross-boundary initializations, and facilitates the handling of weak edges and broken boundaries. In addition, we show that by enhancing the geometrical interaction field with a nonlocal edge-preserving algorithm, the new deformable model can effectively overcome image noise. We provide a comparative study on the segmentation of various geometries with different topologies from both synthetic and real images, and show that the proposed method achieves significant improvements against existing image gradient techniques.

Si Yong Yeo, Xianghua Xie, Igor Sazonov, Perumal Nithiarasu Geometrically Induced Force Interaction for Three-Dimensional Deformable Models IEEE Transactions on Image Processing, 20(5):1373 - 1387, 2011 (article)

pdf talk Project Page [BibTex]

Shape and pose-invariant correspondences using probabilistic geodesic surface embedding

Tsoli, A., Black, M. J.

In 33rd Annual Symposium of the German Association for Pattern Recognition (DAGM), 6835, pages: 256-265, Lecture Notes in Computer Science, (Editors: Mester, Rudolf and Felsberg, Michael), Springer, 2011 (inproceedings)

Abstract

Correspondence between non-rigid deformable 3D objects provides a foundation for object matching and retrieval, recognition, and 3D alignment. Establishing 3D correspondence is challenging when there are non-rigid deformations or articulations between instances of a class. We present a method for automatically finding such correspondences that deals with significant variations in pose, shape and resolution between pairs of objects.We represent objects as triangular meshes and consider normalized geodesic distances as representing their intrinsic characteristics. Geodesic distances are invariant to pose variations and nearly invariant to shape variations when properly normalized. The proposed method registers two objects by optimizing a joint probabilistic model over a subset of vertex pairs between the objects. The model enforces preservation of geodesic distances between corresponding vertex pairs and inference is performed using loopy belief propagation in a hierarchical scheme. Additionally our method prefers solutions in which local shape information is consistent at matching vertices. We quantitatively evaluate our method and show that is is more accurate than a state of the art method.

Tsoli, A., Black, M. J. Shape and pose-invariant correspondences using probabilistic geodesic surface embedding In 33rd Annual Symposium of the German Association for Pattern Recognition (DAGM), 6835, pages: 256-265, Lecture Notes in Computer Science, (Editors: Mester, Rudolf and Felsberg, Michael), Springer, 2011 (inproceedings)

pdf talk Project Page [BibTex]

Steerable random fields for image restoration and inpainting

Roth, S., Black, M. J.

In Markov Random Fields for Vision and Image Processing, pages: 377-387, (Editors: Blake, A. and Kohli, P. and Rother, C.), MIT Press, 2011 (incollection)

Abstract

This chapter introduces the concept of a Steerable Random Field (SRF). In contrast to traditional Markov random field (MRF) models in low-level vision, the random field potentials of a SRF are defined in terms of filter responses that are steered to the local image structure. This steering uses the structure tensor to obtain derivative responses that are either aligned with, or orthogonal to, the predominant local image structure. Analysis of the statistics of these steered filter responses in natural images leads to the model proposed here. Clique potentials are defined over steered filter responses using a Gaussian scale mixture model and are learned from training data. The SRF model connects random fields with anisotropic regularization and provides a statistical motivation for the latter. Steering the random field to the local image structure improves image denoising and inpainting performance compared with traditional pairwise MRFs.

publisher site [BibTex]

Roth, S., Black, M. J. Steerable random fields for image restoration and inpainting In Markov Random Fields for Vision and Image Processing, pages: 377-387, (Editors: Blake, A. and Kohli, P. and Rother, C.), MIT Press, 2011 (incollection)

publisher site [BibTex]

Spatial Models of Human Motion

Soren Hauberg

University of Copenhagen, 2011 (phdthesis)

PDF [BibTex]

Soren Hauberg Spatial Models of Human Motion University of Copenhagen, 2011 (phdthesis)

PDF [BibTex]

Visual orientation and direction selectivity through thalamic synchrony

Kelly, S., Stanley, G., Jin, J., Wang, Y., Desbordes, G., Wang, Q., Black, M., Alonso, J.

2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Online (conference)

Kelly, S., Stanley, G., Jin, J., Wang, Y., Desbordes, G., Wang, Q., Black, M., Alonso, J. Visual orientation and direction selectivity through thalamic synchrony 2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Online (conference)

Use of the BrainGate neural inteface system for more than five years by a woman with tetraplegia

2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Onine (conference)

Hochberg, L., Bacher, D., Barefoot, L., Berhanu, E., Black, M., Cash, S., Feldman, J., Gallivan, E., Homer, M., Jarosiewicz, B., King, B., Liu, J., Malik, W., Masse, N., Berge, J., Rosler, D., Schmansky, N., Simeral, J., Travers, B., Truccolo, W., Donoghue, J. Use of the BrainGate neural inteface system for more than five years by a woman with tetraplegia 2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Onine (conference)

Extracting 3D Structures from Biomedical Data

Xianghua Xie, Si Yong Yeo, Igor Sazonov, Perumal Nithiarasu

Proceedings of the 5th International Conference on Bioinformatics and Biomedical Engineering, 2011 (conference)

Xianghua Xie, Si Yong Yeo, Igor Sazonov, Perumal Nithiarasu Extracting 3D Structures from Biomedical Data Proceedings of the 5th International Conference on Bioinformatics and Biomedical Engineering, 2011 (conference)

Model-Based Pose Estimation

Pons-Moll, G., Rosenhahn, B.

In Visual Analysis of Humans: Looking at People, pages: 139-170, 9, (Editors: T. Moeslund, A. Hilton, V. Krueger, L. Sigal), Springer, 2011 (inbook)

book page pdf [BibTex]

Pons-Moll, G., Rosenhahn, B. Model-Based Pose Estimation In Visual Analysis of Humans: Looking at People, pages: 139-170, 9, (Editors: T. Moeslund, A. Hilton, V. Krueger, L. Sigal), Springer, 2011 (inbook)

book page pdf [BibTex]

Illumination Estimation and Cast Shadow Detection through a Higher-order Graphical Model

Panagopoulos, A., Wang, C., Samaras, D., Paragios, N.

In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (inproceedings)

Panagopoulos, A., Wang, C., Samaras, D., Paragios, N. Illumination Estimation and Cast Shadow Detection through a Higher-order Graphical Model In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (inproceedings)

Pose-invariant 3D Proximal Femur Estimation through Bi-Planar Image Segmentation with Hierarchical Higher-Order Graph-based Priors

Wang, C., Boussaid, H., Simon, L., Lazennec, J., Paragios, N.

In International Conference, Medical Image Computing and Computer Assisted Intervention (MICCAI), 2011 (inproceedings)

Wang, C., Boussaid, H., Simon, L., Lazennec, J., Paragios, N. Pose-invariant 3D Proximal Femur Estimation through Bi-Planar Image Segmentation with Hierarchical Higher-Order Graph-based Priors In International Conference, Medical Image Computing and Computer Assisted Intervention (MICCAI), 2011 (inproceedings)

Intrinsic Dense 3D Surface Tracking

Zeng, Y., Wang, C., Wang, Y., Gu, X., Samaras, D., Paragios, N.

In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (inproceedings)

Zeng, Y., Wang, C., Wang, Y., Gu, X., Samaras, D., Paragios, N. Intrinsic Dense 3D Surface Tracking In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (inproceedings)

Publishers site Code PDF Suppl. material [BibTex]

Data-Driven Importance Distributions for Articulated Tracking

Soren Hauberg, Kim S. Pedersen

In Energy Minimization Methods in Computer Vision and Pattern Recognition, 6819, pages: 287-299, Lecture Notes in Computer Science, (Editors: Boykov, Yuri and Kahl, Fredrik and Lempitsky, Victor and Schmidt, Frank), Springer Berlin Heidelberg, 2011 (inproceedings)

Soren Hauberg, Kim S. Pedersen Data-Driven Importance Distributions for Articulated Tracking In Energy Minimization Methods in Computer Vision and Pattern Recognition, 6819, pages: 287-299, Lecture Notes in Computer Science, (Editors: Boykov, Yuri and Kahl, Fredrik and Lempitsky, Victor and Schmidt, Frank), Springer Berlin Heidelberg, 2011 (inproceedings)

Publishers site Code PDF Suppl. material [BibTex]

A Physically Natural Metric for Human Motion and the Associated Brownian Motion Model

Soren Hauberg, Kim Steenstrup Pedersen

In 1st IEEE Workshop on Kernels and Distances for Computer Vision (ICCV workshop), 2011 (inproceedings)

Workshop link [BibTex]

Soren Hauberg, Kim Steenstrup Pedersen A Physically Natural Metric for Human Motion and the Associated Brownian Motion Model In 1st IEEE Workshop on Kernels and Distances for Computer Vision (ICCV workshop), 2011 (inproceedings)

Workshop link [BibTex]

Virtual Visual Servoing for Real-Time Robot Pose Estimation

Gratal, X., Romero, J., Kragic, D.

In International Federation of Automatic Control World Congress, IFAC, 2011 (inproceedings)

Pdf [BibTex]

Gratal, X., Romero, J., Kragic, D. Virtual Visual Servoing for Real-Time Robot Pose Estimation In International Federation of Automatic Control World Congress, IFAC, 2011 (inproceedings)

Pdf [BibTex]

Cooperative Localization Based on Visually Shared Objects

Lima, P., Santos, P., Oliveira, R., Ahmad, A., Santos, J.

In RoboCup 2010: Robot Soccer World Cup XIV, pages: 350-361, Lecture Notes in Computer Science ; 6556, Springer, Berlin, Germany, 2011 (inproceedings)

Abstract

In this paper we describe a cooperative localization algorithm based on a modification of the Monte Carlo Localization algorithm where, when a robot detects it is lost, particles are spread not uniformly in the state space, but rather according to the information on the location of an object whose distance and bearing is measured by the lost robot. The object location is provided by other robots of the same team using explicit (wireless) communication. Results of application of the method to a team of real robots are presented.

DOI [BibTex]

Lima, P., Santos, P., Oliveira, R., Ahmad, A., Santos, J. Cooperative Localization Based on Visually Shared Objects In RoboCup 2010: Robot Soccer World Cup XIV, pages: 350-361, Lecture Notes in Computer Science ; 6556, Springer, Berlin, Germany, 2011 (inproceedings)

DOI [BibTex]

Computational flow studies in a subject-specific human upper airway using a one-equation turbulence model. Influence of the nasal cavity

Prihambodo Saksono, Perumal Nithiarasu, Igor Sazonov, Si Yong Yeo

International Journal for Numerical Methods in Biomedical Engineering, 87(1-5):96–114, 2011 (article)

Abstract

This paper focuses on the impact of including nasal cavity on airflow through a human upper respiratory tract. A computational study is carried out on a realistic geometry, reconstructed from CT scans of a subject. The geometry includes nasal cavity, pharynx, larynx, trachea and two generations of airway bifurcations below trachea. The unstructured mesh generation procedure is discussed in some length due to the complex nature of the nasal cavity structure and poor scan resolution normally available from hospitals. The fluid dynamic studies have been carried out on the geometry with and without the inclusion of the nasal cavity. The characteristic-based split scheme along with the one-equation Spalart–Allmaras turbulence model is used in its explicit form to obtain flow solutions at steady state. Results reveal that the exclusion of nasal cavity significantly influences the resulting solution. In particular, the location of recirculating flow in the trachea is dramatically different when the truncated geometry is used. In addition, we also address the differences in the solution due to imposed, equally distributed and proportionally distributed flow rates at inlets (both nares). The results show that the differences in flow pattern between the two inlet conditions are not confined to the nasal cavity and nasopharyngeal region, but they propagate down to the trachea.

Prihambodo Saksono, Perumal Nithiarasu, Igor Sazonov, Si Yong Yeo Computational flow studies in a subject-specific human upper airway using a one-equation turbulence model. Influence of the nasal cavity International Journal for Numerical Methods in Biomedical Engineering, 87(1-5):96–114, 2011 (article)

Discrete Minimum Distortion Correspondence Problems for Non-rigid Shape Matching

Wang, C., Bronstein, M. M., Bronstein, A. M., Paragios, N.

In International Conference on Scale Space and Variational Methods in Computer Vision (SSVM), 2011 (inproceedings)

Wang, C., Bronstein, M. M., Bronstein, A. M., Paragios, N. Discrete Minimum Distortion Correspondence Problems for Non-rigid Shape Matching In International Conference on Scale Space and Variational Methods in Computer Vision (SSVM), 2011 (inproceedings)

Viewpoint Invariant 3D Landmark Model Inference from Monocular 2D Images Using Higher-Order Priors

Wang, C., Zeng, Y., Simon, L., Kakadiaris, I., Samaras, D., Paragios, N.

In IEEE International Conference on Computer Vision (ICCV), 2011 (inproceedings)

Wang, C., Zeng, Y., Simon, L., Kakadiaris, I., Samaras, D., Paragios, N. Viewpoint Invariant 3D Landmark Model Inference from Monocular 2D Images Using Higher-Order Priors In IEEE International Conference on Computer Vision (ICCV), 2011 (inproceedings)

Publishers site Code Paper site PDF [BibTex]

Correspondence estimation from non-rigid motion information

Wulff, J., Lotz, T., Stehle, T., Aach, T., Chase, J. G.

In Proc. SPIE, Proc. SPIE, (Editors: B. M. Dawant, D. R. Haynor), SPIE, 2011 (inproceedings)

Abstract

The DIET (Digital Image Elasto Tomography) system is a novel approach to screen for breast cancer using only optical imaging information of the surface of a vibrating breast. 3D tracking of skin surface motion without the requirement of external markers is desirable. A novel approach to establish point correspondences using pure skin images is presented here. Instead of the intensity, motion is used as the primary feature, which can be extracted using optical flow algorithms. Taking sequences of multiple frames into account, this motion information alone is accurate and unambiguous enough to allow for a 3D reconstruction of the breast surface. Two approaches, direct and probabilistic, for this correspondence estimation are presented here, suitable for different levels of calibration information accuracy. Reconstructions show that the results obtained using these methods are comparable in accuracy to marker-based methods while considerably increasing resolution. The presented method has high potential in optical tissue deformation and motion sensing.

pdf link (url) DOI [BibTex]

Wulff, J., Lotz, T., Stehle, T., Aach, T., Chase, J. G. Correspondence estimation from non-rigid motion information In Proc. SPIE, Proc. SPIE, (Editors: B. M. Dawant, D. R. Haynor), SPIE, 2011 (inproceedings)

pdf link (url) DOI [BibTex]

Predicting Articulated Human Motion from Spatial Processes

Soren Hauberg, Kim S. Pedersen

International Journal of Computer Vision, 94, pages: 317-334, Springer Netherlands, 2011 (article)

Soren Hauberg, Kim S. Pedersen Predicting Articulated Human Motion from Spatial Processes International Journal of Computer Vision, 94, pages: 317-334, Springer Netherlands, 2011 (article)

Publishers site Code Paper site PDF [BibTex]

An Empirical Study on the Performance of Spectral Manifold Learning Techniques

Peter Mysling, Soren Hauberg, Kim S. Pedersen

In Artificial Neural Networks and Machine Learning – ICANN 2011, 6791, pages: 347-354, Lecture Notes in Computer Science, (Editors: Honkela, Timo and Duch, Włodzisław and Girolami, Mark and Kaski, Samuel), Springer Berlin Heidelberg, 2011 (inproceedings)

Publishers site PDF [BibTex]

Peter Mysling, Soren Hauberg, Kim S. Pedersen An Empirical Study on the Performance of Spectral Manifold Learning Techniques In Artificial Neural Networks and Machine Learning – ICANN 2011, 6791, pages: 347-354, Lecture Notes in Computer Science, (Editors: Honkela, Timo and Duch, Włodzisław and Girolami, Mark and Kaski, Samuel), Springer Berlin Heidelberg, 2011 (inproceedings)

Publishers site PDF [BibTex]

Separation of visual object features and grasp strategy in primate ventral premotor cortex

Vargas-Irwin, C., Franquemont, L., Black, M., Donoghue, J.

Neural Control of Movement, 21st Annual Conference, 2011 (conference)

Vargas-Irwin, C., Franquemont, L., Black, M., Donoghue, J. Separation of visual object features and grasp strategy in primate ventral premotor cortex Neural Control of Movement, 21st Annual Conference, 2011 (conference)

2005

Representing cyclic human motion using functional analysis

Ormoneit, D., Black, M. J., Hastie, T., Kjellström, H.

Image and Vision Computing, 23(14):1264-1276, December 2005 (article)

Abstract

We present a robust automatic method for modeling cyclic 3D human motion such as walking using motion-capture data. The pose of the body is represented by a time-series of joint angles which are automatically segmented into a sequence of motion cycles. The mean and the principal components of these cycles are computed using a new algorithm that enforces smooth transitions between the cycles by operating in the Fourier domain. Key to this method is its ability to automatically deal with noise and missing data. A learned walking model is then exploited for Bayesian tracking of 3D human motion.

2005

Ormoneit, D., Black, M. J., Hastie, T., Kjellström, H. Representing cyclic human motion using functional analysis Image and Vision Computing, 23(14):1264-1276, December 2005 (article)

A quantitative evaluation of video-based 3D person tracking

Balan, A. O., Sigal, L., Black, M. J.

In The Second Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, VS-PETS, pages: 349-356, October 2005 (inproceedings)

Balan, A. O., Sigal, L., Black, M. J. A quantitative evaluation of video-based 3D person tracking In The Second Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, VS-PETS, pages: 349-356, October 2005 (inproceedings)

on-line at USPTO pdf [BibTex]

Visual motion analysis method for detecting arbitrary numbers of moving objects in image sequences

Jepson, A. D., Fleet, D. J., Black, M. J.

US Pat. 6,954,544, October 2005 (patent)

Jepson, A. D., Fleet, D. J., Black, M. J. Visual motion analysis method for detecting arbitrary numbers of moving objects in image sequences US Pat. 6,954,544, October 2005 (patent)

on-line at USPTO pdf [BibTex]

Inferring attentional state and kinematics from motor cortical firing rates

Wood, F., Prabhat, , Donoghue, J. P., Black, M. J.

In Proc. IEEE Engineering in Medicine and Biology Society, pages: 1544-1547, September 2005 (inproceedings)

Wood, F., Prabhat, , Donoghue, J. P., Black, M. J. Inferring attentional state and kinematics from motor cortical firing rates In Proc. IEEE Engineering in Medicine and Biology Society, pages: 1544-1547, September 2005 (inproceedings)

Motor cortical decoding using an autoregressive moving average model

Fisher, J., Black, M. J.

In Proc. IEEE Engineering in Medicine and Biology Society, pages: 1469-1472, September 2005 (inproceedings)

Fisher, J., Black, M. J. Motor cortical decoding using an autoregressive moving average model In Proc. IEEE Engineering in Medicine and Biology Society, pages: 1469-1472, September 2005 (inproceedings)

Fields of Experts: A framework for learning image priors

Roth, S., Black, M. J.

In IEEE Conf. on Computer Vision and Pattern Recognition, 2, pages: 860-867, June 2005 (inproceedings)

Roth, S., Black, M. J. Fields of Experts: A framework for learning image priors In IEEE Conf. on Computer Vision and Pattern Recognition, 2, pages: 860-867, June 2005 (inproceedings)

On the receptive fields of Markov random fields: Predictions from a probabilistic model of scene statistics

Black, M. J., Roth, S.

COSYNE 2005, Salt Lake City, March 2005 (conference)

Black, M. J., Roth, S. On the receptive fields of Markov random fields: Predictions from a probabilistic model of scene statistics COSYNE 2005, Salt Lake City, March 2005 (conference)

Yalcin, H. C. R. B. M. J. H. M.

A Flow-Based Approach to Vehicle Detection and Background Mosaicking in Airborne Video

IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Video Proceedings,, pages: 1202, 2005 (patent)

YouTube pdf [BibTex]

Yalcin, H. C. R. B. M. J. H. M. A Flow-Based Approach to Vehicle Detection and Background Mosaicking in Airborne Video IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Video Proceedings,, pages: 1202, 2005 (patent)

YouTube pdf [BibTex]

On the spatial statistics of optical flow

(Marr Prize, Honorable Mention)

Roth, S., Black, M. J.

In International Conf. on Computer Vision, International Conf. on Computer Vision, pages: 42-49, 2005 (inproceedings)

Roth, S., Black, M. J. On the spatial statistics of optical flow In International Conf. on Computer Vision, International Conf. on Computer Vision, pages: 42-49, 2005 (inproceedings)

Modeling neural population spiking activity with Gibbs distributions

Wood, F., Roth, S., Black, M. J.

In Advances in Neural Information Processing Systems 18, pages: 1537-1544, 2005 (inproceedings)

Wood, F., Roth, S., Black, M. J. Modeling neural population spiking activity with Gibbs distributions In Advances in Neural Information Processing Systems 18, pages: 1537-1544, 2005 (inproceedings)

Energy-based models of motor cortical population activity

Wood, F., Black, M.

Program No. 689.20. 2005 Abstract Viewer/Itinerary Planner, Society for Neuroscience, Washington, DC, 2005 (conference)

Wood, F., Black, M. Energy-based models of motor cortical population activity Program No. 689.20. 2005 Abstract Viewer/Itinerary Planner, Society for Neuroscience, Washington, DC, 2005 (conference)

1999

Edges as outliers: Anisotropic smoothing using local image statistics

Black, M. J., Sapiro, G.

In Scale-Space Theories in Computer Vision, Second Int. Conf., Scale-Space ’99, pages: 259-270, LNCS 1682, Springer, Corfu, Greece, September 1999 (inproceedings)

Abstract

Edges are viewed as statistical outliers with respect to local image gradient magnitudes. Within local image regions we compute a robust statistical measure of the gradient variation and use this in an anisotropic diffusion framework to determine a spatially varying "edge-stopping" parameter σ. We show how to determine this parameter for two edge-stopping functions described in the literature (Perona-Malik and the Tukey biweight). Smoothing of the image is related the local texture and in regions of low texture, small gradient values may be treated as edges whereas in regions of high texture, large gradient magnitudes are necessary before an edge is preserved. Intuitively these results have similarities with human perceptual phenomena such as masking and "popout". Results are shown on a variety of standard images.

1999

Black, M. J., Sapiro, G. Edges as outliers: Anisotropic smoothing using local image statistics In Scale-Space Theories in Computer Vision, Second Int. Conf., Scale-Space ’99, pages: 259-270, LNCS 1682, Springer, Corfu, Greece, September 1999 (inproceedings)

Probabilistic detection and tracking of motion discontinuities

(Marr Prize, Honorable Mention)

Black, M. J., Fleet, D. J.

In Int. Conf. on Computer Vision, ICCV-99, pages: 551-558, ICCV, Corfu, Greece, September 1999 (inproceedings)

Black, M. J., Fleet, D. J. Probabilistic detection and tracking of motion discontinuities In Int. Conf. on Computer Vision, ICCV-99, pages: 551-558, ICCV, Corfu, Greece, September 1999 (inproceedings)

Artscience Sciencart

Black, M. J., Levy, D., PamelaZ,

In Art and Innovation: The Xerox PARC Artist-in-Residence Program, pages: 244-300, (Editors: Harris, C.), MIT-Press, 1999 (incollection)

Abstract

One of the effects of the PARC Artist In Residence (PAIR) program has been to expose the strong connections between scientists and artists. Both do what they do because they need to do it. They are often called upon to justify their work in order to be allowed to continue to do it. They need to justify it to funders, to sponsoring institutions, corporations, the government, the public. They publish papers, teach workshops, and write grants touting the educational or health benefits of what they do. All of these things are to some extent valid, but the fact of the matter is: artists and scientists do their work because they are driven to do it. They need to explore and create.

This chapter attempts to give a flavor of one multi-way "PAIRing" between performance artist PamelaZ and two PARC researchers, Michael Black and David Levy. The three of us paired up because we found each other interesting. We chose each other. While most artists in the program are paired with a single researcher Pamela jokingly calls herself a bigamist for choosing two PAIR "husbands" with different backgrounds and interests.

There are no "rules" to the PAIR program; no one told us what to do with our time. Despite this we all had a sense that we needed to produce something tangible during Pamela's year-long residency. In fact, Pamela kept extending her residency because she did not feel as though we had actually made anything concrete. The interesting thing was that all along we were having great conversations, some of which Pamela recorded. What we did not see at the time was that it was these conversations between artists and scientists that are at the heart of the PAIR program and that these conversations were changing the way we thought about our own work and the relationships between science and art.

To give these conversations their due, and to allow the reader into our PAIR interactions, we include two of our many conversations in this chapter.

Black, M. J., Levy, D., PamelaZ, Artscience Sciencart In Art and Innovation: The Xerox PARC Artist-in-Residence Program, pages: 244-300, (Editors: Harris, C.), MIT-Press, 1999 (incollection)

Parameterized modeling and recognition of activities

Yacoob, Y., Black, M. J.

Computer Vision and Image Understanding, 73(2):232-247, 1999 (article)

Abstract

In this paper we consider a class of human activities—atomic activities—which can be represented as a set of measurements over a finite temporal window (e.g., the motion of human body parts during a walking cycle) and which has a relatively small space of variations in performance. A new approach for modeling and recognition of atomic activities that employs principal component analysis and analytical global transformations is proposed. The modeling of sets of exemplar instances of activities that are similar in duration and involve similar body part motions is achieved by parameterizing their representation using principal component analysis. The recognition of variants of modeled activities is achieved by searching the space of admissible parameterized transformations that these activities can undergo. This formulation iteratively refines the recognition of the class to which the observed activity belongs and the transformation parameters that relate it to the model in its class. We provide several experiments on recognition of articulated and deformable human motions from image motion parameters.

Yacoob, Y., Black, M. J. Parameterized modeling and recognition of activities Computer Vision and Image Understanding, 73(2):232-247, 1999 (article)