CompressionGroup/MVCProject

Multi-view Video Coding

Multiview video systems are used for capturing a scene from different viewpoints, so that 3-D information of a scene is contained in the resulting set of sequences. Such videos are emerging as a potential tool for new multimedia services, e.g., 3-D TV and free viewpoint video. Because a multiview video contains several video sequences from different cameras, widespread use of multiview video requires the design of efficient compression techniques.

A straightforward approach for multiview video encoding would be to use standard video coding techniques independently on the video sequences corresponding to each camera. To further improve coding efficiency, inter-view coding (IVC) can be applied, where block-based predictive techniques can be used that is similar to the motion compensated predictive coding techniques used in MPEG-2, H.264/AVC, etc. Please refer to MVC diagram .

• People
  • Antonio Ortega
  • Jae Hoon Kim
  • PoLin Lai

  
  

• Publication
  • PoLin Lai, Antonio Ortega, Purvin Pandit, Peng Yin, and Cristina Gomila, "Focus Mismatches in Multiview Systems and Efficient Adaptive Reference Filtering for Multiview Video Coding," in Proc. Visual Communications and Image Processing (VCIP), San Jose, CA, Jan. 2008
    PDF format
  • J. H. Kim, P. Lai, J. Lopez, A. Ortega, Y. Su, P. Yin, and C. Gomila, "New Coding Tools for Cross-view Prediction in Multi-view Video Coding," in IEEE Trans. Circuits and Systems for Video Technology (Special Issue on Multiview Video Coding) 17, no. 11, pp. 1519–1535, Nov 2007
    
  • PoLin Lai, Antonio Ortega, Purvin Pandit, Peng Yin, and Cristina Gomila, "Focus Mismatches in Multiview Systems and Efficient Adaptive Reference Filtering for Multiview Video Coding," in Proc. Visual Communications and Image Processing (VCIP), San Jose, CA, Jan. 2008.
    PDF format
  • PoLin Lai and Antonio Ortega, "Predictive Fast Motion/Disparity Search for Multiview Video Coding," in Proc. Visual Communications and Image Processing (VCIP) 2006, San Jose, CA, Jan. 2006.
    PDF format
  • Jae Hoon Kim, Jonathan Garcia, and Antonio Ortega, "Dependent Bit Allocation in Multiview Video Coding," in Proc. of IEEE International Conference on Image Processing (ICIP), Genoa, Italy, Sep. 2005.
    PDF format
  • Joaquin Lopez, Jae Hoon Kim, Antonio Ortega, and George Chen, "Block-based Illumination Compensation and Search Techniques for Multiview Video Coding," Picture Coding Symposium, San Francisco, CA, Dec. 2004.
    PDF format

  
  

• MPEG Contributions
  • J. H. Kim, P. Lai, A. Ortega, Y. Su, P. Yin, and C. Gomila, "Results of CE2 on multi-view video coding," ISO/IEC JTC1/SC29/WG11 MPEG Document M13720, Jul. 2006.
    
  • J. H. Kim, P. Lai, A. Ortega, Y. Su, P. Yin, C. Gomila, and P. Pandit, "Results of CE2 on multi-view video coding," ISO/IEC JTC1/SC29/WG11 MPEG Document M13317, Apr. 2006.
    
  • PoLin Lai, Jae-Hoon Kim, Antonio Ortega (USC), Yeping Su, Pandit Purvin, Cristina Gomila (Thomson Inc.), "New rate-distortion metrics for MVC considering cross-view dependency," ISO/IEC JTC1/SC29/WG11 MPEG Document M13318, Montreux, SWITZERLAND , Apr. 2006.
    
  • Y. Su, P. Yin, C. Gomila, J. Kim, P. Lai, and A. Ortega, "Thomson's response to MVC CfP," ISO/IEC JTC1/SC29/WG11 MPEG Document M12969/2, Jan. 2006.
    
  • Illumination compensation is adopted as a new coding tool in JMVM (Joint Multi-view Video Model)
    - A. Vetro, Y. Su, H. Kimata, and A. Smolic, “Joint multiview video model (JMVM) 2.0,� ISO/IEC JTC1/SC29/WG11 MPEG Document N8459, Oct. 2006.
    

  
  

  
  

• Link
  • H.264/AVC reference software