Methodology for 3D Video Subjective Quality Evaluation

Filip Lewandowski, Mateusz Paluszkiewicz, Tomasz Grajek, Krzysztof Wegner


The paper presents the methodology for 3D video subjective quality evaluation. Described methodology was designedto compare different 3D video compression technologies without an influence of any particular displaying or rendering technology. In addition detailed step by step description of test session design and preparation is provided. Experimental results for state-of-the-art 3D encoders are also included. All tests were conducted on two 3D monitors (polarization and autostereoscopic) thus influence of different displaying technologies on 3D video quality assessments has also been evaluated.

Full Text:



C. Fehn, “Depth-image-based rendering (DIBR), Compression and Transmission for a New Approach on 3D-TV,” Proceedings of SPIE,vol. 5291, pp. 93–104, January 2004, CA, U.S.A.

J. W. Shade, S. J. Gortler, L.-W. He, and R. Szeliski, “Layered depth images,” Computer Graphics, vol. 32, pp. 231–242, July 1998, Annual Conference Series.

ITU-R Rec. BT.500-11, “Methodology for the Subjective Assessment of the Quality of Television Pictures,” 2002.

Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncell, “Image quality assessment: From error visibility to structural similarity,” IEEE

Transactions on Image Processing, vol. 13, pp. 600–612, April 2004.

D.-F. Shen and L.-S. Yan, “JND Measurements and Wavelet-based Image Coding,” Proceedings of SPIE on Input/Output and Imaging Technologies, vol. 3422-19, July 1998.

M. Doma´nski, T. Grajek, K. Klimaszewski, M. Kurc, O. Stankiewicz, J. Stankowski, and K. Wegner, “Pozna´n Multiview Video Test Sequences and Camera Parameters, ISO/IEC JTC1/SC29/WG11 MPEG 2009/M17050,” October 2009, Xian, China.

J. Zhang, R. Li, H. Li, D. Rusanovskyy, and M. M. Hannuksela, “Ghost Town Fly 3DV Sequence for Purposes of 3DV Standardization,

ISO/IEC JTC1/SC29/WG11 MPEG 2011/M20027,” March 2011, Geneve, Switzerland.

P. Aflaki, D. Rusanovskyy, and M. M. Hannuksela, “Undo Dancer 3DV Sequence for Purposes of 3DV Standardization, MPEG 2011/M20028,” March 2011, Geneve, Switzerland.

“Call for Proposals on 3D Video Coding Technology, ISO/IEC JTC1/SC29/WG11 MPEG2011/N12036,” March 2011, Geneve, Switzerland.

ITU-T and ISO/IEC JTC 1, “Advanced Video Coding for Generic Audiovisual Services,” 2011, ITU-T Rec. H.264 and ISO/IEC 14496-


M. Domański, T. Grajek, D. Karwowski, K. Klimaszewski, J. Konieczny, M. Kurc, A. Łuczak, R. Ratajczak, J. Siast, O. Stankiewicz,

J. Stankowski, and K. Wegner, “New Coding Technology for 3D Video With Depth Maps as Proposed for Standardization Within Mpeg,” in

th International Conference on Systems, Signals and Image Processing (IWSSIP), Vienna, Austria, 11–13 April 2012.

G. Tech, K. Wegner, Y. Chen, and S. Yea, “3D-HEVC Test Model Description draft 1,” in Joint Collaborative Team on 3D Video Coding Extension Development of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC

/WG 11 Doc. JTC2-A1005, 1st Meeting, Stockholm, Sweden, 16–20 July 2012.

M. Doma´nski, J. Konieczny, M. Kurc, R. Ratajczak, J. Siast, O. Stankiewicz, J. Stankowski, and K. Wegner, “3D Video Compression

by Coding of Disoccluded Regions,” in IEEE The International Conference on Image Processing (ICIP), Orlando, USA, 2012.

C. A. Floudas and P. M. Pardalos (eds.), Encyclopedia of Optimization. Kluwer, 2001, vol. 4, ch. Outranking Methods, pp. 249–255.


  • There are currently no refbacks.

International Journal of Electronics and Telecommunications
is a periodical of Electronics and Telecommunications Committee
of Polish Academy of Sciences

eISSN: 2300-1933