تنظیم تطبیقی پارامتر کوانتیزاسیون در سطح فریم بر اساس ویژگی‌های سیستم بینایی انسان در کدگذار ویدئویی
مریم کلانتری
1
(
گروه برق، دانشکده مهندسی، دانشگاه فردوسی مشهد، مشهد، ایران
)
مرتضی خادمی
2
(
گروه برق، دانشکده مهندسی، دانشگاه فردوسی مشهد، مشهد، ایران
)
عباس ابراهیمی مقدم
3
(
گروه برق، دانشکده مهندسی، دانشگاه فردوسی مشهد، مشهد، ایران
)
کلید واژه: کدگذاری ویدئو, کدگذاری ادراکی, پارامتر کوانتیزاسیون (QP), آستانه تفاوت قابل‌تشخیص (JND), ساختار سلسله‌مراتبی زمانی, فشرده‌سازی ویدئو با کارایی بالا (HEVC).,
چکیده مقاله :
کدگذاری ویدئو نقش مهمی در کاهش حجم داده و بهینه‌سازی انتقال و ذخیره‌سازی محتوای چندرسانه‌ای دارد. در سال‌های اخیر، کدگذاری ادراکی با بهره‌گیری از ویژگی‌های سیستم بینایی انسان به‌عنوان رویکردی مؤثر برای کاهش نرخ بیت بدون افت قابل‌تشخیص کیفیت مطرح شده است. در این مقاله، یک روش ادراکی برای تنظیم تطبیقی پارامتر کوانتیزاسیون (ΔQP) در کدگذاری ویدئو با ساختار سلسله‌مراتبی زمانی ارائه می‌شود. روش پیشنهادی با استفاده از مدل آستانه تفاوت قابل‌تشخیص (JND)، حساسیت ادراکی هر فریم را تخمین زده و مقدار ΔQP را متناسب با ویژگی‌های محتوایی و اهمیت زمانی آن تنظیم می‌کند، به‌گونه‌ای که فریم‌های با حساسیت ادراکی کمتر فشرده‌تر شده و کیفیت بصری فریم‌های حساس‌تر حفظ می‌شود.
نتایج آزمایش‌ها بر روی توالی‌های استاندارد و با استفاده از کدگذار HEVC نشان می‌دهد که روش پیشنهادی به‌طور متوسط 5/2٪ کاهش نرخ بیت همراه با 67/1٪ کاهش زمان اجرا ایجاد می‌کند. افزون بر این، ارزیابی ذهنی مبتنی بر شاخص I-MOS بهبود میانگین 17/0 واحدی را نسبت به نسخه مرجع نشان می‌دهد و در اکثر توالی‌ها کیفیت بصری نسخه پیشنهادی بهتر یا برابر نسخه مرجع است. این نتایج نشان می‌دهد که تنظیم تطبیقی ΔQP مبتنی بر JND رویکردی کارآمد، کم‌پیچیدگی و سازگار با HEVC برای کاربردهای ویدئویی است.
چکیده انگلیسی :
Video coding plays a key role in reducing data volume and optimizing the transmission and storage of multimedia content. In recent years, perceptual video coding has emerged as an effective approach for reducing bitrate without introducing perceptible visual degradation by exploiting characteristics of the HVS. In this paper, a perceptual method for adaptive adjustment of the quantization parameter in video coding with a hierarchical temporal structure is proposed. The proposed method employs a just noticeable difference model to estimate the perceptual sensitivity of each frame and adjusts the ΔQP according to content characteristics and temporal importance, such that frames with lower perceptual sensitivity are more strongly compressed while perceptually sensitive frames preserve their visual quality.
Experimental results on standard video sequences using the HEVC encoder show that the proposed method achieves an average bitrate reduction of 2.5% together with a 1.67% reduction in encoding time. In addition, subjective evaluation based on the MOS demonstrates an average improvement of 0.17 compared to the reference encoder, with equal or better visual quality achieved in most sequences. These results indicate that the proposed JND-based adaptive ΔQP strategy is an efficient, low-complexity, and HEVC-compatible solution for practical video coding applications.
[1] Cisco, Cisco Annual Internet Report (2018–2023), White Paper, Mar. 2020. [Online]. Available: https://www.cisco.com/c/en/us/solutions/executive-perspectives/annual-internet-report/index.html
[2] G. J. Sullivan, J. Ohm, W.-J. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) standard," IEEE Trans. on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649-1668, Dec. 2012.
[3] G. Wang et al., "A survey on just noticeable distortion estimation and its applications in video coding," Journal of Visual Communication and Image Representation, vol. 98, Article ID: 104034, Feb. 2024.
[4] K. McCann, et al.,, "High Efficiency Video Coding (HEVC) Test Model 16 (HM 16) encoder description," JCT-VC R1002, 18th Meeting of JCT-VC, San DiegoCA, USA, 22-26 Feb. 2014. Available: https://mpeg.chiariglione.org
[5] Y. Xu, S. Yi, L. Lin, W. Chen, and T. Zhao, "GOP structure-independent quantization parameter cascading in video coding," IEEE Access, vol. 7, pp. 76274-76282, 2019.
[6] Y. Gong, et al., "Quantization parameter cascading for surveillance video coding considering all inter reference frames," IEEE Trans. Image Processing, vol. 30, pp. 5692-5707, 2021.
[7] X. Huang, D. Li, and H. Yin, "HEVC quantization parameter selection algorithm based on inter-frame dependency," Multimedia Tools and Applications, vol. 79, no. 19, pp. 13951-13966, 2020.
[8] H. Amer and E. H. Yang, "Adaptive quantization parameter selection for low-delay HEVC via temporal propagation length estimation," Signal Processing: Image Communication, vol. 84, Article ID: 115826, May 2020.
[9] L. Jia, K. Jia, and X. Fan, "Adaptive Lagrangian multiplier for quantization parameter cascading in HEVC hierarchical coding," IEEE Signal Processing Letters, vol. 27, pp. 1220=1224, 2020.
[10] I. Marzuki and D. Sim, "Perceptual adaptive quantization parameter selection using deep convolutional features for HEVC encoder," IEEE Access, vol. 8, pp. 37052-37065, 2020.
[11] Y. Wu, et al., "Perceptual VVC quantization refinement with ensemble learning," Displays, vol. 70, Article ID: 102103, 2021.
[12] H. Wang et al., "Surprise-based JND estimation for perceptual quantization in H.265/HEVC codecs," Signal Processing: Image Communication, vol. 118, Article ID: 117019, Oct. 2023.
[13] H. Wang et al., "Learning-based JNCD prediction for quality-wise perceptual quantization in HEVC," Journal of Visual Communication and Image Representation, vol. 95, Article ID: 103877, Sept. 2023.
[14] A. J. Ruiz, G. O. López, M. M. Pérez, and M. O. Martínez-Rach, "Perceptual QP optimization for VVC with dual hybrid neural networks," The Journal of Supercomputing, vol. 81, no. 3, Article ID: 464, 2025.
[15] W. Lim and D. Sim, "A perceptual rate control algorithm based on luminance adaptation for HEVC encoders," Signal Image Video Processing, vol. 14, no. 5, pp. 887-895, 2020.
[16] M. Zhou, X. Wei, S. Kwong, W. Jia, and B. Fang, "Just noticeable distortion-based perceptual rate control in HEVC," IEEE Trans. Image Processing, vol. 29, pp. 7603-7614, 2020.
[17] K. C. Liu, "Color video JND model using compound spatial masking and structure-based temporal masking," IEEE Access, vol. 8, pp. 136760-136768, 2020.
[18] H. Jo, S. Lee, Y. Ahn, Y. Kim, and D. Sim, "Perceptual intra-frame coding for HEVC still picture profile based on invisible signal suppression," Signal Image Video Processing, vol. 14, pp. 1053-1061, 2020.
[19] J. Guo, "An HEVC-compliant perceptual video coding using just noticeable difference," Multimedia Tools and Applications, vol. 81, pp. 1257-1286, 2022.
[20] S. Nami, F. Pakdaman, and M. R. Hashemi, "Juniper: A JND-based perceptual video coding framework to jointly utilize saliency and JND," in Proc. IEEE Int. Conf. Multimedia Expo Workshops, 6 pp., Londom, UK, 6-10 Jul. 2020.
[21] S. Ki, J. Do, and M. Kim, "Learning-based JND-directed HDR video preprocessing for perceptually lossless compression with HEVC," IEEE Access, vol. 8, pp. 228605-228618, 2020.
[22] J. Kim, D. Y. Lee, S. Jeong, and S. Cho, "Perceptual video coding using deep neural network based JND model," in Proc. Data Compression Conf., pp. 375-375, Snowbird, UT, USA, 24-27 Mar. 2020.
[23] D. Fu, Y. Wang, B. Fan, and N. Ding, "HEVC/H.265 intra coding based on the human visual system," IEEE Access, vol. 7, pp. 186587-186599, 2019.
[24] H. Wang, et al., "JND-based multi-module cooperative perceptual optimization for HEVC," Displays, vol. 84, Article ID: 102783, Sept. 2024.
[25] Y. Zhang, et al., "SJ-PVC: An efficient perceptual video compression scheme based on adaptive QP and rate-distortion optimization," IEEE Trans. Consumer Electronics, col. 71, no. 1, pp. 706-719, Feb. 2025.
[26] ITU-T, Common Test Conditions for HEVC, JCT-VC Document, 2016.
[27] Z. Y. Wei and K. N. Ngan, "Spatio-temporal just noticeable distortion profile for gray-scale image/video in DCT domain," on Circuits and Systems for Video Technology, vol. 19, no. 3, pp. 337-346, Mar. 2009.
[28] G. Bjøntegaard, Calculation of Average PSNR Differences between RD-Curves, VCEG-M33, Apr. 2001.
[29] Z. Wang, et al., "Multiscale structural similarity for image quality assessment," in Proc. The Thrity-Seventh Asilomar Conf. on Signals, Systems & Computers, pp. 1398-1402.Pacific Grove, CA, USAm 9-12 Nov. 2003.
[30] ITU-T, Subjective Video Quality Assessment Methods for Multimedia Applications, ITU-T Rec. P.910, 2008, rev. 2021.