Entropy coder for audio signals


  • Grzegorz Ulacha Department of Computer Science, West Pomeranian University of Technology
  • Ryszard Stasiński Faculty of Electronics and Communications, Poznan University of Technology


In the paper an effective entropy coder designed for coding of prediction errors of audio signals is presented. The coder is implemented inside a greater structure which signal modeling part is a lossless coding backward adaptation algorithm consisting of cascaded OLS and NLMS sections is presented. The technique performance is compared to that of 4 other lossless codecs, including MPEG-4 ALS one, and it is shown that indeed, the new method is the best one. The entropy coder is an advanced context adaptive Golomb one followed by two context adaptive arithmetic coders.


H. Huang, P. Fränti, D. Huang, S. Rahardja, "Cascaded RLS-LMS prediction in MPEG-4 lossless audio coding," IEEE Trans. on Audio, Speech and Language Processing, vol. 16, no. 3, 2008, pp. 554-562.

"Ghido's Data Compression Page." Internet: http://www.losslessaudio.org/, Feb 12, 2011.

"Monkey's Audio." Internet: http://www.monkeysaudio.com/, Jan. 20, 2013.

C. D. Giurcaneau, I. Tabus, J. Astola, "Adaptive context based sequential prediction for lossless audio compression," Proc. of IX European Signal Processing Conference EUSIPCO 1998, vol. 4, 1998, pp. 2349-2352.

T. Robinson, "SHORTEN: Simple lossless and near-lossless waveform compression," Cambridge Univ. Eng. Dept., Cambridge, UK, Tech. Rep. 156, 1994, pp. 1-17.

E. Ravelli, P. Gournay, R. Lefebvre, "A Two-Stage MLP+NLMS Lossless coder for stereo audio," Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’06), vol. 5, 2006, pp. V_177-180.

R. Yu, S. Rahardja, C. C. Ko, H. Huang, "Improving coding efficiency for MPEG-4 Audio Scalable Lossless coding," Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’05), vol. 3, 2005, pp. III_169-172.

Lin Xiao, Li Gang, Li Zhengguo, Chia Thien King, Yoh Ai Ling, "A novel prediction scheme for lossless compression of audio waveform," Int. Conf. on Multimedia and Expo (ICME 2001), 2001, pp. 197-201.

T. Moriya, D. Yang, and T. Liebchen, "Extended Linear Prediction Tools for Lossless Audio Coding," Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’04), vol. 3, 2004, pp. III_1008-1011.

T. Liebchen , Y. A. Reznik, Improved Forward-Adaptive Prediction for MPEG-4 Audio Lossless Coding, in 118th AES Convention, 28-31 May 2005, Barcelona, Spain, pp. 1-10.


K. Sayood, “Introduction to Data Compression,” 2nd edition, Morgan Kaufmann Publ., 2002.

S. W. Golomb, Run-length encoding, IEEE Transactions on Information Theory, July 1966, vol. 12, pp. 399-401.

R. F. Rice, Some practical universal noiseless coding techniques, Jet Propulsion Labolatory, JPL Publication 79-22, Pasadena, CA, March 1979.

Y.A. Reznik, Coding of prediction residual in MPEG-4 standard for lossless audio cod-ing (MPEG-4 ALS), Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’04), Montreal, Quebec, Canada, 17-21 May 2004, vol. 3, pp. III_1024-1027.

G. Ulacha, R. Stasiński, "Novel Ideas for Lossless Audio Coding", Journal of Electronics and Telecommunications, 2013, vol. 59, no. 1, pp. 17-23.

G. Ulacha, R. Stasiński, Performance Optimized Predictor Blending Technique For Loss-less Image Coding, Proc. of The 36th International Conference on Acoustics, Speech and Signal Processing ICASSP’11, 22-27 maja 2011, Prague, Czech Republic, pp. 1541-1544.

H. Ye, G. Deng, J. C. Devlin, Adaptive linear prediction for lossless coding of greyscale images, in Proc. IEEE Int. Conf. on Image Processing (CDROM), Vancouver, Canada, September 2000.

G. Ulacha, R. Stasiński, Context based lossless coder based on RLS predictor adaptation scheme, Proc. of Int. Conf. on Image Processing ICIP 2009, 7-11 November, Egypt, Cairo 2009, pp. 1917-1920.

H. Huang, S. Rahardja, X. Lin, R. Yu, P. Fränti, "Cascaded RLS-LMS prediction in MPEG-4 lossless audio coding," Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP 2006), 2006, pp. V-181-184.

Makino S., Kaneda Y., Koizumi N., Exponentially weighted stepsize NLMS adaptive filter based on the statistics of a room impulse response, IEEE Transactions on Speech and Audio Processing, Vol. 1 , No. 1, 1993, pp. 101-108.

D. Salomon, Data compression. The complete reference, 3rd ed., New York, Springer-Verlag 2004.

X. Wu, N. D. Memon, CALIC – A Context Based Adaptive Lossless Image Coding Scheme, IEEE Trans. on Communications, May 1996, vol. 45, pp. 437-444.

G. Deng, H. Ye, Lossless image compression using adaptive predictor combination, symbol mapping and context filtering, Proceedings of IEEE 1999 International Confe-rence on Image Processing, Kobe, Japan, Oct. 1999, vol. 4, pp. 63-67.

I. Matsuda, N. Ozaki, Y. Umezu, S. Itoh, Lossless coding using Variable Blok-Size adap-tive prediction optimized for each image, Proceedings of 13th European Signal Processing Conference EUSIPCO-05 CD, September 2005.

G. Ulacha, R. Stasiński, Lossless OLS-NLMS Algorithm for Audio Coding, ICSES 2014, Proc. on USB, September 2014.






Image Processing