International Journal of Advanced Networking and Applications

Open Access Open Access  Restricted Access Subscription Access

Machine learning in Dynamic Adaptive Streaming over HTTP (DASH)


Affiliations
1 Department of Computing and Information Technology, The University of the West Indies, Trinidad and Tobago, W.I, India
2 Department of Computing and Information Technology The University of the West Indies, Trinidad and Tobago, W.I, India
 

Recently machine learning has been introduced into the area of adaptive video streaming. This paper explores a novel taxonomy that includes six state of the art techniques of machine learning that have been applied to Dynamic Adaptive Streaming over HTTP (DASH): (1) Q-learning, (2) Reinforcement learning, (3) Regression, (4) Classification, (5) Decision Tree learning, and (6) Neural networks.

Keywords

Machine Learning, DASH, Q-Learning, Reinforcement Learning, Regression, Classification, Decision Tree Learning, Neural Networks.
User
Notifications
Font Size

  • Casas, Pedro, Alessandro D'Alconzo, Florian Wamser, Michael Seufert, Bruno Gardlo, Anika Schwind, Phuoc Tran-Gia, and Raimund Schatz. "Predicting QoE in cellular networks using machine learning and in-smartphone measurements." In Quality of Multimedia Experience (QoMEX), 2017 Ninth International Conference on, pp. 1-6. IEEE, 2017.

  • Cheng, Bo, Jialin Yang, Shangguang Wang, and Junliang Chen. "Adaptive video transmission control system based on reinforcement learning approach over heterogeneous networks." IEEE Transactions on Automation Science and Engineering 12, no. 3 (2015): 1104-1113.

  • Chien, Yu-Lin, Kate Ching-Ju Lin, and Ming-Syan Chen. "Machine learning based rate adaptation with elastic feature selection for HTTP-based streaming." In Multimedia and Expo (ICME), 2015 IEEE International Conference on, pp. 1-6. IEEE, 2015.

  • Claeys, Maxim, Steven Latré, Jeroen Famaey, Tingyao Wu, Werner Van Leekwijck, and Filip De Turck. "Design of a Q-learning-based client quality selection algorithm for HTTP adaptive video streaming." In Adaptive and Learning Agents Workshop, part of AAMAS2013 (ALA-2013), pp. 30-37. 2013.

  • Claeys, Maxim, Steven Latré, Jeroen Famaey, Tingyao Wu, Werner Van Leekwijck, and Filip De Turck. "Design and optimisation of a (FA) Qlearningbased HTTP adaptive streaming client." Connection Science 26, no. 1 (2014): 25-43.

  • Cochocki, A., and Rolf Unbehauen. Neural networks for optimization and signal processing. John Wiley & Sons, Inc., 1993.

  • Demirbilek, Edip, and Jean-Charles Grégoire. "Machine Learning--Based Parametric Audiovisual Quality Prediction Models for Real-Time Communications." ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 13, no. 2 (2017): 16.

  • Demuth, Howard B., Mark H. Beale, Orlando De Jess, and Martin T. Hagan. Neural network design. Martin Hagan, 2014.

  • Fliegel, Karel. "QUALINET Multimedia Databases v4. 6." (2013).

  • Gadaleta, Matteo, Federico Chiariotti, Michele Rossi, and Andrea Zanella. "D-DASH: a Deep Q-learning Framework for DASH Video Streaming." IEEE Transactions on Cognitive Communications and Networking (2017).

  • Kirkpatrick, Keith. "Software-defined networking." Communications of the ACM 56, no. 9 (2013): 16-19.

  • Kotsiantis, Sotiris B., Ioannis D. Zaharakis, and Panayiotis E. Pintelas. "Machine learning: a review of classification and combining techniques." Artificial Intelligence Review 26, no. 3 (2006): 159-190.

  • Kreutz, Diego, Fernando MV Ramos, Paulo Esteves Verissimo, Christian Esteve Rothenberg, Siamak Azodolmolky, and Steve Uhlig. "Software-defined networking: A comprehensive survey." Proceedings of the IEEE 103, no. 1 (2015): 14-76.

  • Kutner, Michael H., Chris Nachtsheim, and John Neter. Applied linear regression models. McGrawHill/Irwin, 2004.

  • Lin, Yu-Ting, Eduardo Mucelli Rezende Oliveira, Sana Ben Jemaa, and Salah Eddine Elayoubi. "Machine learning for predicting QoE of video streaming in mobile networks." In Communications (ICC), 2017 IEEE International Conference on, pp. 1-6. IEEE, 2017.

  • Mao, Hongzi. "Neural adaptive video streaming with pensieve." PhD diss., Massachusetts Institute of Technology, 2017.

  • Martín, Virginia, Julián Cabrera, and Narciso García. "Evaluation of q-learning approach for HTTP adaptive streaming." In Consumer Electronics (ICCE), 2016 IEEE International Conference on, pp. 293-294. IEEE, 2016.

  • Michie, Donald, David J. Spiegelhalter, and Charles C. Taylor. "Machine learning, neural and statistical classification." (1994).

  • Oide, Makoto, Akiko Takahashi, Toru Abe, and Takuo Suganuma. "Design and implementation of user-oriented video streaming service based on machine learning." In Cognitive Informatics & Cognitive Computing (ICCI* CC), 2016 IEEE 15th International Conference on, pp. 111-116. IEEE, 2016.

  • Orsolic, Irena, Dario Pevec, Mirko Suznjevic, and Lea Skorin-Kapov. "A machine learning approach to classifying YouTube QoE based on encrypted network traffic." Multimedia Tools and Applications (2017): 1-35.

  • Oyman, Ozgur, and Sarabjot Singh. "Quality of experience for HTTP adaptive streaming services."

  • IEEE Communications Magazine 50, no. 4 (2012).

  • Petrangeli, Stefano, Maxim Claeys, Steven Latré, Jeroen Famaey, and Filip De Turck. "A multi-agent Q-Learning-based framework for achieving fairness in HTTP Adaptive Streaming." In Network Operations and Management Symposium (NOMS), 2014 IEEE, pp. 1-9. IEEE, 2014.

  • Petrangeli, Stefano, Tingyao Wu, Tim Wauters, Rafael Huysegems, Tom Bostoen, and Filip De Turck.

  • "A machine learning-based framework for preventing video freezes in HTTP adaptive streaming." Journal of Network and Computer Applications 94 (2017): 78-92.

  • Russell, Stuart J., and Andrew Zimdars. "Qdecomposition for reinforcement learning agents." In Proceedings of the 20th International Conference on Machine Learning (ICML-03), pp. 656-663. 2003.

  • Shahid, Muhammad, Joanna Panasiuk, Glenn Van Wallendael, Marcus Barkowsky, and Benny Lövström. "Predicting full-reference video quality measures using HEVC bitstream-based no-reference features." In Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on, pp. 1-2. IEEE, 2015.

  • Shanableh, Tamer. "A regression-based framework for estimating the objective quality of HEVC coding units and video frames." Signal Processing: Image Communication 34 (2015): 22-31.

  • Søgaard, Jacob, Søren Forchhammer, and Kjell Brunnström. "Quality assessment of adaptive bitrate videos using image metrics and machine learning." In Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on, pp. 1-2. IEEE, 2015.

  • Streijl, Robert C., Stefan Winkler, and David S. Hands. "Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives." Multimedia Systems 22, no. 2 (2016): 213-227.

  • Suthaharan, Shan. "Decision tree learning." In Machine Learning Models and Algorithms for Big Data Classification, pp. 237-269. Springer US, 2016.

  • Sutton, Richard S., and Andrew G. Barto. Reinforcement learning: An introduction. Vol. 1, no.

  • Cambridge: MIT press, 1998.

  • Uzakgider, Tuba, Cihat Cetinkaya, and Muge Sayit. "Learning-based approach for layered adaptive video streaming over SDN." Computer Networks 92 (2015): 357-368.

  • van der Hooft, Jeroen, Stefano Petrangeli, Maxim Claeys, Jeroen Famaey, and Filip De Turck. "A learning-based algorithm for improved bandwidthawareness of adaptive streaming clients." In Integrated Network Management (IM), 2015 IFIP/IEEE International Symposium on, pp. 131-138. IEEE, 2015.

  • Vega, M. Torres, and A. Liotta. "LIMP-video quality database." (2016).

  • Vega, Maria Torres, Decebal Constantin Mocanu, Jeroen Famaey, Stavros Stavrou, and Antonio Liotta.

  • "Deep Learning for Quality Assessment in Live Video Streaming." IEEE Signal Processing Letters 24, no. 6 (2017): 736-740.

  • Vidal, José M. "Learning in multiagent systems: An introduction from a game-theoretic perspective." In Adaptive agents and multi-agent systems, pp. 202-215. Springer, Berlin, Heidelberg, 2003.

  • Viswanathan, Mahesh, and Madhubalan Viswanathan. "Measuring speech quality for text-to-speech systems: development and assessment of a modified mean opinion score (MOS) scale." Computer Speech & Language 19, no. 1 (2005): 55-83.

  • Wang, Zhiheng, Sujata Banerjee, and Sugih Jamin. "Studying streaming video quality: from an application point of view." In Proceedings of the eleventh ACM international conference on Multimedia, pp. 327-330. ACM, 2003.

  • Wang, Zhou, Ligang Lu, and Alan C. Bovik. "Video quality assessment based on structural distortion measurement.” Signal processing: Image communication 19, no.2(2004):121-132.

  • Watkins, Christopher JCH, and Peter Dayan. "Qlearning." Machine learning 8, no. 3-4 (1992): 279292.

  • Winkler, Stefan. “Analysis of public image and video database for quality assessment.” IEEE Journal of selected topics in Signal Processing 6, no. 6 (2012): 616-625

  • Wu, Tingyao, and Wemer Van Leekwijck. “Factor selection for reinforcement learning in http adaptive streaming.” In International Conference on Multimedia Modeling, pp.553-567. Springer, Cham, 2014.

  • Xue, Yuanyi, Beril Erkin, and Yao Wang. "A novel no-reference video quality metric for evaluating temporal jerkiness due to frame freezing." IEEE Transactions on Multimedia 17, no.1 (2015):134-139.

  • Zambelli, Alex. "IIS smooth streaming technical overview." Microsoft Corporation 3 (2009):40.

  • Zhang, Yue, and Yao Liu. "Buffer-Based Reinforcement Learning for Adaptive Streaming." In Distributed Computing Systems(ICDCS), 2017 IEEE 37th International Conference on, pp.2569-2570. IEEE, 2017.


Abstract Views: 289

PDF Views: 0




  • Machine learning in Dynamic Adaptive Streaming over HTTP (DASH)

Abstract Views: 289  |  PDF Views: 0

Authors

Koffka Khan
Department of Computing and Information Technology, The University of the West Indies, Trinidad and Tobago, W.I, India
Wayne Goodridge
Department of Computing and Information Technology The University of the West Indies, Trinidad and Tobago, W.I, India

Abstract


Recently machine learning has been introduced into the area of adaptive video streaming. This paper explores a novel taxonomy that includes six state of the art techniques of machine learning that have been applied to Dynamic Adaptive Streaming over HTTP (DASH): (1) Q-learning, (2) Reinforcement learning, (3) Regression, (4) Classification, (5) Decision Tree learning, and (6) Neural networks.

Keywords


Machine Learning, DASH, Q-Learning, Reinforcement Learning, Regression, Classification, Decision Tree Learning, Neural Networks.

References