Quality Evaluation of Mobile Networks Using VoIP Applications: A Case Study with Skype and LINE based-on Stationary Tests in Bangkok

Quality Evaluation of Mobile Networks Using VoIP Applications: A Case Study with Skype and LINE based-on Stationary Tests in Bangkok

Автор: Pongpisit Wuttidittachotti, Therdpong Daengsi

Журнал: International Journal of Computer Network and Information Security(IJCNIS) @ijcnis

Статья в выпуске: 12 vol.7, 2015 года.

Бесплатный доступ

This paper presents the performance evaluation of 3G mobile networks for one kind of multimedia application called Voice over IP (VoIP) within Bangkok, the capital city of Thailand, using Line and Skype, two popular VoIP applications. This study used evaluation of voice quality provided by both applications. The tests have been conducted using stationary scenarios over 5 major 3G mobile networks, served by 5 operators, within 14 universities in the inner city of Bangkok in order to gather data of degraded speech files. Then, the data was measured using Perceptual Evaluation of Speech Quality (PESQ) to find Mean Opinion Score (MOS) before analyzing with ANOVA and T-test, which are statistical tools, so that the discussion and conclusion can be eventually derived.

Еще

Mean Opinion Score, Voice over IP, 3G mobile networks, Perceptual Evaluation of Speech Quality, Skype, LINE

Короткий адрес: https://sciup.org/15011480

IDR: 15011480

Список литературы Quality Evaluation of Mobile Networks Using VoIP Applications: A Case Study with Skype and LINE based-on Stationary Tests in Bangkok

  • A. Zieliński and K. Zielińsk, "Mobile Telecommunication Systems Changed the Electronic Communications and ICT Market", J. Telecommun. Inf. Technol., vol. 2013, no. 2, pp. 5-13, 2013.
  • P. Sereewiwatthana, A. Nittayagasetwat and K. Panyagometh, "3G and Economic Impact: A Case of Thailand", NIDA Bus. Admin. J., vol. 9, pp. 5-21, 2011 (ไพบูลย์ เสรีวิวัฒนา, เอกชัย นิตยาเกษตรวัฒน์ และ กำพล ปัญญาโกเมศม, "3G และผลกระทบต่อเศรษฐกิจไทย", วารสารบริหารธุรกิจ นิด้า., เล่มที่ 9, หน้า 5-21, 2011).
  • S. Malisuwan, T. Orada, M. Navneet, S. Jesada, and K. Wassana, "Analysis of Mobile Spectrum Management in Thailand to Move Towards a Knowledge Based Economy: A Regulatory Review", J. Adv. Manage. Sci., vol 1, no. 3, pp. 288-298, 2013. DOI: 10.12720/joams.1.3.288-298.
  • NBTC, "Report of Telecoms Market Status", Q3/2014 (รายงานสภาพตลาดโทรคมนาคม ไตรมาสที่ 3 ปี 2557).
  • http://www.techinasia.com/line-releases-regional-breakdowns-for-its-490m-registered-users/.
  • P. Wuttidittachotti and T. Daengsi, "QoE of social network applications: A study of VoIP quality from Skype vs LINE over 3G and 4G", Proc. 7th ICUFN 2015, Sapporo, Japan, pp. 462-464, Jul. 2015. DOI: 10.1109/ICUFN.2015.7182586.
  • P. Wuttidittachotti, W. Akapan, and T. Daengsi, "Comparison of VoIP-QoE from Skype, LINE, Tango and Viber over 3G networks in Thailand", Proc. 7th ICUFN 2015, Sapporo, Japan, pp. 456-461, Jul. 2015. DOI: 10.1109/ICUFN.2015.7182585.
  • http://truemoveh.truecorp.co.th/change/network_en.php (Accessed Sep. 14, 2015).
  • S.M. Chadchan and C.B. Akki, "A Fair Downlink Scheduling Algorithm for 3GPP LTE Networks",Int. J. Comput. Network. Inf. Secur., vol.5, no.6, pp.34-41,2013. DOI: 10.5815/ijcnis.2013.06.05.
  • http://www.oopsmobile.net/wp-content/uploads/2013/09/Evolution-of-the-G.jpg.
  • S. Kasera, and N. Narang, 3G Networks, Tata McGraw-Hill Education, 2004.
  • A.O. Samuel, "Evaluation of Video Quality of Service in 3G/UMTS Wireless Networks as Succor for B3G/4G Wireless Network", Master Thesis in Electrical Engineering, Bleking Institute of Technology, 2010.
  • J.L. Burbank, J. Andrusenko, J.S. Everett, W.T.M. Kasch, Wireless Networking: Understanding Internetworking Challenges, John Wiley and Sons, Inc., 2013.
  • M.Z. Shafiq, J. Lusheng, A.X. Liu, and J. Pang, "Characterizing Geospatial Dynamics of Application Usage in a 3G Cellular Data Network", Proc. IEEE INFOCOM, Orlando, FL, pp. 1341-1349, Mar. 2012. DOI: 10.1109/INFCOM.2012.6195497.
  • L. Boker, Z. Kanizsai and G. Jeney, "IMS-centric Evaluation of IPv4/IPv6 Transition Methods in 3G UMTS Systems", Int. J. Adv. Networks. Serv., vol. 3, pp. 402-416, 2010.
  • Y.-B. Lin et al., "Performance measurements of TD-LTE, WiMax and 3G systems", IEEE Wirel Commun., vol. 20, pp. 153-160. 2013. DOI: 10.1109/MWC.2013.6549295.
  • 4G Americas, "The Evolution of HSPA: The 3GPP standards progress for fast mobile broadband using HSPA+," White Paper, Oct. 2011.
  • J. Prokkola, P.H.J. Perala, M. Hanski and E. Piri, "3G/HSPA Performance in Live Networks from the End User Perspective", Proc. IEEE ICC 2009, Dresden, Germany, pp. 1-6, Jun. 2009. DOI: 10.1109/ICC.2009.5198575.
  • I.F. Akyildiz , D. M. Gutierrez-Estevez , E.C. Reyes, "The evolution to 4G cellular systems: LTE-Advanced," Phys. Commun., vol. 3, no. 4, p.217-244, Dec. 2010. DOI: 10.1016/j.phycom.2010.08.001.
  • Qualcomm, "HSPA+ Evolution: Building upon the solid foundation" Aug. 2014.
  • http://investor.ais.co.th/FileUpload/Editor/DocumentUpload/WebContent/56-1/56-1%202013.pdf (Accessed Sep. 14, 2015).
  • http://www.dtac.co.th/postpaid/products/addon-internet.html (Accessed Sep. 14, 2015).
  • http://truemoveh.truecorp.co.th/why/entry/51 (Accessed Sep. 14, 2015).
  • http://www.mybycat.com/about.php?id=31 (Accessed Sep. 14, 2015).
  • B. Trammell, E. Boschi, G. Procissi, C. Callegari, P. Dorfinger, and D. Schatzmann, "Identifying Skype traffic in a large-scale flow data repository", Proc. 3rd COST TMA International Workshop on Traffic Monitoring and Analysis (TMA 2011), Vienna, Austria, Apr 2011. DOI: 10.1007/978-3-642-20305-3_7.
  • M. Korczynski, and A. Duda," Classifying Service Flows in the Encrypted Skype Traffic," Proc. IEEE ICC 2012, Ottawa, Canada, pp. 11064-1068, Jun. 2012. DOI: 10.1109/ICC.2012.6364024.
  • http://it-nigeria.com/wp-content/uploads/2014/05/Skype-statistics-2013.png (Accessed Sep. 14, 2015).
  • http://blogs.skype.com/2013/08/28/skype-celebrates-a-decade-of-meaningful-conversations/ (Accessed Sep. 14, 2015).
  • S.-W. Hsieh and M.-P. Wu, "Exploring Learning Performance toward Cognitive Approaches of a Virtual Companion System in LINE app for m-learning", Eurasia J. Math. Sci. Technol. Educ., vol. 9(4), pp. 337-346, 2013. DOI: 10.12973/eurasia.2013.943a.
  • http://www.statista.com/statistics/250926/number-of-registered-line-app-users/ (Accessed: Sep. 14, 2015) .
  • Al-Imran and A.O. Samuel, "Evaluation of Video Quality of Service in 3G/UMTS Wireless Networks as Succor for B3G/4G Wireless Network", Master Thesis, School of Computing, Blekinge Institute of Technology, Sep. 2010.
  • S. Zainab, M. Jannisar and A. Javed,"Improving Quality of Perception (QoP), Quality of Experience (QoE), and Quality of Service (QoS) in agile development using Cleanroom Software Engineering (CSE)", Int. J. Mod. Educ. Comput. Sci., vol.6, no.10, pp.49-56, 2014. DOI: 10.5815/ijmecs.2014.10.07.
  • ITU-T Recommendation G.1000. Communications quality of service: A framework and definitions. November, 2001
  • ITU-T Recommendation E.800. Terms and definitions related to quality of service and network performance including dependability. August, 1994.
  • ITU-T Recommendation P.10/G.100. Vocabulary for performance and quality of service, Amendment 1 - New Appendix I- Definition of Quality of Experience (QoE). January, 2007.
  • ITU.T Recommendation P.800. Methods for subjective determination of transmission quality. August, 1996.
  • T. Daengsi, "VoIP Quality Measurement: Recommendation of MOS and Enhanced Objective Measurement Method for Standard Thai Spoken Language", Ph.D. Thesis, Faculty of Information Technology, KMUTNB, Nov. 2012.
  • M. Langer, "Quality Management in 4G Wireless Networking Technology Allows to Attend High-Quality Users", J. Telecommunications and Information Technology, vol. 2013, No.3, pp. 48-55, 2013.
  • M. Voznak and J. Rozhon, "Influence of Atmospheric Parameters on Speech Quality in GSM/UMTS", Int. J. Math. Model. Method. Appl. Sci., vol. 6(4), pp. 575-582, 2012.
  • Ditech Networls, "Limitations of PESQ for Measuring Voice Quality in Mobile and VoIP Networks", White paper, Dec 2007.
  • M. Goudarzi, L. Sun, and E. Ifeachor, "PESQ and 3SQM measurement of voice quality over live 3G networks," MESAQIN'09, Czech Republic, Jun. 2009.
  • ITU-T Recommendation P.800.1. Mean Opinion Score (MOS) terminology. July, 1996.
  • T. Ulseth, and F. Stafsnes, "VoIP speech quality – Better than PSTN?" Telektronikk, pp. 119-132, 2006.
  • ITU-T Recommendation G.107, "The E-model: a computational model for use in transmission planning," 2011.
  • G. Lisha and L. Junzhou, "Performance Analysis of a P2P-Based VoIP Software", Proc. AICT/ICIW 2006, San Jose, CA, pp. 11, Feb. 2006. DOI: 10.1109/AICT-ICIW.2006.147.
  • B. Sat and B. W. Wah, "Evaluation of Conversational Voice Communication Quality of the Skype, Google-Talk, Windows Live, and Yahoo Messenger VoIP Systems", Proc. IEEE 9th MMSP 2007, Crete, Greece, pp. 135-138, Oct. 2007. DOI: 10.1109/MMSP.2007.4412836.
  • C.-C. Wu, K.T. Chen, C.-Y. Huang, and C.-L. Lei, "An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google Talk, and MSN Messenger", Proc. NOSSDAV, Williamsburg, VA, pp. 97-102, Jun. 2009. DOI: 10.1145/1542245.1542268.
  • B. Eröz-Tuğa and R. Sadler, "Comparing six video chat tools: A critical evaluation by language teachers", Comput. Educ., vol. 53(3), pp. 787-798, 2009. DOI: 10.1016/j.compedu.2009.04.017.
  • P. Casas, A. Sackl, S. Egger, and R. Schatz, "YouTube & Facebook Quality of Experience in Mobile Broadband Networks", Proc. IEEE Globecom Workshops, Anaheim, CA, pp. 1269-1274, Dec. 2012. DOI: 10.1109/GLOCOMW.2012.6477764.
  • Y.-C. Yen et al., "Lab experiment vs. crowdsourcing: a comparative user study on Skype call quality", Proc. AINTEC'13, Chiang Mai, Thailand, pp. 65-72, Nov. 2013. DOI: 10.1145/2534142.2534151.
  • Y.-C. Chen, "Measuring Cellular Networks: Characterizing 3G, 4G, and Path Diversity", Presented in Annual Conference of ITA 2012, Southampton, UK, Sep. 2012. Retrieved from: http://people.cs.umass.edu/~yungchih/publication/12_mtcp_4g_tech_report.pdf (Accessed Sep. 14, 2015).
  • http://www.pcworld.com/article/253808/3g_and_4g_wireless_speed_showdown_which_networks _are_fastest_.html (Accessed: Sep. 14, 2015) .
  • http://opensignal.com/reports/state-of-lte/usa-q1-2014/ (Accessed: Sep. 14, 2015) .
  • J. Poncela et al. "Quality Assessment in 3G/4G Wireless Networks", Wireless Personal Communications, vol. 76, pp. 363-377, 2014. DOI: 10.1007/s11277-014-1711-5.
  • NBTC, "Results of Quality of Service Measurement from Mobile Networks", Field Survey Report, Sep. 2013.
  • P. Wuttidittachotti, K. Yochanang, N. Chumkot, T. Triyason and T. Daengsi, "Quality of Experience of VoIP for Social Network Services: Facebook vs LINE over 3G Networks in North Bangkok", Proc. 11th ECTI-CON 2014, Nakhon Ratchasima, Thailand, pp. 1-6, May. 2014. DOI: 10.1109/ECTICon.2014.6839876.
  • A. Azfar, K.-K.R. Choo, L. Liu, "A study of ten popular Android mobile VoIP applications: Are the communications encrypted?" Proc. 47th Hawaii Int. Conf. System Sciences (HICSS) 2014, Waikoloa, HI, pp. 4858-4867, Jan. 2014. DOI: 10.1109/HICSS.2014.596.
  • Y. Xu, C. Yu, J. Li and Y. Liu, "Video Telephony for End-consumers: Measurement Study of Google+, iChat, and Skype," IEEE/ACM Trans. Networking, vol. 22(3), pp. 826-839, 2014. DOI: 10.1109/TNET.2013.2260354.
  • K. Jang et al., "3G and 3.5G wireless network performance measured from moving cars and high-speed trains", Proc. 1st ACM workshop on Mobile internet through cellular networks (MICNET'09), Beijing, China, pp. 19-24, Sep. 2009. DOI: 10.1145/1614255.1614261
  • T. Daengsi et al., "The Development of a Thai Speech Set for Telephonometry", Proc. Oriental COCOSDA 2010, Kathmandu, Nepal, paper no. 53, Nov. 2010.
  • https://www.itu.int/net/itu-t/sigdb/genaudio/AudioForm-g.aspx?val=10000501 (Accessed Sep. 14, 2015).
Еще
Статья научная
QR-код для установки приложения SciUp Наведите камеру и скачайте бесплатное приложение SciUp