How to evaluate MPEG video transmission simulations with MPEG traffic traces?

 

[Background]

1.      http://www-tkn.ee.tu-berlin.de/research/trace/ltvt.html provided many MPEG4 traffic traces for evaluation.

2.      The performance metric used to evaluate the delivered quality: The fraction of decodable frame rate. Standard MPEG encoders generate three distinct types of frames, namely I, P, and B frames. Due to the hierarchical structure of MPEG, I frames are more important than P frames, and in turn P frames are more important than B frames. Therefore, a frame is considered decodable if, and only if, all the fragmented packets of this frame and the other packets that this frame depends on are completely received. Thus, the fraction of decodable frame rate (Q) is defined as the number of decodable frames over the total number of frames sent by a video source. The larger the Q value, the better the video quality perceived by the end user.

 

[Preparation]

1.      This work was extended from http://csie.nqu.edu.tw/smallko/nctuns/myevalvid.htm. Therefore, refer to this page to add sFIFO_video, mystg2/myrtg2 into NCTUNS.

2.      Go to http://www-tkn.ee.tu-berlin.de/research/trace/ltvt.html download one trace for evaluation.

(Take the StarWarsIV: high quality trace as an example)

http://csie.nqu.edu.tw/smallko/ns2/myevalvid-NT.files/image003.jpg

 

(Open it and remove the first two lines and save the file as test_trace.dat.)

http://csie.nqu.edu.tw/smallko/ns2/myevalvid-NT.files/image004.jpg

 

3.     Download the evaluation tool from http://140.116.164.80/~smallko/nctuns/myevalvid_NT.tar.bz2.

 

[Simulation]

1.      Prepare the traffic trace file needed by mystg2.

 

2.      Prepare the traffic trace file needed by evaluation tool et.

  

3.      Create a topology. (Node1 is the sender and the node2 is the receiver.)

 

4.      Because the video transmission time is around 3600 seconds. Click G_Setting/Simulation to set the simulation time.

 

5.      Click “E” to edit property.

 

(set the receiver application)

 

(set the sender application)

 

(set the link error between node1 and router)

 

 

6.      Click “R” but don’t click Simulation/Run. We have to do some settings. (Because we have to copy the st to the working directory. Also, the test1. tcl needs to be modified. Because the FIFO queues in node 1 and node2 are needed to be replaced by sFIFO_video. I don’t add this module in the GUI.)

 

http://csie.nqu.edu.tw/smallko/nctuns/myevalvid.files/image008.jpg

 

http://csie.nqu.edu.tw/smallko/nctuns/myevalvid.files/image009.jpg

 

http://csie.nqu.edu.tw/smallko/nctuns/myevalvid.files/image010.jpg

 

http://csie.nqu.edu.tw/smallko/nctuns/myevalvid.files/image011.jpg

 

http://csie.nqu.edu.tw/smallko/nctuns/myevalvid.files/image012.jpg

 

7.     Now, click Simulation/Run to run the simulation.

 

8.      After simulation, you can find mysd_1 and myrd_2 under /tmp. Copy these two files to /root/myevalvid_NT.

 

 

p.s. If you refer to this work, please add the following publication in the reference.

 

C. H. Ke, C. K. Shieh, W. S. Hwang, A. Ziviani, “An Evaluation Framework for More Realistic Simulations of MPEG Video Transmission”, Journal of  Information Science and Engineering, vol. 24, no. 2, pp.425-440, March 2008 (SCI)

 

Dr. Chih-Heng Ke

Department of Computer Science and Information Engineering, National Quemoy University, Taiwan

Email: smallko@gmail.com