Convolutional Neural Network for Intermediate View Enhancement in Multiview Streaming
MetadataShow full item record
Subjectmultiview video streaming; multiview video representation; multiview navigation; Convolutional neural network (ConvNet)
Multiview video streaming continues to gain popularity clue to the great viewing experience it offers, as well as its availability that has been enabled by increased network throughput and other recent technical developments. User demand for interactive multiview video streaming that provides seamless view switching upon request is also increasing. However, it is a highly challenging task to stream stable and high quality videos that allow real-time scene navigation within the bandwidth constraint. In this paper, a convolutional neural network (ConvNet)-assisted seamless multiview video streaming system is proposed to tackle the challenge. The proposed method solves the problem from two perspectives. First, a ConvNet-assisted multiview representation method is proposed, which provides flexible interactivity without compromising on multiview video compression efficiency. Second, a bit allocation mechanism guided by a navigation model is developed to provide seamless navigation and adapt to network bandwidth fluctuations at the same time. These two blocks work closely to provide an optimized viewing experience to users. They can be integrated into any existing multiview video streaming framework to enhance overall performance. Experimental results demonstrate the effectiveness of the proposed method for seamless multiview streaming.
Showing items related by title, author, creator and subject.
Scalable Bit Allocation Between Texture and Depth Views for 3-D Video Streaming Over Heterogeneous Networks Xiao JM; Hannuksela MM; Tillo T; Gabbouj M; Zhu C; Zhao Y (IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2015)In the multiview video plus depth (MVD) coding format, both texture and depth views are jointly compressed to represent the 3-D video content. The MVD format enables synthesis of virtual views through depth-image-based ...
Formal verification of wastewater treatment processes using events detected from continuous signals by means of artificial neural networks: Case study: SBR plant Luccarini, L; Bragadin, GL; Colombini, G; Mancini, M; Mello, P; Montali, M; Sottara, D (Elsevier, 2010)This paper proposes a modular architecture for the analysis and the validation of wastewater treatment processes. An algorithm using neural networks is used to extract the relevant qualitative patterns, such as apexes, ...
Classification of Sperm Cells According to their Chromosomic Content Using a Neural Network Trained with a Genetic Algorithm Kuri, A; Ortiz, M; Zenteno, D; Penaloza, R (IEEE-Press, 2003)A priori determination of the sex of a human individual before gestation is a desirable goal in some cases. To achieve this, it is necessary to perform the separation of sperm cells containing either X or Y chromosomes. ...