3D/Multiview Video, Compression and Error Concealment

The 3DTV network of excellence (NoE) was a research project funded by the European Union 6. Frame Information Society Technologies Programme, which included 19 companies and institutions spread among 9 european countries, with the aim of collaborating for research on almost all aspects of 3D imagery and video creation, compression, transmission and display. I was a researcher within this project between the years 2004-2007, and actively contributed to research on the topics of stereoscopic/multiview video compression, transmission and error concealment. In addition to these research topics, I extensively studied 3D and epipolar geometry, camera calibration, depth/disparity estimation, perceptual quality of stereoscopic imagery

 

During this project we have developed (and implemented) compression algorithms for stereoscopic video as well as multiview video, with the backward compatibility with standard H.264 decoders. This was achieved first time in the literature, and very similar ideas were later implemented within the H.264 standard by our project partners. My experience in this project have also helped me really learn to think like a developer, and have immense experience with C/C++ and OpenCV in my formative years of research.

I also wrote my BSc. thesis on the error concealment of stereoscopic and multiview video, and developed algorithms that can generate entire lost frames with inter-view and inter-frame correlations.

Relevant Publications

  • Bilen, C. "A hybrid approach for full frame loss concealment of multiview video", METU Theses, 2007, V.EE .07-21 (BSc. thesis)
  • Norkin, A.; Bici, M. O.; Aksay, A.; Bilen, C.; Gotchev, A.; Akar, G. B.; Egiazarian, K.; Astola, J.; “Multiple description coding and its relevance to 3DTV” in Haldun M. Ozaktas and Levent Onural (Eds.), “Three-Dimensional Television: Capture, Transmission, and Display.”, Springer, Heidelberg, 2007. 
  • Aksay, A.; Pehlivan, S.; Kurutepe, E.; Bilen, C.; Ozcelebi, T.; Akar, G. B.; Civanlar, R.; Tekalp, M.; “End-to-end Stereoscopic Video Streaming with Content-Adaptive Rate and Format Control”, Signal Processing:Image Communication Special Issue on Three-Dimensional Video and Television, Vol 22/2 pp 157-168.
  • Norkin, A.; Aksay, A.; Bilen, C.; Akar, B. G.; Gotchev, A.; Astola, J.; “Schemes for multiple description coding of stereoscopic video”, MRCS 2006, Istanbul, Turkey, Sept. 2006. Lecture Notes in Computer Science, vol. 4105, pp. 730-737, Springer-Verlag Heidelberg.
  • Tan, A.S.; Aksay, A.; Bilen, C.; Akar, G.B.; Arikan, E.; "Rate-distortion optimized layered stereoscopic video streaming with raptor codes", Packet Video 2007
  • Kurutepe, E.; Aksay, A.; Bilen, C.; Gurler, C.G.; Sikora, T.; Akar, G.B.; Tekalp, A.M.; "A standards-based, flexible, end-to-end multi-view video streaming architecture", Packet Video 2007
  • Bilen, C.; Aksay, A.; Akar G.B.; "Two novel methods for full frame loss concealment in stereo video", PCA 2007
  • Tan, A.S.; Aksay, A.; Bilen, C.; Akar, G.B.; Arikan, E.; "Error resilient layered stereoscopic video streaming", 3DTV Conference 2007
  • Bilen, C.; Aksay, A.; Akar, G.B., “A Multi-View Video Codec Based on H.264”, ICIP 2006
  • Norkin, A.; Aksay, A.; Bilen, C.; Akar, G.B.; Gotchev, A.; Astola, J.; "Schemes for multiple description coding of stereoscopic video", MRCS 2006
  • Aksay,A; Bilen, C.; Kurutepe, E.; Ozcelebi, T.; Akar, G.B.; Civanlar, M.R.; "Temporal and spatial scaling for stereoscopic video compression", EUSIPCO 2006
  • Pehlivam, S.; Aksay, A.; Bilen, C.; Akar, G.B.; Civanlar, M.R.; "End-to-end stereoscopic video streaming system", ICME 2006
  • Aksay, A.; Bilen, C; Akar, G.b.; "Subjective evaluation of effects of spectral and spatial redundancy reduction on stereo images", EUSIPCO 2005