進階搜尋


下載電子全文  
系統識別號 U0026-2008201016532300
論文名稱(中文) 基於深度圖像繪圖法產生的破洞之修補辦法及其硬體架構設計與實現
論文名稱(英文) Real-time Stereoscopic Image Generation Using Depth Image Based Rendering with Virtual View Point Estimation
校院名稱 成功大學
系所名稱(中) 電腦與通信工程研究所
系所名稱(英) Institute of Computer & Communication
學年度 98
學期 2
出版年 99
研究生(中文) 陳炫志
研究生(英文) Hsuan-Chih Chen
學號 Q3697409
學位類別 碩士
語文別 中文
論文頁數 74頁
口試委員 指導教授-陳中和
口試委員-謝錫堃
召集委員-黃穎聰
口試委員-邱瀝毅
中文關鍵字 深度圖像繪圖法  空洞修補  立體顯示器 
英文關鍵字 Depth Image Based Rendering  DIBR  3D Display 
學科別分類
中文摘要 隨著三維立體顯示技術的進步,立體顯示的應用也越來越普及。本篇論文中,我們提出一個基於深度圖像繪圖法(Depth Image Based Rendering, DIBR)的立體影像繪製系統。
由於DIBR的演算法所繪製的虛擬視點影像會產生一些畫面上的瑕疵,以往的研究提出一些消除瑕疵的方法。其中以深度影像的前置平滑處理為目前最常見的方法。然而,對來源深度影像的前置處理方法雖然能有效處理DIBR的破洞問題,卻會造成立體效果的衰減,同時會伴隨諸如幾何線條結構的扭曲(Geometry Distortion),以及Rubber Sheet Artifact等瑕疵問題。為了避免立體效果的衰減及其他的瑕疵影響,我們捨棄了對深度圖像進行前置平滑處理的方法,並根據DIBR產生的破洞特性,以其空洞區域周邊的資訊對空洞部分進行修補。對於深度變化較劇烈的部分,通常也就是物件的邊緣部分,會產生較大的破洞,而對於這樣的空洞我們採用了類似motion estimation的virtual view estimation填補辦法,也就是在其空洞區域的周圍尋找最相似的區塊進行填補。依據DIBR的破洞特性,有效地縮小搜尋比對的範圍,並且固定修補的順序,這樣簡化而規律的修補辦法能夠減少計算量且降低硬體設計上的複雜度,而使我們能夠達成硬體的實現並做到即時的應用。目前的實驗顯示對於背景較單調但強調場景中主要物件的畫面而言能取得不錯的修補效果同時不會因為深度的平滑處理而降低立體效果的呈現。
英文摘要 Three dimensional applications are widely spread all over the world. In this thesis, we proposed a stereoscopic image generation system using Depth Image Based Rendering (DIBR) method. Due to the unfavorable artifacts produced by the DIBR algorithm, researchers have developed various algorithms to handle the problem. The most common one is to smooth the depth map before rendering. However, pre-processing of the depth map usually generates other artifacts, such as rubber sheet artifact, geometry distortion and even the degradation of depth perception. In order to avoid these defects, we proposed a solution with another approach based on virtual view point estimation.
We first analyze the feature of the holes produced by the DIBR method which tends to generate big holes in the regions with large variation of depth. We develop a virtual view estimation method similar to motion estimation to fill these holes, that is, to search the most similar block and fill the blank pixels by the corresponding pixels of the best candidate block. This simple and regular filling method is suitable for hardware implementation and is able to achieve real-time applications. The results show that our method works well on images with monotonous background and the strong depth perception of the main object in the scene can be preserved.
論文目次 摘要 I
ABSTRACT II
誌 謝 III
目錄 IV
表目錄 VII
圖目錄 VIII
第1章 序論 1
1.1 研究動機 1
1.2 研究貢獻 3
1.3 論文編排 4
第2章 背景知識與相關研究 5
2.1 HUMAN VISION SYSTEM 5
2.2 3D DISPLAYS 8
2.2.1 Parallax 8
2.2.2 Stereoscopic Display Technologies 11
2.3 RELATED WORKS 14
2.3.1 Depth Image Based Rendering 14
2.3.2 Handling Artifacts 16
第3章 演算法及架構設計 19
3.1 MULTI-VIEW DISPLAY SYSTEM 19
3.2 PIXEL RE-SAMPLING 20
3.2.1 RGBD Rendering 21
3.2.2 Horizontal Visual Angle 23
3.3 HYBRID FILLING METHOD 24
3.3.1 Object-based Filling Method 26
3.3.2 Virtual View Estimation Method 28
3.4 FILLING ORDER 30
3.5 SEARCH BLOCK & SEARCH RANGE 32
3.6 SUMMARY 33
第4章 架構實現 35
4.1 OVERVIEW 35
4.2 LOOKUP TABLE DESIGN 37
4.3 FILLING UNIT 40
4.3.1 Inter-candidate Data Reuse 41
4.3.2 Processing Element 42
4.3.3 Data Flow 43
4.4 DATA SHARING 45
4.4.1 Intra-candidate Data Reuse 45
4.4.2 External Memory Access 49
4.5 SUMMARY 52
第5章 模擬環境與實驗結果 54
5.1 SIMULATION ENVIRONMENT 54
5.2 AUTO-STEREOSCOPIC DISPLAY 56
5.3 EXPERIMENTAL RESULTS 57
第6章 結論與未來展望 64
6.1 結論 64
6.2 未來展望 64
參考文獻 71
參考文獻 [1] D. F. McAllister, Stereo technology: Stereo & 3D display technology, http://research.csc.ncsu.edu/stereographics/wiley.pdf
[2] L. Hill and A. Jacobs, “3D Liquid Crystal Displays and Their Applications,” Proceedings of IEEE, vol. 94(3), pp. 524-538, 2006.
[3] J. Compen, “3D graphics rendering for multi-view displays: Using programmable shaders on graphics cards,” Koninklijke Philips Electronics N.V. 2005, Technical note TN-2004/00920.
[4] N. A. Dodgson, “Autostereoscopic 3D Displays,” Computer, vol. 38, iss. 8, pp. 31-36, Aug. 2005.
[5] L. F. Hodges, “Tutorial: Time-multiplexed stereoscopic computer graphics,” IEEE Computer Graphics and Applications, 1992, 20-30.
[6] C. Fehn, RD. Barre and S. Pastoor, “Interactive 3-DTV--Concepts and Key Technologies,” Proceedings of the IEEE, vol. 94(3), pp. 524 - 538, 2006.
[7] C. Fehn, “A 3D-TV system based on video plus depth information,” in Thirty-Seventh Asilomar Conference on Signals, Systems and Computers, vol. 2, pp. 1529-1533, Nov. 2003.
[8] J.-K. Cho, “Multi-view Image Generation Using Compensated Depth-Image-Based Rendering for 3D Displays,” Master’s Thesis, Dept. of Electrical Engineering, National Cheng Kung University, 2007.
[9] Y.-C. Wu, “Image Synthesis Technology for Multi-view 3D Displays,” Master’s Thesis, Dept. of Electrical Engineering, National Cheng Kung University, 2008.
[10] C. Vazquez, W. J. Tam and F. Speranza, “Stereoscopic Imaging: Filling Disoccluded Areas in Depth Image-Based Rendering,” in Proc. Of SPIE vol. 6392, 2006.
[11] M. Bertalmio, G. Sapiro, V. Caselles and C. Ballestar, “Image Inpainting,” Computer Graphics (SIGGRAPH 2000), pp. 417-424, July 2000.
[12] A. Criminisi, P. Perez and K. Toyama, “Region Filling and Object Removal by Exemplar-Based Image Inpainting,” IEEE Transactions on Image Processing, Vol. 13, No. 9, September 2004.
[13] H.-J. Hsu, J.-F. Wang, Fellow, IEEE, and S.-C. Liao, “A Hybrid Algorithm With Artifact Detection Mechanism for Region Filling After Object Removal From a Digital Photograph,” IEEE Transactions on Image Processing, vol. 16, no. 6, June 2007.
[14] L. Zhang and W. J. Tam, “Stereoscopic Image Generation Based on Depth Images for 3D TV,” IEEE Transactions on Broadcasting, vol. 51, no. 2, June 2005.
[15] K.-J. Oh, S. Yea and Y.-S. Ho, “Hole Filling Method Using Depth Based In-painting for View Synthesis in Free Viewpoint Television and 3D Video,” Picture Coding Symposium, 2009.
[16] W.-Y. Chen, Y.-L. Chang, S.-F. Lin, L.-F. Ding and L.-G. Chen, “Efficient Depth Image Based Rendering With Edge Dependent Depth Filter and Interpolation,” IEEE International Conference on Multimedia and Expo, pp. 1314-1317, ICME, July 2005.
[17] W.-Y. Chen, Y.-L. Chang, H.-K. Chiu, S.-Y. Chien and L.-G. Chen, “Real-Time Depth Image Based Rendering Hardware Accelerator for Advanced Three Dimensional Television System,” IEEE International Conference on Multimedia and Expo, ICME, 2006.
[18] M. Gong, J. M. Selzer, C. Lei and Y.-H. Yang, "Real-time backward disparity-based rendering for dynamic scenes using programmable graphics hardware," Proceedings of Graphics Interface, pp. 241-248, May 2007.
[19] M. Kim, I. Hwang and S.-I. Chae, “A fast VLSI Architecture for Full-Search Variable Block Size Motion Estimation in MPEG-4 AVC/H.264,” IEEE ASP-DAC 2005, Pages 631-634, 2005.
[20] CoWare Platform Architecture,
http://www.coware.com/products/platformarchitect.php
[21] P. Benzie, Member, IEEE, J. Watson, Senior Member, IEEE, P. Surman, I. Rakkolainen, K. Hopf, H. Urey, Member, IEEE, V. Sainov and C. v. Kopylow, “A Survey of 3DTV Displays: Techniques and Technologies, ” IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, No. 11, NOVEMBER 2007.
[22] A. Jacobs, J. Mather, R. Winlow, D. Montgomery, G. Jones, M. Tillin, L. Hill, M. Khazova, H. Stevenson and G. Bourhill, 2D/3D switchable displays, Sharp Technical Journal (4) 2003.
[23] S.-F. Tsai, “Design, Analysis, and Implementation of a Geometry Engine Based on Tile-Based Rendering Architecture in 3D Graphics,” Master’s Thesis, Dept. of Electrical Engineering, National Cheng Kung University, July 2009.
[24] J.-Y. Liou, “Design, Analysis, and Implementation of a Rasterization Engine based on Tile-Based Rendering Architecture in 3D Graphics,” Master’s Thesis, Dept. of Electrical Engineering, National Cheng Kung University, July 2009.
[25] B. Froner, N. S. Holliman and S. P. Liversedge, “A comparative study of fine depth perception on two-view 3D displays, ” Displays 29, 440-450 (2008).
[26] C.L. Zitnick, S.B. Kang, M. Uyttendaele, S. Winder and R. Szeliski, ”high-quality video view interpolation using a layered representation,” ACM SIGGRAPH and ACM Trans. on Graphics, Los Angeles, CA, pp. 600-608, Aug. 2004.
[27] Futuremark Corporation, Products page, http://www.futuremark.com/products/
論文全文使用權限
  • 同意授權校內瀏覽/列印電子全文服務,於2012-08-25起公開。
  • 同意授權校外瀏覽/列印電子全文服務,於2012-08-25起公開。


  • 如您有疑問,請聯絡圖書館
    聯絡電話:(06)2757575#65773
    聯絡E-mail:etds@email.ncku.edu.tw