進階搜尋


   電子論文尚未授權公開,紙本請查館藏目錄
(※如查詢不到或館藏狀況顯示「閉架不公開」,表示該本論文不在書庫,無法取用。)
系統識別號 U0026-2206202022563500
論文名稱(中文) 應用定量及定性型高斯過程之替代輔助模型於參數校調設計
論文名稱(英文) Surrogate-Assisted Tuning for Gaussian Process with Qualitative and Quantitative Factors
校院名稱 成功大學
系所名稱(中) 數據科學研究所
系所名稱(英) Institute of Data Science
學年度 108
學期 2
出版年 109
研究生(中文) 蘇純瑩
研究生(英文) Chun-Ying Su
學號 RE6071012
學位類別 碩士
語文別 中文
論文頁數 44頁
口試委員 指導教授-陳瑞彬
口試委員-李國榮
口試委員-李宜真
中文關鍵字 電腦實驗  高斯過程  序列設計  卷積神經網路 
英文關鍵字 computer experiments  Gaussian process  sequential design  Convolutional Neural Network 
學科別分類
中文摘要 本論文主要以高斯過程模型(Gaussian Process Model)應用在電腦實驗的研究方向上,主要探討的問題同時包含連續型因子(Quantitative Factors)及類別型因子(Qualitative Factors),並依反應變數含有噪聲(noise)與否分為兩種不同的案例進行研究。而整個實驗流程基本上涵蓋有兩步驟:應用高斯過程模型建模再依填充標準(Infill Criteria)進行序列設計(Sequential Design),整個算法為這兩個步驟依序疊代,直到停止條件滿足為止。

其中不具噪聲的案例為電子元件散熱鰭片之散熱效果分析。此類資料的反應變數不具有噪聲,因此我們選用定量及定性型之高斯過程(QQGP)為替代輔助模型,透過以QQGP建模結合最大期望改進量準則(Expected Improvement Criterion)進行序列設計,得以在控制成本的情況下,從少許實驗樣本找出電子元件散熱鰭片散熱效果較優的配置。

而具有噪聲的案例則應用在卷積神經網路(CNN)的參數優化上。因一般訓練卷積神經網路辨識影像需耗費大量的時間,本論文以樹狀高斯過程模型(tGP)結合期望改進量準則進行最佳化程序,得以在進行迭代的過程中逐步提升模型準確率並優於原作所建議的參數預設值。
英文摘要 This thesis mainly focuses on surrogate-assisted tuning procedures for the different types of the variables and responses. Basically, the surrogate-assisted approach iterates the following two steps until a stop criterion is met. First based on the current explored points, a surrogate surface is constructed and then due to the surrogate model, an infill criterion is adopted to identify the next explored points. Here in addition to quantitative variables, the qualitative variables are also considered, and the responses can be deterministic or contain noise.

Firstly, we study the performance of the heat dissipation fins in electronic components. The response is deterministic. Since qualitative variables are considered in the study, the Gaussian process model with qualitative and quantitative factors (QQGP) is adopted for surrogate construction and a maximum expected improvement criterion is used to identify the next explored points. Due to the cost limitation, the proposed surrogate-assisted approach does find out the configuration with better heat dissipation effect of the heat dissipation fins in electronic components.

Secondly, we consider the parameter tuning in CNN. Since the response involves the random effects, the treed Gaussian process (tGP) with an expected improvement criterion is adopted here for the surrogate-assisted tuning procedure. Due to the numerical experiments, the proposed surrogate-assisted tuning procedure can identify the parameters with better performance.
論文目次 摘要....II
表目錄....X
圖目錄....XI
第一章 緒論....1
1.1 研究背景與動機....1
1.2 文獻回顧....2
1.3 論文架構....3
第二章 研究架構....4
2.1 切片拉丁方格設計(Sliced Latin Hypercube Design)....6
2.2 高斯過程(Gaussian Process)....7
2.2.1 基於連續型因子之高斯過程模型....7
2.2.2 定量及定性型之高斯過程模型(QQGP)....9
2.2.3 樹狀高斯過程模型(treed GP)....11
2.3 期望改進量(Expected Improvement)....13
第三章 電子元件散熱鰭片....15
3.1 資料來源及介紹....15
3.2 實驗設計與流程....17
3.3研究結果....18
第四章 卷積神經網路參數校調....21
4.1 卷積神經網路(Convolutional Neural Network)....21
4.1.1 卷積層(Convolution Layer)....21
4.1.2 池化層(Pooling Layer)....22
4.1.3 全連接層(Fully Connected Layer)....23
4.2 實驗設計及流程....25
4.2.1 模型選擇....25
4.2.2 參數介紹....26
4.2.3 開放資料集介紹....27
4.3 實驗結果....28
4.3.1 一個連續型因子及一個三水準的類別型因子....29
4.3.2 一個連續型因子及一個五水準的類別型因子....33
4.3.3 三個連續型因子及一個三水準的類別型因子....37
第五章 結論與未來展望....42
參考文獻....43
參考文獻 [1] Ba, S., Myers, W. R., & Brenneman, W. A. (2015). “Optimal sliced Latin hypercube designs.” Technometrics, 57(4), 479-487.
[2] Chen, J. K., Chen, R. B., Fujii, A., Suda, R., & Wang, W. (2018). “Surrogate-assisted tuning for computer experiments with qualitative and quantitative parameters.” Statistica Sinica, 761-789.
[3] Fang, K. T., Li, R., & Sudjianto, A. (2005). “Design and modeling for computer experiments.” CRC press.
[4] Gramacy, R. B. (2007). “tgp: an R package for Bayesian nonstationary, semiparametric nonlinear regression and design by treed Gaussian process models.” Journal of Statistical Software, 19(9), 6.
[5] Gramacy, R. B., & Taddy, M. (2009). “Categorical inputs, sensitivity analysis, optimization and importance tempering with TGP version 2, an R package Ior treed Gaussian process models.” Technical report, R manual.
[6] Gramacy, R. B., & Lee, H. K. H. (2008). “Bayesian treed Gaussian process models with an application to computer modeling.” Journal of the American Statistical Association, 103(483), 1119-1130.
[7] Qian, P. Z. G., Wu, H., & Wu, C. J. (2008). “Gaussian process models for computer experiments with qualitative and quantitative factors.” Technometrics, 50(3), 383-396.
[8] Santner, T. J., Williams, B. J., Notz, W., & Williams, B. J. (2003). “The design and analysis of computer experiments” (Vol. 1). New York: Springer.
[9] Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., ... & Rabinovich, A. (2015). “Going deeper with convolutions.” In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1-9).
[10] Taddy, M. A., Gramacy, R. B., & Polson, N. G. (2011). “Dynamic trees for learning and design.” Journal of the American Statistical Association, 106(493),109-123.
[11] Zhou, Q., Qian, P. Z., & Zhou, S. (2011). “A simple approach to emulation for computer models with qualitative and quantitative factors.” Technometrics, 53(3), 266-273.


論文全文使用權限
  • 同意授權校內瀏覽/列印電子全文服務,於2025-06-22起公開。
  • 同意授權校外瀏覽/列印電子全文服務,於2025-06-22起公開。


  • 如您有疑問,請聯絡圖書館
    聯絡電話:(06)2757575#65773
    聯絡E-mail:etds@email.ncku.edu.tw