深度學習筆記有深度學習領軍人物個人主頁
阿新 • • 發佈：2019-01-31
**為什麼深度的神經網路比較好？這個問題在《Learning Deep Architectures for AI》提及過。原文為“The main conclusion of this section is that functions that can be compactly represented by
a depth k architecture might require an exponential number of computational elements to be represented by a depth k − 1 architecture. Since the number of computational elements one can afford depends on the number of training examples available to tune or
select them, the consequences are not just computational but also statistical: poor generalization may be expected when using an insufficiently deep architecture for representing some functions.” 解讀為存在某些函式可以簡潔地通過 k 層邏輯閘網路計算出來，但是如果限制為 k -1 層的話，就需要指數級別的邏輯閘才行（解讀來自