The　influence　of　the　structure　design　to　the　capabilities　of　neural　networks　is　discussed　in　this　paper.　The　development　history　of　the　dynamic　structure　neural　networks,　especially　the　growing　and　the　pruning　neural　networks　are　introduced.　The　substantial　results　on　the　computing　capabilities,　learning　theories,　stability　of　neural　networks　are　then　analyzed.　Finally,　the　research　on　the　dynamic　optimization　structure　design　is　summarized　and　several　views　are　put　forward.