We　build　a　set　of　human　behavior　recognition　system　based　on　the　convolution　neural　network　constructed　for　the　specific　human　behavior　in　public　places.　Firstly,　video　of　human　behavior　data　set　will　be　segmented　into　images,　then　we　process　the　images　by　the　method　of　background　subtraction　to　extract　moving　foreground　characters　of　body.　Secondly,　the　training　data　sets　are　trained　into　the　designed　convolution　neural　network,　and　the　depth　learning　network　is　constructed　by　stochastic　gradient　descent.　Finally,　the　various　behaviors　of　samples　are　classified　and　identified　with　the　obtained　network　model,　and　the　recognition　results　are　compared　with　the　current　mainstream　methods.　The　result　show　that　the　convolution　neural　network　can　study　human　behavior　model　automatically　and　identify　human＇s　behaviors　without　any　manually　annotated　trainings.