Content-Based　Image　Retrieval　(CBIR)　characterizes　the　image　content　by　extracting　visual　features,　and　measures　the　similarity　according　to　the　distance　between　the　two　features.　This　paper　adopts　CBIR　to　perform　automatic　tongue　color　analysis　of　Traditional　Chinese　Medicine　(TCM).　Firstly,　we　extract　the　visual　features　of　tongue　images　to　be　analyzed,　especially　the　color　features;　and　then　retrieve　the　similar　tongue　images　from　the　database,　which　have　been　labeled　by　TCM　doctors　in　advance.　Finally,　statistical　decision　method　is　exploited　based　on　the　retrieval　results　to　classify　the　tongue　color.　Experimental　results　show　that　the　proposed　method　can　achieve　the　classification　accuracy　of　87.85%　and　88.54%　respectively　for　the　colors　of　tongue　substance　and　tongue　coating.　The　proposed　method　in　this　paper　can　provide　a　new　means　for　the　tongue　color　automatic　analysis　of　TCM,　and　it　is　also　a　new　application　of　CBIR.