Image emotions are human emotional responses caused by the contents of digital images. Computers are able to classify different images according to different human emotional responses.With the rapid growth of the amount of informa-tion,image emotion classification will contribute to the image annotation and search producing great social and commercial value. Chinese paintings have obvious characteristics:traditional Chinese paintings do not focus on the perspective,and do not emphasize the light color changes of objects in nature,and do not rigidly adhere to the appearance of objects.They more focus on the expression of authors' subjective consciousness making it harder to bridge the semantic gap between general low-level features and human emotions.The structure of convolutional neural network(CNN)is simple,yet its adaptability is strong.CNN also has less training parameters and more junctions,and are able to read images directly without preprocessing images complexly. It has a huge advantage over traditional image-processing method. This paper aims to explore the rela-tionships between low-level features and emotional semantics by CNN,and extract the features of Chinese paintings and process the features by PCA and normalization. Finally we classify the features by SVM.