This article is trying to catalogue all different styled pavilion, garden house of straw and the gardening stone which has painted as an important sightseeing part among the scenery of landscape that was served as the background of the large illustration to Buddhist sutra on the wall of cave 3 at the Yulin Grottoes, based on a large scaled investigation and study on the site. This article then put forwards the three topics to discussing with: 1. By the study of the classic literary works especially these ones which have been describing pavilions, the garden houses of straw and the gardening stone,therefore go forth to analysis their concrete function in the literary man’s life or to seek for the reason why these concrete objects to be chosen as subjection to be grasp with admiration and to praise with. 2. By the investigation on the works of ancient Chinese gardening art and then to study the function of these pavilions, the garden house of straw and gardening stone in the literary man’s garden and their country house or a villa since the living style has been popular among the literary man during the Tang Dynasty to the Song Dynasty. 3. By investigation on the works of paintings of the Tang and the Song Dynasty, it was turned out that the drawing of pavilion, the garden house of straw and the gardening stone had been a fashionable current during the Tang and the Song Dynasty as a Hotpoint in the literary man’s painting. Based on these investigations and the study, this article pointed out that by the-time of the Tang and the Song Dynasty, the drawing of pavilion, garden house of straw and the gardening stone has become a significant phenomenon that was served as the symbol of traditional Chinese literary man’s mind and signify their mental life.