In recent years, an architecture made of natural resources attracts more attention. In some areas of Europe, “Rammed earth’’ has already been used for building structure. To spread the rammed earth in Japan, the structural system with seismic resistant mechanism is needed. This study suggests composite structure with rammed earth and steel framework. In this paper, the horizontal loading test is conducted. From test result, specimen with rammed earth presents high strength and rigidity by comparing the steel specimen, that is, the combined effect is confirmed. Furthermore, the proposed analytical method of strength can estimate the test result.