Self-Compacting Concrete (SCC) has been widely used in the filling layer of high-speed railways. The quality of the filling layer directly affects the durability, comfort, and safety of the track system. In this study, shrinkage characteristics and the creep behavior of SCC were investigated by compressive creep tests and shrinkage tests. They were performed on specimens with different loading levels with a calcium sulfoaluminate-based expansive agent (UEA) and viscosity modified admixture (VMA). Furthermore, based on the scanning electron microscope (SEM) morphology of hydration products and X-ray diffraction (XRD) analysis, the influence of admixtures on microstructure and mineral phases of SCC was analyzed.The results show that when concretes were loaded with the same stress level, the main factor influencing creep of SCC was the quantity and microstructure of amorphism and hydration crystal. The XRD and SEM result showed that UEA andVMAmake the creep and shrinkage of SCC reduce obviously as the cementitious system grow many crystals in hydration products. The creep of NC was less than SCC with identical compressive strength. At the same time, the addition of UEA can improve the ability to resist drying shrinkage.