A lot of heat will generate in mass concrete after pouring to form temperature cracks, which will reduce structural stiffness. This paper briefly introduces the principle of solid heat conduction and the cause of temperature crack formation and then used COMSOL software to simulate and analyze the mass concrete. The results showed that the simulation model had enough reliability to analyze the temperature change; the internal and external temperature of concrete rose first and then decreased; the formation of temperature crack was related to the internal and external temperature difference; the internal and external temperature difference was inversely proportional to the heat conductivity coefficient of concrete and directly proportional to the pouring temperature. Then, according to the analysis results, two measures were put forward to prevent temperature cracks in mass concrete: selecting concrete materials with high thermal conductivity, i.e., selecting coarse aggregate and fine aggregate with larger heat conductivity coefficient and reducing concrete pouring temperature, i.e., selecting cement with lower hydration heat, paying attention to temperature reduction in the process of concrete stirring, and reducing the amount of cement.