With the widespread use of liquid lithium batteries, thermal runaway phenomenon occurs from time to time, and their thermal safety has become an urgent issue to be solved. The all-solid-state lithium battery shows great potential for application with its excellent safety. The paper briefly introduces the basic concept and structure of all-solid-state lithium batteries, focuses on the latest research progress of oxide, sulfide and polymer solid electrolytes, and summarizes the differences in the thermal safety of these three types of all-solid-state lithium batteries, including the thermal safety at the level of the solid electrolyte material, the level of the interface between the solid electrolyte and the mixing of the active material or the lithium metal cathode, and the thermal safety at the level of the full-cell battery. In addition, the influence of lithium dendrite phenomenon on the safety of all-solid-state lithium batteries is still not negligible. At present, there are many studies on the thermal safety at the material and interface levels, but fewer studies at the full-cell level, and most of them are focused on small-capacity batteries, so the thermal safety at the full-cell battery level still needs to be further investigated. Finally, it is pointed out that the future commercialization of high-safety all-solid-state lithium batteries should focus on solving the key interface problems and lithium dendrite problems in all-solid-state lithium batteries.