Although its derivation involves possibly elusive notions like energy, thermal conductivity, and specific heat, it is a natural candidate for a plausibility argument:
The temperature of the body falls if it is hotter than its surroundings (The concept of heat flow appears again in section 9.4, Time-dependent Diffusion, p. 460-467, where the heat equation). The rate of decrease of temperature increases if there is more surface area A to transfer heat energy or if thermal conductivity k is larger (i.e., if insulation is poorer).