The energy crisis and environmental pollution pose great challenges to human development. Traditional vapor-compression cooling consumes abundant energy and leads to a series of environmental problems. Radiative cooling without energy consumption and environmental pollution holds great promise as the next generation cooling technology, applied in buildings mostly in indirect way. In this work, a temperature-regulating module was introduced for direct summer cooling and winter heating. Firstly, the summer experiments were conduct to investigate the radiative cooling performance of the module. And the results indicated that the maximum indoor temperature reached only 27.5 °C with the ambient temperature of 34 °C in low latitude areas and the air conditioning system was on for only about a quarter of the day. Subsequently, the winter experiments were performed to explore the performance of the module in cooling and heating modes. The results indicated that indoor temperature can reach 25 °C in the daytime without additional heat supply and about a quarter of the day didn’t require heating in winter. Additionally, the transient model of the module and the building revealed that the electricity saving of 42.4% (963.5 kWh) can be achieved in cooling season with the module, and that was 63.7% (1449.1 kWh) when coupling with energy storage system. Lastly, further discussion about the challenges and feasible solutions for radiative cooling to directly combine with the buildings were provided to advance the application of radiative cooling. Furthermore, with an acceptable payback period of 8 years, the maximum acceptable incremental cost reached 26.2 $/m2. The work opens up a new avenue for the application mode of the daytime radiative cooling technology.