If one were to plot the black body radiation curve for the different temperatures each temperature has a peak emission which quickly drops off as you scan towards shorter wavelengths. https://www.physicsresourcebank.com/post/blackbody-radiation-spreadsheet-available-as-a-plaything. As you start from 0 degrees K you get very small values of W/m2, meaning it is very very hard to spot small and cold objects that are far away, there is just not much energy being relesed each second. With your shipboard sensors, you may be getting photons from that 1 m3 missile that has been sitting doggo for a month at a rate of one per hour. Just how long are you going to stare at each small patch of space looking for these threats? This is effectivly stealth in space. It CAN be detected with enough sensor area staring at that location for a few months, but an adventure class ship is not going to have the sensor m2 and time to make that detection.