A: Consider replacing your gutters if you are unable to fix this problem. Peeling exterior paint. When gutters pull away from your roof, the water can seep down over the rear edge and onto your siding or trim. Peeling paint means this has been happening for a while and you should probably replace your gutters.