Caulking windows prevents air leaks that drive up heating and cooling costs and stops water intrusion that causes rot and mold. You should caulk both the exterior (where the window frame meets the siding) and interior (where the frame meets the drywall).