Its really depends on the location of the house! Shooting directly toward sun is undesirable.
The sun rise in the east and set in the west. The best exterior photoshoot would be after 12:00 pm for west facing homes & morning for east facing homes. For interior photoshoot just make a time with less direct sunlight from windows.