It seems Sir Walter and his men aren't the only ones in the neighborhood, and the neighbors aren't necessarily friendly.

See the guy in green? He once worked for Sir Walter, but was fired, though no one knows quite why. Shoddy workmanship most likely, or maybe he wasn't quite sober when he showed up for work. In any case, it seems that he has a grudge.