It's not "us" we need to worry about. It's the townsfolk here the Stalkers are after. They could easily start taking out more than one at a time. Especially if they know we're close to something