Thinking about waking away from our home?

so we live in a three bedroom ranch with no basement and a small yard and owe $160,000 on it. our neighbor is a certified psycho path and we are watching all of or respectful neighbors load up there trucks and pull out leaving us here to deal with whats moving in after them and let me tell you there's some winners. now My husband bring's in roughly $85,00 a year and were terrified that if we walk away we will be sued because he makes so much money. is there anyone on here that has went through this process and gotten away with it? now before you negative people get on here and tell me how were doing the wrong thing and how we should stick it out and blah blah blah. please understand that we have been sticking it out but have had enough of being stuck in a subdivision full foreclosed homes and crazies and we need an answer. help me with some suggestions.