I'm confused about something and am hoping to find answers

Why does joel live in one of the military "camps" like why not go with Tommy to his group (I forgot the name of his community). LIke the military ki[[ed his daughter so that's why I don't understand why part 1 starts with him in the military camp maybe I missed something but if anyone can offer me answers I'd be very appreciative