Some good books which might be useful:
Flesh and Stone – the body and architecture in western civilisation – Richard Sennet
Lessons for students of architecture – Herman Hertzberger – design oriented essays with a lot about how people inhabit buildings – features a lot of his own work.
A.D. Architectural Design – issue on architecture and anthropology – some good essays on architecture and culture.
‘Crossing the Expendable Landscape’ by Bettina Drew has a good bit about the psychology of people coping with the demolition of the downtown of Boston in the seventies.
A lot of stuf has been written about this in relation to failing housing estates.