I’ve had many homes or places where I resided for a while. Most of these places have pleasant memories, but one or two do not. I don’t have any wish to revisit any of them as I know the changes will be unsettling as you noted. My siblings are scattered around the country, our parents dead many years. There is no childhood home to visit.
I expect to finish my life in my current home. Moving at 83, unless circumstances force me, is not appealing. My friends, although not family, are close by. They are the people whose houses I visit frequently these days; they are my old age family.