I would counsel against a move into the apartment you describe as it may upset him so much that he has a crisis and ends up in a care home shortly afterwards. There are care homes that cater for all needs, suggest you go see a few.
A final point. Its often those that are closest to the Person With Dementia ( PWD) who are the last to realize how far down the Dementia journey that person is. This was the mistake that we made.