Makes me think of Julio Cortazar short story House Taken Over (Casa Tomada).
You may enjoy it.

https://shortstoryproject.com/stories/house-taken-over/