If you have read 2nd Corinthians in the Bible you will actually see that it says that GOD will live with unbelievers and that he will walk among them and that the believer should separate themselves from the non-believer.
Do not be yoked together with unbelievers. For what do righteousness and wickedness have in common? Or what fellowship can light have with darkness? …. As God has said: “I will live with them and walk among them, and I will be their God, and they will by my people.” Therefore come out from them and be separate, says the Lord. Touch no unclean thing, and I will receive you. I will be a Father to you, and you will be my sons and daughters, says the Lord Almighty.” 2 Corinthians 6:2-18