Yes, you can chat with people who don’t have the app. They will receive chat messages in the form of emails. However, they won't be able to send chat messages to you or to any Team.
You can also ask the person you want to chat with to download 4th Office. Just click/tap their name, go to your chat stream and choose 'Send invite'.