Yes, you can delete ALL your voice data by going to your account settings in the app, and deleting your account. You have full control of your data.
Meanwhile, feel free to create an account and explore the app, even just by listening to other recordings! And only when you feel comfortable sharing your thoughts with your voice, you can participate.