How can I unsubscribe from a podcast?

Go to the app main screen, then long press on the podcast you want to unsubscribe from and select 'Unsubscribe' in the menu.
Be careful because it will delete every downloaded episodes for this podcast as well as its playback stats.