Podcasts you follow are automatically downloaded to your Apple device. Episodes you’ve played are automatically deleted from your device. You can change these settings, and adjust other download options.
Go to Settings > Apps > Podcasts.
Turn off Sync Library.