Always carry a bucket of milk to drink immediately after killing the Captain if you want to clear the effect.

To help you get ready for your assault on the bay, let me know: What do you currently have? Share public link the pillager bay