Belly button discharge happens when bacteria, yeast, or other microorganisms cause an infection in the navel. Common causes include bacterial infections, yeast infections (candidiasis), and cysts.