Getting Rid of Mushrooms in Houseplant Pots?

I have a very tall Norfolk Island pine tree, houseplant, which has yellow mushrooms sprouting up in the potting soil. How can I permanently get rid of them?

By Kathy