Gas Heat Leaving Yellow Stains on Walls?You may want to test an inconspicuous area if using nail polish remover. Then hold a light near the wall and test area. Remover will probably clean it. However, it may discolor the paint.