I used Pittman's One Step to clean mine last year and they still look good. I did not need tools or protective clothing so I'd say it was pretty safe and its liquid, so its safe on the headlight too. Absolutely no abrasive damage.
There is a kit you can buy at the auto parts store to take that off headlamps. Ask at the counter and they should be able to point you in the right direction.
I understand there is a product at motorcycle places like Harley's that have a product for the motorbikes that is excellent to clean the headlights. I don't know the name, but I'm sure you can ask and find out.
m2¢
Whiting* sprinkled on a damp (non-abrasive) cloth should remove the foreign particles and polish at the same time. Not knowing what material your lens are made of, if High-impact Acrylic, it should have UV properties within; if still concerned after cleaning your lens, apply a UV Protectant available from an Auto Wax..
Add the 3M Headlight Lens Restoration System to your revenue stream of car care services. This system is a fast and easy way to restore the clarity back to headlight lenses that have become dull or cloudy over time. It was designed with the professional in mind to maximize productivity and performance. In many cases, this kit can be paid for in as little as 10 jobs. Use the 3M Headlight Lens Restoration System to increase your profitability and customer satisfaction.
Available February 8, 2008 at any authorized 3M Automotive Aftermarket distributor. Ask for part number 02516.
Meguiars auto polish company makes stuff called plastiX just for this job it takes 4 to 6 applications to buff them out it works. If they are yellow and look sand blasted don't waste your time just replace them.
I used Pittman's 360ID. It's safer than sandpaper or polish. It works very well and it's fast. I would recommend it over any of the other cleaning methods.
Where do I get the deoxidizer for the clear lens on my car.
Use the search engine, best way to find anything online.
A headlight deoxidizer is the safest way to clean oxidation.