If they need polishing yes. Depends what colour they are, (you'd notice marks more in darker colours of course) but polishing will give a smoother finish and remove any remaining deposits from the wheel.
I'd use some Iron contaminant remover, and APC or wheel cleaner, then polish, the Panel...