The noise you're hearing is gear backlash caused by less inertia from the lightened flywheel. Mine is much louder than it was before I changed mine.
I had a lightweight flywheel fitted, a Blackline diff, 4.73:1 CWP from an 021 box along with 1-3 ratios from an 031 to replace my 003 ratios.