Have you checked for cracked exhaust flexi's, exhaust flange where it bolts to the engine, or any other parts of the exhaust leaking?
As frank said, exhaust changes (or leaks) can cause noticeable problems on these. Look out for black soot to easily spot a leak on the exhaust.
Changing the cam...