Lord Cormack says there is a difference between racism and the “deeply held belief” of religious intolerance.