'I have no agenda' - Contractor General says he is doing his job