'I won't be judged' - Azan says he isn't worried about critics as he is reappointed state minister