Mr Ayariga has denied withdrawing