Mr Ayariga has however denied withdrawing