Former Attorney General Martin Amidu could regret his decision to withdraw