Ariel Siedman has been given 72 hours to leave South Africa, the foreign affairs ministry says.