It just took him a few hours to break his Oath. The 14th Amendment to the Constitution of the United States specifically gives Citizenship to anyone born in the USA. The ONLY way to change that is with another Amendment.