If a baby goat is banded, can the band be taken off or not (did not need to be banded)?

We got a baby pygmy goat and the guy banded him. I want to know if the band can be taken off or will this hurt the goat ? This has been on him for almost a week now. I just do not know much about this yet so any information is greatly appreciated!