Can you remove a castrating band early? (Goats)?

We just came home with an almost seven week old pygmy goat buckling. We did not want him banded this early as it is not healthy, and he was just banded either yesterday or the day before. I want to know if it is safe to remove the band or if it will cause some sort of harm.