When migrating to AWS route53 sould I delete the original nameserver addresses?

After I have added the AWS delegation set to the original NS list, should I then delete the default NS set provided by the original service?