This fix the issue that the negative response with retry-after has been failed-over to the next address.