Terminal Error (The specified bucket does not exist) after "serverless remove"

[ghost]

I ran into a terminal error with serverless deploy. If you attempt to serverless remove an s3 bucket that has a file in it, you get the following error:

An error occurred: s3 - The bucket you tried to delete is not empty.

I have seen other issues listing the same thing, so this seems to be known. However, if you then attempt to either serverless deploy or serverless remove, you get the following error:

The specified bucket does not exist

I have seen other issues list the same error message if the user manually deletes the severless s3 bucket, however, that is not the case here, serverless seems to be causing the issue. The only way I can correct this is if I change the service name in the serverless.yml file.