I *always* forget that one so there we are.

If your tag is named ‘tagname’:

# remove the tag locally
git tag -d tagname

# remove the tag on the remote (origin in that case)
git push origin :tagname
# or, more verbosely
git push --delete origin tagname