It seems that taxonomies created through the Gutenberg interface doesn’t get the proper language set for them.

Whenever I create a new tag through with Gutenberg enabled the tag’s language is undefined. Then I need to go into the tag and manually select what language the tag is created in.