Reputation: 3738
When using Hugginface Transformers on GLUE task, I've got the error AttributeError: 'MrpcProcessor' object has no attribute 'tfds_map'
I suspect a problem of compatibility.
Upvotes: 2
Views: 2149
Reputation: 14641
Right now I am using transformers 2.11.0
and this code works for me:
# First we create an empty Byte-Pair Encoding model (i.e. not trained model)
tokenizer = Tokenizer(BPE())
tokenizer.normalizer = Sequence([
NFKC(),
Lowercase()
])
So there seems to be a constructor which you can use.
Upvotes: 0
Reputation: 3738
My solution was to simply to downgrade the version of transformers to 2.2.0
pip uninstall transformers -y
pip install transformers==2.2.0
Upvotes: 3