CODEWITHSUNDEEP
pythonhuggingface-transformersgpt-2
Johnny
Johnny

Reputation: 125

How to Get Rid of GPT-2 Warning Message?

Every time I run GPT-2, I am receiving this message. Is there a way I can get this to go away?

Some weights of GPT2LMHeadModel were not initialized from the model checkpoint at gpt2 and are newly initialized: ['h.0.attn.masked_bias', 'h.1.attn.masked_bias', 'h.2.attn.masked_bias', 'h.3.attn.masked_bias', 'h.4.attn.masked_bias', 'h.5.attn.masked_bias', 'h.6.attn.masked_bias', 'h.7.attn.masked_bias', 'h.8.attn.masked_bias', 'h.9.attn.masked_bias', 'h.10.attn.masked_bias', 'h.11.attn.masked_bias', 'lm_head.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.

Upvotes: 2

Views: 1382

Answers (1)

cronoik
cronoik

Reputation: 19300

Yes you need to change the loglevel before you import anything from the transformers library:

import logging
logging.basicConfig(level='ERROR')

from transformers import GPT2LMHeadModel

model = GPT2LMHeadModel.from_pretrained('gpt2')

Upvotes: 2

Related Questions