StackOverflow Questions for Tag: huggingface-evaluate

Raptor

Reputation: 54258

How to specify additional parameters when using HuggingFace Evaluate's evaluate.combine() method?

pythonbleuhuggingface-evaluatechrf

Score: 0

Answers: 2

Tetro

Reputation: 27

Error when installing evaluate library in miniconda3

pythonanacondacondahuggingfacehuggingface-evaluate

Score: 0

Answers: 2

rushikesh maheshwari

Reputation: 82

write_csv=True does not write the csv for the result while using SentenceTransformerEvaluator

pytorchnlphuggingface-transformerssentence-transformershuggingface-evaluate

Score: 0

Answers: 0

Duong Vu

Reputation: 197

HuggingFace LLM Evaluate: RuntimeError: isin_Tensor_Tensor_out only works on floating types on MPS for pre MacOS_14_0. Received dtype: Long

pytorchnlpapple-m1huggingfacehuggingface-evaluate

Score: 3

Answers: 1

alvas

Reputation: 122260

How to have no preset values sent into .compute() in Huggingface evaluate metrics?

pythonlarge-language-modelhuggingface-datasetshuggingface-evaluate

Score: 0

Answers: 0

user23338870

Reputation: 21

Can I make a Huggingface trainer work with an Intel GPU?

tensorflowhuggingface-transformerstensorrthuggingface-evaluate

Score: 1

Answers: 0

Raptor

Reputation: 54258

Evaluate's METEOR Implementation returns 0 score

pythonmeteorhuggingface-evaluate

Score: 0

Answers: 1

bill yao

Reputation: 21

Load accuracy metric with evaluate ,sometime mistakes happen: TypeError: 'NoneType' object is not callable

pythondeep-learningnlpcomputer-visionhuggingface-evaluate

Score: 1

Answers: 1

Raptor

Reputation: 54258

Compute BLEU score of a Pandas DataFrame with valid rows filtered

pythonpandasbleuhuggingface-evaluate

Score: 0

Answers: 0

alvas

Reputation: 122260

How to load a .py script directly with evaluate.load?

pythonmetricshuggingfacehuggingface-evaluate

Score: 0

Answers: 1

Raha

Reputation: 51

How to resolve Error in seqeval in NER bert finetuning?

nlphuggingface-transformersnamed-entity-recognitionevaluationhuggingface-evaluate

Score: 2

Answers: 2

pilu

Reputation: 800

How to compute sentence level perplexity from hugging face language models?

pythonnlphuggingface-transformerslarge-language-modelhuggingface-evaluate

Score: 8

Answers: 1

PreviousPage 1Next

StackOverflow Questions for Tag: huggingface-evaluate

How to specify additional parameters when using HuggingFace Evaluate&#39;s evaluate.combine() method?

Error when installing evaluate library in miniconda3

write_csv=True does not write the csv for the result while using SentenceTransformerEvaluator

HuggingFace LLM Evaluate: RuntimeError: isin_Tensor_Tensor_out only works on floating types on MPS for pre MacOS_14_0. Received dtype: Long

How to have no preset values sent into .compute() in Huggingface evaluate metrics?

Can I make a Huggingface trainer work with an Intel GPU?

Evaluate&#39;s METEOR Implementation returns 0 score

Load accuracy metric with evaluate ,sometime mistakes happen: TypeError: &#39;NoneType&#39; object is not callable

Compute BLEU score of a Pandas DataFrame with valid rows filtered

How to load a .py script directly with evaluate.load?

How to resolve Error in seqeval in NER bert finetuning?

How to compute sentence level perplexity from hugging face language models?

How to specify additional parameters when using HuggingFace Evaluate's evaluate.combine() method?

Evaluate's METEOR Implementation returns 0 score

Load accuracy metric with evaluate ,sometime mistakes happen: TypeError: 'NoneType' object is not callable