Kaja Sherief
Kaja Sherief

Reputation: 41

Azure OpenAI 'Bring Your Own Data' Feature Not Providing Correct Answers

I've been using Azure's OpenAI and the 'Bring Your Own Data' (BYOD) feature for a while now. Recently, I've encountered an issue where the BYOD feature is not providing the correct answers to certain queries.

When I input the same question into the Azure Cognitive Search Explorer, it successfully returns the correct matches. However, when I pose the same question to the BYOD feature, it responds with "I don't have information about this."

I've double-checked my data and it seems to be correctly formatted and uploaded. I'm not sure why the BYOD feature isn't able to retrieve the correct information.

Has anyone else encountered this issue? Any suggestions on how to troubleshoot and fix this problem would be greatly appreciated.

Upvotes: 3

Views: 1612

Answers (3)

joao8tunes
joao8tunes

Reputation: 31

I have a GitHub project that allows for integrating external data with LLM without the need for model retraining. It also enables a side-by-side comparison of Azure/OpenAI and GCP PaLM technologies. Check it out: https://github.com/joao8tunes/genai_music_chat

Upvotes: 0

Tom
Tom

Reputation: 51

You could use Marqo as your information source and pair it directly with GPT instead. This would give you a lot more control. Here's an example of augmented retrieval with BYOD on Marqo: https://www.marqo.ai/blog/from-iron-manual-to-ironman-augmenting-gpt-with-marqo-for-fast-editable-memory-to-enable-context-aware-question-answering

Upvotes: 0

Ranran Wang
Ranran Wang

Reputation: 1

Few things to try:

  1. Did you turn on "Semantic Search" which will help with the results?
  2. Sometimes asking the same question again will help get the correct answer.
  3. You mentioned you run into the issue with "certain queries", did you notice some pattern of these queries?

Upvotes: 0

Related Questions