[BUG] Not receving knowledge base answers from Custom Question Answering with an Orchestration Workflow using SDK
See original GitHub issueLibrary name and version
Azure.AI.Language.Conversations 1.0.0-beta.3
Describe the bug
When using the ConversationAnalysisClient to retrieve predictions from an Orchestrator connected to a Custom Question Answering (CQA), and giving a valid question message, the result successfully predicts the CQA intent, however the answers collection is empty when it should contain the expected answer of the question.
Expected behavior
As it is documented in GitHub here, if the given question is valid, the Orchestration should return the answer for the question within the prediction result.
Actual behavior
When using the ConversationAnalysisClient and giving a valid question, the prediction is correct but the answers collection is empty.
Reproduction Steps
var endpoint = new Uri(@"https://<language_studio_name>.cognitiveservices.azure.com");
var credential = new AzureKeyCredential("<primary_key>");
var conversationAnalysisClient = new ConversationAnalysisClient(endpoint, credential);
var input = new TextConversationItem(participantId: "1", id: "1", text: message)
{
Language = "es"
};
var opt = new AnalyzeConversationOptions(input);
Response<AnalyzeConversationTaskResult> response =
await _conversationAnalysisClient.AnalyzeConversationAsync(message, _conversationsProject, opt);
var customConversationalTaskResult = response.Value as CustomConversationalTaskResult;
var orchestratorPrediction = customConversationalTaskResult.Results.Prediction as OrchestratorPrediction;
var targetIntentResult = orchestratorPrediction.Intents[orchestratorPrediction.TopIntent];
var questionAnsweringTargetIntentResult = targetIntentResult as QuestionAnsweringTargetIntentResult;
KnowledgeBaseAnswers knowledgeBaseAnswers = questionAnsweringTargetIntentResult.Result;
var answers = knowledgeBaseAnswers.Answers; // THIS IS EMPTY, HOWEVER THERE SHOULD BE ANSWERS!!!
Environment
Windows 10 .NET 6.0 Visual Studio 2022 17.1.5
Issue Analytics
- State:
- Created a year ago
- Reactions:2
- Comments:14 (3 by maintainers)
Top Results From Across the Web
Bot framework SDK NodeJS and Custom Question ...
1 Answer. The BotFramework SDK does not support the new Custom Questions feature yet. This was causing the error. A feature request is...
Read more >Troubleshooting - question answering - Azure AI services
Answer : It's possible that question answering can't auto-extract some question-and-answer (QnA) content from valid FAQ URLs. In such cases, you ...
Read more >Managing access to knowledge bases and ...
Determine whether certain users or categories of users can access knowledge bases and knowledge articles by controlling contribute and read access.
Read more >Knowledge connectors | Dialogflow ES
You can interact with the agent and receive knowledge connector responses via the Dialogflow simulator: Follow the steps above to enable a knowledge...
Read more >Orchestrator Event: Required event payload key or value ...
I have a flow trigger staged on a custom object which stores the orchestrationInstanceId in a custom field. When the orchestration triggers as ......
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Hi @ChongTang!
The issue is fixed. Everything seems to be working as expected. This bug can be closed.
Thank you all for the great support and your help.
@rliberoff, the issue should be fixed. Can you try again?