question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Allow custom semantic backend?

See original GitHub issue

Hi folks, currently semantic kernel only allows us to use either OpenAI or Azure OpenAI as TextCompletion or Embedding backends. Is it possible for your team to add support for a customized TextCompletion backend? It will be helpful for developers who host their own GPT or AICG service.

use case

// my customized semantic backend
ITextCompletionClient myGossipTextClientInstance

IBackendConfig myGossipTextClientConfig

// suggested API to add config to kernel
kernel.Config.AddTextCompletionBackend(myGossipTextClientConfig, myGossipTextClientInstance)

Issue Analytics

  • State:closed
  • Created 6 months ago
  • Comments:5 (1 by maintainers)

github_iconTop GitHub Comments

1reaction
dluccommented, Mar 20, 2023

@LittleLittleCloud as @timlaverty we’re actively working on this.

In the meantime, just in case you are blocked, by the design the kernel allows to plug in any function that implements the ISKFunction interface. So, only if this is urgent, this is one available path to integrate any model not yet supported.

0reactions
evchakicommented, Apr 4, 2023

This is now in the main branch, @LittleLittleCloud thanks for the feedback!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Backends (Company User Manual)
Execute command M-x customize-group RET <backend-name> . ... Having enabled semantic-mode makes it to be used by the CAPF mechanism (see (emacs)Symbol ...
Read more >
Semantic Segmentation with Open3D-ML, PyTorch ...
Semantic Segmentation with Open3D-ML, PyTorch Backend, and a Custom ... Add path to the SemanticKitti dataset and your own custom dataset
Read more >
Building semantic memory with embeddings
Building semantic memory with embeddings · In this article · 1) Import the SDK · 2) Instantiate the kernel with memory · 3)...
Read more >
Custom Backend
Hi, I want to create a custom backend. Any pointers on how to enable this would be great. thanks !! m ... I...
Read more >
How to Configure Custom Fiori App for SAP Transaction ...
Activities to be performed in S/4 (Backend) System. Go to transaction SE93and verify whether the transaction is marked as SAP GUI for HTML....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found