Wrapping LLM deployed in azure Databricks

题意:在 Azure Databricks 中部署的 LLM 包装(Wrapping LLM deployed in Azure Databricks)

问题背景:

I have deployed a LLM model on azure databricks. I can access it via the databricks API:

我已经在 Azure Databricks 上部署了一个 LLM(大型语言模型)模型。我可以通过 Databricks API 访问它:

Https://adb-17272728282828282.1.azuredatabricks.net/serving-endpoints/my-code-llama/invocations

I am aware that langchain supports Databricks directly but is it possible to say wrap the databricks cluster in mlflow/openai wrapper or something so that I can use it in langchain like this:

我知道 langchain 直接支持 Databricks,但是是否有可能将 Databricks 集群包装在 mlflow/openai 包装器或其他类似的东西

你可能感兴趣的:(AI,azure,flask,microsoft,langchain,databricks,mlflow)