Configure custom LLM for posit assistant in R-studio

Posit Assistant
,
1

Hello,
I'm trying to configure posit assitstant in R-studio to work with A version of Claude we have on our azure foundry. I have seen this article: Config File — Posit Assistant

However, it is not entirely clear to me how to setup the settings file correctly for a azure foundry.
So far my settings.json file looks like this - but this doesn't make the LLM available in the Chat.

{
  "providers": {
    "anthropic": {
      "baseUrl": "https://xyz-xyzx-resource.services.ai.azure.com",
      "customHeaders": {
        "api-key": "myapikey"
      }
    }
  }
}

Would be great if someone can share an example settings file that works for them.
Thx

2

The current release of Posit Assistant for RStudio only supports the Posit AI subscription, but this will be changing very soon to support a bunch of "bring your own provider" options, along with the ability to configure your own via the config file.

Very soon being on the order of a week (or a few days).

3

Hi Gary,
with the latest update of posit assistant I see now a ton of LLM options to chose from. Great work! Big thanks a lot to the Posit team.
however, in my particular caseI would like to use a specific model deployed on azure foundry, not the default model -router in foundry.
I have seen that this can be configured for the positron assitstant (Providers – Positron); what would be the equivalent configuration for posit assistant in rstudio ? which config file do I need to change there? and how?

Thanks in advance for your help.

4

That reminded me to open this issue: [Documentation] Document how to configure custom providers for Posit Assistant · Issue #18217 · rstudio/rstudio · GitHub

I'll do some research and get back to you here, hopefully later today.

5

Here's a draft of the docs. These haven't been reviewed yet by the Posit Assistant team, so buyer-beware.

Attaching as a PDF, the new content starts at page 3, "Configuring LLM providers").

posit-ai.pdf (210.5 KB)

6

Thank you Gary, this is already very helpful. Much appreciated.

Just need to figure out now what the equivalent of

"positron.assistant.models.overrides.msFoundry": [
  {
    "name": "gpt-4.1",
    "identifier": "gpt-4.1"
  }
}

is for posit assistant. Or maybe I should just explicitly write ms-foundry as provider and list the available model?
I will try.

Thanks.

7

Also, I just learned about this existing documentation, so I may end up just linking to this from the RStudio docs instead of repeating it:

8

Is you are unable to get it working, I recommend posting an issue at GitHub - posit-dev/assistant-feedback: Repository for feedback on Posit Assistant · GitHub.

That issue list is monitored by the Posit Assistant team (I did the integration of Posit Assistant into RStudio, but am not as familar with the guts of Posit Assistant itself).