Questions tagged [llm]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
0 answers
59 views

Leveraging Mathematica's Capabilities for Building an Advanced Mathematical Database and Theorem Proving Syst [closed]

This is going to be an important and interesting question about the theorem proving capabilities of Mathematica and may be it has been asked before here but with the advent of LLM's the question ...
AgnostMystic's user avatar
1 vote
1 answer
42 views

OpenAI ServiceConnect for `chat` completion API does not properly implement `logprobs` option

According to the OpenAI ServiceConnect documentation, the Chat request supports the option LogProbs (which allows for specifying ...
Joshua Schrier's user avatar
3 votes
0 answers
88 views

How to use GPT-4 vision?

How exactly do you call GPT vision, both programmatically and in chat-enabled notebooks? It seems like the image is being downsized when pasted inline, and it is unclear how many prior cells are in ...
M.R.'s user avatar
  • 31.5k
3 votes
0 answers
41 views

How to import huggingface dataset files?

The .hf file from HuggingFace's datasets library is a very popular format: https://github.com/huggingface/datasets. Is there an easy way to import these from either files on disk or their webportal?
user5601's user avatar
  • 3,583
6 votes
1 answer
209 views

How to set LLMConfiguration Model to Claude 3?

I have an API key, but I'm not sure how to set the default for new chat-enabled notebooks to Claude 3? Is this supported, if not in the UI, what about programatically? Also, I'd like to put my Gemini ...
user5601's user avatar
  • 3,583
9 votes
1 answer
549 views

Do I need a paid OpenAI account to use the LLMFunction?

I tried using the LLMFunction in Mathematica 14.0 using e.g. the example given in its documentation. Before this, I logged into my Wolfram account as suggested by @...
divenex's user avatar
  • 616
1 vote
0 answers
54 views

Can't get my Persona to appear

I am trying to use the new LLM functionality in a Mathematica 13.3 installation. I already got the connection to OpenAI working and can use a chat-driven notebook. My intention at the moment is ...
Jürgen Böhm's user avatar
3 votes
1 answer
132 views

Living or Non-Living?

...
Syed's user avatar
  • 53.7k
2 votes
0 answers
281 views

Using Local LLM Service That Duplicates Open AI API

I have a local service running on https://localhost:PORT/v1 that duplicates the Open AI API functionality available at ...
James Rohal's user avatar
  • 1,404
1 vote
1 answer
2k views

How to set the OpenAI endpoint `OPENAI_API_BASE` for the Chat Notebook?

I have an OpenAI Key associated with a specific OpenAI API Base, such as https://openaiXXX.cloud/v1, instead of the default base ...
Peace Wang's user avatar
2 votes
1 answer
50 views

Problem with setting up ChatObject[]: possible conflict?

Context My naive expectation is that in order to use chat = ChatObject[] in Mathematica 13.3.1 I don't need to have a paid plan with OpenAI. Question Is this ...
chris's user avatar
  • 22.9k
2 votes
0 answers
95 views

Asynchronous parallelization of LLM calls

The new LLM functionality in Mathematica 13.3 is really quite slick. But it is often the case that one wants to apply it to many items in parallel, i.e., to submit many jobs simultaneously. The ...
Joshua Schrier's user avatar
8 votes
2 answers
371 views

Need short summary of 60 Page document using LLMFunctions

Is there any append/chunking solutions for getting OpenAI to summarize docs longer than the input limit through either one large or multiple ChatInput cells or some ...
user5601's user avatar
  • 3,583
4 votes
1 answer
205 views

Q&A System using LLMSynthesize and Nearest

I'm looking for a Wolfram Q&A system that scales to 100k of text documents. Using Mathematica's similarity search (e.g. Nearest) or vector database operations (...
user5601's user avatar
  • 3,583