10
$\begingroup$

In the release blog post for v13.3 Stephen Wolfram gives the following example for a Chat-Enabled Notebook.

Wolfram Blog

As it appears there is automatic evaluation, e.g., Used Wolfram Language Evaluator. Working in a new Chat-Enabled Notebook, my attempt to replicate that nice example is not as impressive, e.g., there is no automatic use of an evaluator—instead we need to explicitly call an evaluator using an icon that will pop up when we click on the inside window showing Wolfram Language code.

Replication

While the code works out correctly (giving a slightly different plot), I wonder how automatic evaluation as shown in the blog can be achieved in v13.3?

EDIT

While it is certainly true that we would need to “sandbox” the evaluator to prevent damages to our system as commentators rightly pointed out, one would likely want to have the same user experience as someone using OpenAI’s web interface with the Wolfram PlugIn. The blog post is essentially “selling” that use case implicitly.

NOTE: I crossposted this as an issue in the GitHub repository WolramResearch/Chatbook (here).

$\endgroup$
8
  • 4
    $\begingroup$ I have the same question. Possibly the default is to allow the user to inspect the code before evaluation for performance and/or security reasons. $\endgroup$
    – david
    Commented Jun 29, 2023 at 18:01
  • $\begingroup$ Suppose the generated code is to delete your files...... $\endgroup$
    – Lacia
    Commented Jun 29, 2023 at 18:09
  • 2
    $\begingroup$ @Lacia Good point, but then I would have asked, “FBI is coming, what can I do?”:D $\endgroup$
    – gwr
    Commented Jun 29, 2023 at 18:22
  • 1
    $\begingroup$ @gwr It seems that the evaluation is done by Wolfram`Chatbook`Tools`$defaultChatTools["wolfram_language_evaluator"] which points to the function Wolfram`Chatbook`Tools`Private`sandboxEvaluate . But I have no idea how to automate it. $\endgroup$
    – Lacia
    Commented Jun 29, 2023 at 19:59
  • 3
    $\begingroup$ @gwr Maybe you can open an issue here github.com/WolframResearch/Chatbook/issues $\endgroup$
    – Lacia
    Commented Jun 29, 2023 at 20:03

2 Answers 2

3
$\begingroup$

I will relay Rick Hennigan's answer given on GitHub.

The tools are currently only enabled by default for GPT-4, since GPT-3.5 almost always fails to use them correctly. If you have access to GPT-4 with your API key, you should be able to see outputs like these when using that model. Note that for that particular example, GPT-4 makes a call to the WL evaluator approximately 60% of the time, so it's not guaranteed that you'll see similar results.

If you want to force GPT-3.5 to use tools, you can enable it via the "ToolsEnabled" option when creating the notebook:

CreateNotebook["ChatEnabled", "ToolsEnabled" -> True]

However, GPT-3.5 simply does not understand the tool-calling instructions, so you will not get useful results.

$\endgroup$
8
  • $\begingroup$ Too bad, but currently I only have access to the GPT-3.5 API. Currently, OpenAI's web interface is more useful to me. $\endgroup$
    – gwr
    Commented Jul 3, 2023 at 17:24
  • 1
    $\begingroup$ Thanks. For those wondering how to get GPT-4 the answer is to wait... help.openai.com/en/articles/7102672-how-can-i-access-gpt-4 $\endgroup$ Commented Jul 4, 2023 at 7:06
  • $\begingroup$ I have an account with OpenAI and get access to GPT-4 and all the plugins. However, using e.g. LLMEvaluator -> LLMConfiguration[<|"Model" -> "GPT-4", "Temperature" -> 0.9|>] has no impact. I can use "GPT-4" without any error message but I can also use "GPT-6.5" without any error message. $\endgroup$ Commented Jul 4, 2023 at 7:48
  • 1
    $\begingroup$ @gwr I actually meant that I can use GPT-4 in ChatGPT’s web interface. As pointed out by others "GPT-4" is listed in the "Advanced Settings" but generates an error message. The option "Model" has no effect. Sorry for the confusion. $\endgroup$ Commented Jul 4, 2023 at 8:24
  • 1
    $\begingroup$ @gwr GPT-4 and flavours work since this morning! $\endgroup$ Commented Jul 7, 2023 at 6:08
2
$\begingroup$

The upper response is with Setting GPT-4, the lower with GPT-3.5.

enter image description here

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.