cloud/music_library
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Increase response determinism

Browse Source 
- Lower temperature
- Add explicit limit and ordering instructions
This commit is contained in:
Claudio Ortolina
2024-12-10 16:30:51 +03:00
parent 6326948dbf
commit 1cd38e5358
1 changed files with 6 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
experiment.exs
+6 -3
View File
@@ -35,7 +35,8 @@ defmodule OpenAI do
model: "gpt-4o-mini", model: "gpt-4o-mini",
messages: [%{role: "user", content: prompt}], messages: [%{role: "user", content: prompt}],
response_format: %{type: "json_object"}, response_format: %{type: "json_object"},
stream: true stream: true,
temperature: 0.2
}, },
auth: {:bearer, System.fetch_env!("OPENAI_KEY")}, auth: {:bearer, System.fetch_env!("OPENAI_KEY")},
finch_request: fun finch_request: fun
@@ -50,9 +51,11 @@ end
{:ok, collector} = Agent.start_link(fn -> "" end) {:ok, collector} = Agent.start_link(fn -> "" end)
prompt = """ prompt = """
Please provide a list of music genres applicable to the album "Stupid Things that Mean the World" by Tim Bowness. Provide a list of music genres applicable to the album "Stupid Things that Mean the World" by Tim Bowness.
Return the genres as a valid JSON list. Limit the list to 5 genres, ordered by decreasing specificity, all lowercase.
Return a valid JSON list.
""" """
OpenAI.gpt_stream(prompt, fn data -> OpenAI.gpt_stream(prompt, fn data ->