Differences

This shows you the differences between two versions of the page.

--- ai:ollama-openwebui [2024/08/01 13:44] – Wulf Rajek
+++ ai:ollama-openwebui [2024/08/08 17:31] (current) – Wulf Rajek
@@ Line 123: / Line 123: @@
             capabilities: [gpu]
 </code>
+https://zohaib.me/extending-openwebui-using-pipelines/
 Under settings->connections set:
@@ Line 263: / Line 266: @@
 </code>
-docker install - WSL2 backend
+Create the respective docker volumes folder:
-cmd line
+<code>
+# p/Docker_Volumes = P:\Docker_Volumes
+mkdir P:\Docker_Volumes
+</code>
+# docker install - choose the WSL2 backend
+# cmd line
 <code>
 docker compose -f docker-openwebui.yml up -d
@@ Line 270: / Line 280: @@
 </code>
-mkdir
-p/Docker_Volumes = P:\Docker_Volumes
 to update all ollama models on windows, use this powershell command - adjust for the hostname/ip ollama is running on:
@@ Line 280: / Line 288: @@
 (Invoke-RestMethod http://localhost:11434/api/tags).Models.Name.ForEach{ docker exex -t ollama ollama pull $_ }
 </code>
+====== Curl OpenAI API test ======
+<code>
+curl http://localhost:11434/v1/chat/completions \
+    -H "Content-Type: application/json" \
+    -d '{
+        "model": "llama3",
+        "messages": [
+            {
+                "role": "system",
+                "content": "You are a helpful assistant."
+            },
+            {
+                "role": "user",
+                "content": "Hello!"
+            }
+        ]
+    }'
+{"id":"chatcmpl-957","object":"chat.completion","created":1722601457,"model":"llama3","system_fingerprint":"fp_ollama","choices":[{"index":0,"message":{"role":"assistant","content":"Hi there! It's great to meet you! I'm here to help with any questions or tasks you might have. What brings you to this virtual space today? Are you looking for recommendations, seeking answers to a specific question, or maybe looking for some inspiration? Let me know, and I'll do my best to assist you."},"finish_reason":"stop"}],"usage":{"prompt_tokens":23,"completion_tokens":68,"total_tokens":91}}
+</code>