http://wuff.dyndns.org/ 2026-04-15T22:45:06+00:00 http://wuff.dyndns.org/ http://wuff.dyndns.org/lib/exe/fetch.php?media=logo.png text/html 2024-04-24T08:23:42+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:ai-desktop-client&rev=1713947022&do=diff AI Desktop Client apt-get install flatpak flatpak install --user https://flathub.org/apps/details/io.github.Bavarder.Bavarder.flatpakref /usr/bin/flatpak run --branch=stable --arch=x86_64 --command=bavarder io.github.Bavarder.Bavarder text/html 2024-08-01T12:47:27+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:base-system&rev=1722516447&do=diff Base AI System install :!: notes only https://www.simplified.guide/ubuntu/remove-snapd sudo systemctl stop snapd sudo apt remove --purge --assume-yes snapd gnome-software-plugin-snap rm -rf ~/snap/ rm -rf /var/cache/snapd/ apt remove squashfs-tools cat << EOD >> /etc/apt/preferences.d/nosnap.pref Package: snapd Pin: release a=* Pin-Priority: -10 EOD sudo apt update Ubuntu Server 22.04 LTS install with third party drivers -------------------------------------------------------- Note: CUDA … text/html 2024-07-23T18:56:31+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:generalinfo&rev=1721760991&do=diff AI Info General info Large language models vs small language models: <https://venturebeat.com/ai/why-small-language-models-are-the-next-big-thing-in-ai/> <https://www.toptal.com/machine-learning/machine-learning-theory-an-introductory-primer> <https://www.databricks.com/glossary/machine-learning-models> <https://www.finextra.com/blogposting/20028/how-is-ai-revolutionizing-fx-market-in-a-way-we-didnt-even-realize> Transformer Model file types: GGUF: binary model format optimised for quick loa… text/html 2024-08-02T16:31:24+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:nl2sql&rev=1722616284&do=diff nl2sql notes: <https://github.com/zylon-ai/private-gpt/pull/1399/files> <https://docs.llamaindex.ai/en/stable/examples/index_structs/struct_indices/SQLIndexDemo/> <https://medium.com/@reddyyashu20/nl2sql-with-llamaindex-querying-databases-using-natural-language-cdd4390cbcd8> <https://arxiv.org/html/2401.02997v1> text/html 2024-08-08T16:31:47+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:ollama-openwebui&rev=1723134707&do=diff Ollama Open-Webui Note: You should have at least 8 GB of RAM available to run the 7B models, 16 GB to run the 13B models, and 32 GB to run the 33B models. Notes only for now: <https://github.com/open-webui/open-webui> <https://docs.openwebui.com/getting-started/env-configuration/#general> Nvidia GPU, linux: mkdir /opt/ollama mkdir /opt/open-webui mkdir /opt/openedai-speech/tts-voices mkdir /opt/openedai-speech/tts-config mkdir /opt/pipelines mkdir /opt/docker-ssl-proxy mkdir /opt/faster-wh… text/html 2024-08-02T14:57:44+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:opendevin&rev=1722610664&do=diff OpenDevin OpenDevin is a platform for autonomous software engineers, powered by AI and LLMs. OpenDevin agents collaborate with human developers to write code, fix bugs, and ship features. <https://github.com/OpenDevin/OpenDevin> <https://docs.all-hands.dev/modules/usage/intro> <https://docs.all-hands.dev/modules/usage/llms/localLLMs> Docker compose file for local setup with separate ollama docker instance. In the current OpenDevin version (0.7), the ollama model needs to be specifically ent… text/html 2024-05-01T16:33:03+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:private-gpt&rev=1714581183&do=diff PrivateGPT Querying own files with GPT locally using any GPT model (Retrieval-augmented generation (RAG)) Supports text formats only (pdf, doc, txt, etc), limited support for tables, but not csv data or large tables. <https://github.com/zylon-ai/private-gpt> CPU only docker Docker version available. text/html 2024-05-02T12:25:34+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:python-nl2sql&rev=1714652734&do=diff Python nl2sql Using a custom OpenAI API compatible LLM to convert natural language to sql in python (other sql engines similar): openai~=1.24.0 SQLAlchemy~=2.0.29 mysql-connector-python~=8.3.0 llama-index-core~=0.10.33 llama-index-embeddings-openai~=0.1.9 llama-index-llms-openai~=0.1.16 llamaindex-py-client~=0.1.19 text/html 2024-07-11T16:51:23+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:ragflow&rev=1720716683&do=diff RagFlow notes: add to /etc/sysctl.conf: vm.max_map_count=262144 sudo sysctl -w vm.max_map_count=262144 git clone https://github.com/infiniflow/ragflow.git cd ragflow/docker chmod +x ./entrypoint.sh adjust docker-compose.yml, add deploy: resources: reservations: devices: - driver: nvidia device_ids: ['0'] capabilities: [gpu] text/html 2025-08-21T13:19:19+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:speech-to-text&rev=1755782359&do=diff Speech to Text OpenAI Whisper <https://github.com/openai/whisper> <https://hub.docker.com/r/fedirz/faster-whisper-server> <https://github.com/speaches-ai/speaches> OpenAI/Whisper example python script with changed base url mkdir transcribe cd transcribe python -m venv venv source venv/bin/activate pip install openai cat >> trans.py << EOD #!/home/user/transcribe/venv/bin/python3 from openai import OpenAI import sys,os def usage(): print("Usage: "+os.path.basename(__file__)+" inputfil… text/html 2024-07-11T12:00:41+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:stable-diffusion&rev=1720699241&do=diff Stable Diffusion Stable Diffusion is an AI model for text to image generation. There are various GUIs available to tweak settings, add specific styles like Disney or photorealistic (Lora models) and help adjusting existing images via picture to picture or selection infill. text/html 2024-04-22T23:35:32+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:start&rev=1713828932&do=diff AI This section contains information about AI, Machine Learning and related topics text/html 2024-08-02T16:31:50+00:00 Anonymous (anonymous@undisclosed.example.com) http://wuff.dyndns.org/doku.php?id=ai:summarization&rev=1722616310&do=diff AI Summarization <https://github.com/matkoson/ai-summarization>