Howto ollama

From Vidalinux Wiki
Jump to navigation Jump to search

install packages

  • archlinux

install nvidia drivers:

https://wiki.vidalinux.org/index.php?title=Howto_install_nvidia_drivers#archlinux

install ollama dependencies:

pacman -S ollama ollama-cuda nvidia-container-toolkit docker docker-compose

openwebui

configure ollama api:

http://localhost:11434