Howto ollama
install packages
- archlinux
install nvidia drivers:
https://wiki.vidalinux.org/index.php?title=Howto_install_nvidia_drivers#archlinux
install ollama dependencies:
pacman -S ollama ollama-cuda nvidia-container-toolkit docker docker-compose
openwebui
configure ollama api:
http://localhost:11434