install packages

install nvidia drivers:

https://wiki.vidalinux.org/index.php?title=Howto_install_nvidia_drivers#archlinux

install ollama dependencies:

pacman -S ollama ollama-cuda nvidia-container-toolkit docker docker-compose

ollama

copy systemd ollama daemon to /etc/systemd/system/:

cp /usr/lib/systemd/system/ollama.service /etc/systemd/system/

edit /etc/systemd/system/ollama.service and add the following:

Environment="OLLAMA_HOST=0.0.0.0"

reload systemd daemon:

systemctl daemon-reload

restart ollama.service

systemctl restart ollama.service

verify ollama is listening on all interfaces:

netstat -tnulp|grep 11434

configure ollama api:

http://localhost:11434