Howto ollama: Difference between revisions
Jump to navigation
Jump to search
Mandulete1 (talk | contribs) |
Mandulete1 (talk | contribs) |
||
| Line 14: | Line 14: | ||
restart ollama.service | restart ollama.service | ||
systemctl restart ollama.service | systemctl restart ollama.service | ||
verify ollama is listening on all interfaces: | |||
netstat -tnulp|grep 11434 | |||
= openwebui = | = openwebui = | ||
configure ollama api: | configure ollama api: | ||
http://localhost:11434 | http://localhost:11434 | ||
Revision as of 17:31, 7 August 2025
install packages
- archlinux
install nvidia drivers:
https://wiki.vidalinux.org/index.php?title=Howto_install_nvidia_drivers#archlinux
install ollama dependencies:
pacman -S ollama ollama-cuda nvidia-container-toolkit docker docker-compose
ollama
copy systemd ollama daemon to /etc/systemd/system/:
cp /usr/lib/systemd/system/ollama.service /etc/systemd/system/
edit /etc/systemd/system/ollama.service and add the following:
Environment="OLLAMA_HOST=0.0.0.0"
reload systemd daemon:
systemctl daemon-reload
restart ollama.service
systemctl restart ollama.service
verify ollama is listening on all interfaces:
netstat -tnulp|grep 11434
openwebui
configure ollama api:
http://localhost:11434