Howto ollama: Difference between revisions
Jump to navigation
Jump to search
Mandulete1 (talk | contribs) |
Mandulete1 (talk | contribs) |
||
| Line 5: | Line 5: | ||
install ollama dependencies: | install ollama dependencies: | ||
pacman -S ollama ollama-cuda nvidia-container-toolkit docker docker-compose | pacman -S ollama ollama-cuda nvidia-container-toolkit docker docker-compose | ||
= ollama = | |||
copy systemd ollama daemon to /etc/systemd/system/: | |||
cp /usr/lib/systemd/system/ollama.service /etc/systemd/system/ | |||
edit /etc/systemd/system/ollama.service and add the following: | |||
Environment="OLLAMA_HOST=0.0.0.0" | |||
reload systemd daemon: | |||
systemd daemon-reload | |||
restart ollama.service | |||
systemd restart ollama.service | |||
= openwebui = | = openwebui = | ||
configure ollama api: | configure ollama api: | ||
http://localhost:11434 | http://localhost:11434 | ||
Revision as of 17:30, 7 August 2025
install packages
- archlinux
install nvidia drivers:
https://wiki.vidalinux.org/index.php?title=Howto_install_nvidia_drivers#archlinux
install ollama dependencies:
pacman -S ollama ollama-cuda nvidia-container-toolkit docker docker-compose
ollama
copy systemd ollama daemon to /etc/systemd/system/:
cp /usr/lib/systemd/system/ollama.service /etc/systemd/system/
edit /etc/systemd/system/ollama.service and add the following:
Environment="OLLAMA_HOST=0.0.0.0"
reload systemd daemon:
systemd daemon-reload
restart ollama.service
systemd restart ollama.service
openwebui
configure ollama api:
http://localhost:11434