Howto ramalama: Difference between revisions
Jump to navigation
Jump to search
Mandulete1 (talk | contribs) No edit summary |
Mandulete1 (talk | contribs) |
||
| Line 8: | Line 8: | ||
= usage = | = usage = | ||
set variables: | |||
RAMALAMA_CONTAINER_ENGINE=docker | |||
CUDA_VISIBLE_DEVICES="0" | |||
run model: | run model: | ||
ramalama run granite | ramalama run granite | ||
Revision as of 01:30, 12 August 2025
install
install on fedora:
sudo dnf install python3-ramalama
install via pypi:
pip install ramalama
install script linux/mac:
curl -fsSL https://ramalama.ai/install.sh | bash
usage
set variables:
RAMALAMA_CONTAINER_ENGINE=docker CUDA_VISIBLE_DEVICES="0"
run model:
ramalama run granite