ollama
学思创
23
Linux部署
curl -fsSL https://ollama.com/install.sh | sh
默认安装:/usr/local/bin/ollama
模型位置:/usr/share/ollama/.ollama/models/blobs
ollama的服务配置文件:/etc/systemd/system/ollama.service
安装到/usr/local目录下,进入目录/usr/local
cd /usr/local
通过下面命令下载
curl -L https://ollama.com/download/ollama-linux-amd64.tgz -o ollama-linux-amd64.tgz
或其他工具下载后,把ollama-linux-amd64.tgz放在/usr/local目录下
#如果已安装老版本,需要先删除
sudo rm -rf /usr/lib/ollama
解压
sudo tar -C /usr/local -xzf ollama-linux-amd64.tgz
启动
ollama serve
将Ollama添加为启动服务(推荐)
在 /etc/systemd/system/ollama.service 文件中创建一个服务文件(服务配置文件内容):
[Unit]
Description=Ollama Service
After=network-online.target
[Service]
ExecStart=/usr/local/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="OLLAMA_HOST=0.0.0.0:11434 PATH=/root/.nvm/versions/node/v23.11.0/bin:/root/.local/bin:/root/bin:/usr/local/ffmpeg/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin"
[Install]
WantedBy=default.target
注意:默认在Environment中没有“OLLAMA_HOST=0.0.0.0:11434 ”,默认仅本机可访问ollama服务,如需要开放访问可加上;如果在公网最好用nginx代理访问加密码或安装one api(https://github.com/songquanpeng/one-api)代理等等
通过Linux服务管理Ollama
//服务重载
sudo systemctl daemon-reload
//将服务启动
sudo systemctl enable ollama
//重启
sudo systemctl restart ollama
//启动
sudo systemctl start ollama
//状态
sudo systemctl status ollama
//停止
sudo systemctl stop ollama
//禁用
sudo systemctl disable ollama
//编辑服务文件
sudo systemctl edit ollama
卸载
sudo systemctl stop ollama
sudo systemctl disable ollama
sudo rm /etc/systemd/system/ollama.service
查看监听的端口
netstat -ntlp
ss -tuln