mcpField
L
local-llm-ops

local-llm-ops

github.com/bobmatnycCloud & DevOps78453 installsUpdated 15w ago
Repository

About local-llm-ops

An Ollama toolchain guide for people running local LLMs on Apple Silicon. It provides setup scripts, command-line chat launchers, benchmarking, and diagnostics for managing local models and checking performance.

Key features

  1. 01Ollama setup scripts
  2. 02Multiple command-line chat launchers
  3. 03Coding, creative, and analytical modes
  4. 04Benchmark workflow
  5. 05Troubleshooting diagnostics

Use cases

  1. 01Set up a local Ollama environment
  2. 02Launch a chat with a selected model
  3. 03Compare model benchmark results
  4. 04Diagnose service or setup problems

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/bobmatnyc/claude-mpm-skills --skill local-llm-ops

After installing, type/local-llm-opsin Claude Code to confirm it loaded.

Bundled filesmetadata.json

Details

From the project README

Local LLM Ops (Ollama)

Overview

Your localLLM repo provides a full local LLM toolchain on Apple Silicon: setup scripts, a rich CLI chat launcher, benchmarks, and diagnostics. The operational path is: install Ollama, ensure the service is running, initialize the venv, pull models, then launch chat or benchmarks.

Quick Start

./setup_chatbot.sh
./chatllm

If no models are present:

ollama pull mistral

Setup Checklist

  1. Install Ollama: brew install ollama
  2. Start the service: brew services start ollama
  3. Run setup: ./setup_chatbot.sh
  4. Verify service: curl http://localhost:11434/api/version

Chat Launchers

  • ./chatllm (primary launcher)
  • ./chat or ./chat.py (alternate launchers)
  • Aliases: ./install_aliases.sh then llm, llm-code, llm-fast

Task modes:

./chat -t coding -m codellama:70b
./chat -t creative -m llama3.1:70b
./chat -t analytical

Benchmark Workflow

Benchmarks are scripted in scripts/run_benchmarks.sh:

./scripts/run_benchmarks.sh

This runs bench_ollama.py with:

  • benchmarks/prompts.yaml
  • benchmarks/models.yaml
  • Multiple runs and max token limits

Diagnostics

Run the built-in diagnostic script when setup fails:

./diagnose.sh

Common fixes:

  • Re-run ./setup_chatbot.sh
  • Ensure ollama is in PATH
  • Pull at least one model: ollama pull mistral

Operational Notes

  • Virtualenv lives in .venv
  • Chat configs and sessions live under ~/.localllm/
  • Ollama API runs at http://localhost:11434

Related Skills

  • toolchains/universal/infrastructure/docker

Comments

Markdown supported