Skip to content

πŸ‘·β€β™‚οΈ llama.cpp web server is added to GitHub Actions workflows #53

πŸ‘·β€β™‚οΈ llama.cpp web server is added to GitHub Actions workflows

πŸ‘·β€β™‚οΈ llama.cpp web server is added to GitHub Actions workflows #53

Workflow file for this run

name: Development
on:
pull_request:
branches:
- "**"
jobs:
unit-tests:
runs-on: ubuntu-latest
strategy:
matrix:
python:
- "3.12"
- "3.8"
steps:
- uses: actions/checkout@v4
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python }}
- name: Install dependencies
run: pip install tox
- name: Run unit tests
run: tox -e test-unit -- -m "smoke or sanity"
integration-tests:
runs-on: macos-latest
strategy:
matrix:
python:
- "3.12"
- "3.8"
steps:
- name: Setup llama.cpp web server
uses: neuralmagic/nm-actions/actions/llama-cpp@main
with:
port: 8080
model: "aminkhalafi/Phi-3-mini-4k-instruct-Q4_K_M-GGUF"
context-size: 2048
- uses: actions/checkout@v4
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python }}
- name: Install dependencies
run: pip install tox
- name: Run integration tests
run: tox -e test-integration -- -m smoke