Skip to content

Commit

Permalink
CI: Use TinyLlama for testing
Browse files Browse the repository at this point in the history
  • Loading branch information
ariya committed Mar 4, 2024
1 parent b6398ea commit d12dcad
Show file tree
Hide file tree
Showing 6 changed files with 11 additions and 11 deletions.
12 changes: 6 additions & 6 deletions .github/actions/prepare-llm/action.yml
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
name: Prepare Phi 2
description: Download Phi 2 and launch it
name: Prepare TinyLlama
description: Download TinyLlama and launch it
runs:
using: "composite"
steps:
- name: Download Phi 2 model
- name: Download TinyLlama model
shell: bash
run: curl -OL https://huggingface.co/TheBloke/dolphin-2_6-phi-2-GGUF/resolve/main/dolphin-2_6-phi-2.Q3_K_M.gguf
run: curl -OL https://huggingface.co/TheBloke/TinyLlama-1.1B-1T-OpenOrca-GGUF/resolve/main/tinyllama-1.1b-1t-openorca.Q3_K_M.gguf

- name: Setup binfmt with APE
shell: bash
Expand All @@ -15,9 +15,9 @@ runs:
sudo sh -c "echo ':APE:M::MZqFpD::/usr/bin/ape:' >/proc/sys/fs/binfmt_misc/register"
sudo sh -c "echo ':APE-jart:M::jartsr::/usr/bin/ape:' >/proc/sys/fs/binfmt_misc/register"
- name: Run Phi 2 with Llamafile
- name: Run TinyLlama with Llamafile
shell: bash
run: |
curl -OL https://github.com/Mozilla-Ocho/llamafile/releases/download/0.6.2/llamafile-0.6.2.zip
unzip llamafile-0.6.2.zip
./llamafile-0.6.2/bin/llamafile -m ./dolphin-2_6-phi-2.Q3_K_M.gguf &
./llamafile-0.6.2/bin/llamafile -m ./tinyllama-1.1b-1t-openorca.Q3_K_M.gguf &
2 changes: 1 addition & 1 deletion .github/workflows/test-babashka.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ jobs:

- run: bb --version

- name: Prepare LLM (Phi 2)
- name: Prepare LLM (TinyLlama)
uses: ./.github/actions/prepare-llm

- name: Wait until the LLM server is ready
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-bun.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ jobs:

- run: bun --version

- name: Prepare LLM (Phi 2)
- name: Prepare LLM (TinyLlama)
uses: ./.github/actions/prepare-llm

- name: Wait until the LLM server is ready
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-cpython.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ jobs:
with:
python-version: '3.10'

- name: Prepare LLM (Phi 2)
- name: Prepare LLM (TinyLlama)
uses: ./.github/actions/prepare-llm

- name: Wait until the LLM server is ready
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-nodejs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ jobs:
with:
node-version: '18'

- name: Prepare LLM (Phi 2)
- name: Prepare LLM (TinyLlama)
uses: ./.github/actions/prepare-llm

- name: Wait until the LLM server is ready
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-pypy.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:

- run: pypy3 --version

- name: Prepare LLM (Phi 2)
- name: Prepare LLM (TinyLlama)
uses: ./.github/actions/prepare-llm

- name: Wait until the LLM server is ready
Expand Down

0 comments on commit d12dcad

Please sign in to comment.