Skip to content

tests : refactor test-backend-sampler#18753

Merged
ggerganov merged 6 commits into
masterfrom
gg/ci-bs-simplify
Jan 11, 2026
Merged

tests : refactor test-backend-sampler#18753
ggerganov merged 6 commits into
masterfrom
gg/ci-bs-simplify

Conversation

@ggerganov

Copy link
Copy Markdown
Member

cont #17004
fix #18700 (comment)

The new backend sampler tests have been clogging the ggml-ci recently by adding almost ~10 extra min runtime to some workflows. Optimize and deslop the implementation:

  • Avoid loading the model on every test
  • Better names
  • Better RAII
  • Remove redundant CMake test declarations
  • Add device "auto" - used by default
  • Use smaller Q4_0 model instead of F16

@github-actions github-actions Bot added testing Everything test related devops improvements to build systems and github actions labels Jan 11, 2026
@ggerganov ggerganov merged commit 84ae04f into master Jan 11, 2026
75 of 76 checks passed
@ggerganov ggerganov deleted the gg/ci-bs-simplify branch January 11, 2026 15:31
@CISC

CISC commented Jan 11, 2026

Copy link
Copy Markdown
Member

@reeselevine Broke WebGPU CI since greedy test actively fails now:

static void run_tests(const std::vector<const backend_test_case *> & tests, const test_params & args) {
for (const auto & test : tests) {
fprintf(stderr, "\n=== %s ===\n", test->name.c_str());
try {
test->fn(args);
} catch (const std::exception & e) {
fprintf(stderr, "Error running test '%s': %s\n", test->name.c_str(), e.what());
exit(EXIT_FAILURE);
}
}
}

https://github.com/ggml-org/llama.cpp/actions/runs/20897547250/job/60038427586#step:4:21395

@reeselevine

Copy link
Copy Markdown
Contributor

Looks like we need to implement support for ARGMAX, I'll prioritize this!

gary149 pushed a commit to gary149/llama-agent that referenced this pull request Jan 13, 2026
* tests : use "auto", use std::string

* tests : refactor test-backend-sampler.cpp

* cmake : remove redundant declarations

* ci : use smaller model

* tests : add struct test_params

* tests : reduce logit bias 100.0f -> 10.0f
dillon-blake referenced this pull request in dillon-blake/llama.cpp-BL Jan 15, 2026
* tests : use "auto", use std::string

* tests : refactor test-backend-sampler.cpp

* cmake : remove redundant declarations

* ci : use smaller model

* tests : add struct test_params

* tests : reduce logit bias 100.0f -> 10.0f
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
* tests : use "auto", use std::string

* tests : refactor test-backend-sampler.cpp

* cmake : remove redundant declarations

* ci : use smaller model

* tests : add struct test_params

* tests : reduce logit bias 100.0f -> 10.0f
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
* tests : use "auto", use std::string

* tests : refactor test-backend-sampler.cpp

* cmake : remove redundant declarations

* ci : use smaller model

* tests : add struct test_params

* tests : reduce logit bias 100.0f -> 10.0f
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* tests : use "auto", use std::string

* tests : refactor test-backend-sampler.cpp

* cmake : remove redundant declarations

* ci : use smaller model

* tests : add struct test_params

* tests : reduce logit bias 100.0f -> 10.0f
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* tests : use "auto", use std::string

* tests : refactor test-backend-sampler.cpp

* cmake : remove redundant declarations

* ci : use smaller model

* tests : add struct test_params

* tests : reduce logit bias 100.0f -> 10.0f
phibya pushed a commit to ziee-ai/llama.cpp that referenced this pull request May 29, 2026
* tests : use "auto", use std::string

* tests : refactor test-backend-sampler.cpp

* cmake : remove redundant declarations

* ci : use smaller model

* tests : add struct test_params

* tests : reduce logit bias 100.0f -> 10.0f
fewtarius pushed a commit to fewtarius/CachyLLama that referenced this pull request May 30, 2026
* tests : use "auto", use std::string

* tests : refactor test-backend-sampler.cpp

* cmake : remove redundant declarations

* ci : use smaller model

* tests : add struct test_params

* tests : reduce logit bias 100.0f -> 10.0f
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Jul 5, 2026
* tests : use "auto", use std::string

* tests : refactor test-backend-sampler.cpp

* cmake : remove redundant declarations

* ci : use smaller model

* tests : add struct test_params

* tests : reduce logit bias 100.0f -> 10.0f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

devops improvements to build systems and github actions testing Everything test related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants