Daniel Bevenius e7b6d83b52 tests : filter out no-ops from coverage report (#15900) ...

* tests : filter out no-ops from coverage report

This commit is a follow-up commit for #15745 to address the feedback on
how no-op operations should be filtered out from the coverage report.

The feedback regarding the UNARY and GLU sub-operations not being
handled I not exactly sure what should be done. They are included in the
coverage, for example ABS, ELU, EXP, GELU, GEGLU, GEGLU_ERF etc are in
the list of covered operations:
```console
$ ./build/bin/test-backend-ops --show-coverage
Operations covered by tests (89):
  ✓ ABS
  ✓ ACC
  ✓ ADD
  ✓ ADD1
  ✓ ADD_ID
  ✓ ARANGE
  ✓ ARGMAX
  ✓ ARGSORT
  ✓ CLAMP
  ✓ CONCAT
  ✓ CONV_2D
  ✓ CONV_2D_DW
  ✓ CONV_3D
  ✓ CONV_TRANSPOSE_1D
  ✓ CONV_TRANSPOSE_2D
  ✓ COS
  ✓ COUNT_EQUAL
  ✓ CPY
  ✓ CROSS_ENTROPY_LOSS
  ✓ CROSS_ENTROPY_LOSS_BACK
  ✓ DIAG_MASK_INF
  ✓ DIV
  ✓ DUP
  ✓ ELU
  ✓ EXP
  ✓ FLASH_ATTN_EXT
  ✓ GATED_LINEAR_ATTN
  ✓ GEGLU
  ✓ GEGLU_ERF
  ✓ GEGLU_QUICK
  ✓ GELU
  ✓ GELU_ERF
  ✓ GELU_QUICK
  ✓ GET_ROWS
  ✓ GET_ROWS_BACK
  ✓ GROUP_NORM
  ✓ HARDSIGMOID
  ✓ HARDSWISH
  ✓ IM2COL
  ✓ IM2COL_3D
  ✓ L2_NORM
  ✓ LEAKY_RELU
  ✓ LOG
  ✓ MEAN
  ✓ MUL
  ✓ MUL_MAT
  ✓ MUL_MAT_ID
  ✓ NEG
  ✓ NORM
  ✓ OPT_STEP_ADAMW
  ✓ OPT_STEP_SGD
  ✓ OUT_PROD
  ✓ PAD
  ✓ PAD_REFLECT_1D
  ✓ POOL_2D
  ✓ REGLU
  ✓ RELU
  ✓ REPEAT
  ✓ REPEAT_BACK
  ✓ RMS_NORM
  ✓ RMS_NORM_BACK
  ✓ ROLL
  ✓ ROPE
  ✓ ROPE_BACK
  ✓ RWKV_WKV6
  ✓ RWKV_WKV7
  ✓ SCALE
  ✓ SET
  ✓ SET_ROWS
  ✓ SGN
  ✓ SIGMOID
  ✓ SILU
  ✓ SILU_BACK
  ✓ SIN
  ✓ SOFT_MAX
  ✓ SOFT_MAX_BACK
  ✓ SQR
  ✓ SQRT
  ✓ SSM_CONV
  ✓ SSM_SCAN
  ✓ STEP
  ✓ SUB
  ✓ SUM
  ✓ SUM_ROWS
  ✓ SWIGLU
  ✓ SWIGLU_OAI
  ✓ TANH
  ✓ TIMESTEP_EMBEDDING
  ✓ UPSCALE

Operations without tests (14):
  ✗ ADD_REL_POS
  ✗ CUSTOM
  ✗ DIAG
  ✗ DIAG_MASK_ZERO
  ✗ FLASH_ATTN_BACK
  ✗ GET_REL_POS
  ✗ IM2COL_BACK
  ✗ MAP_CUSTOM1
  ✗ MAP_CUSTOM2
  ✗ MAP_CUSTOM3
  ✗ POOL_1D
  ✗ POOL_2D_BACK
  ✗ WIN_PART
  ✗ WIN_UNPART

Coverage Summary:
  Total operations: 103
  Tested operations: 89
  Untested operations: 14
  Coverage: 86.4%
```

Refs: https://github.com/ggml-org/llama.cpp/pull/15745

* use of ggml_op enum values instead of strcmp

2025-09-10 14:17:09 +02:00

..

.gitignore

gitignore : Ignore vim swap files in tests (#15901)

2025-09-10 14:28:47 +03:00

CMakeLists.txt

finetune: SGD optimizer, more CLI args (#13873)

2025-08-14 12:03:57 +02:00

get-model.cpp

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

get-model.h

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

run-json-schema-to-grammar.mjs

llama : move end-user examples to tools directory (#13249)

2025-05-02 20:27:13 +02:00

test-arg-parser.cpp

tests : avoid github urls due to throttling (#13654)

2025-05-20 12:03:17 +02:00

test-autorelease.cpp

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

test-backend-ops.cpp

tests : filter out no-ops from coverage report (#15900)

2025-09-10 14:17:09 +02:00

test-barrier.cpp

ggml : move CPU backend to a separate file (#10144)

2024-11-03 19:34:08 +01:00

test-c.c

ggml : remove kompute backend (#14501)

2025-07-03 07:48:32 +03:00

test-chat-parser.cpp

chat : Deepseek V3.1 reasoning and tool calling support (OpenAI Style) (#15533)

2025-09-08 16:59:48 +02:00

test-chat-template.cpp

model : add support for Seed-OSS (#15490)

2025-08-23 15:21:52 +02:00

test-chat.cpp

chat : Deepseek V3.1 reasoning and tool calling support (OpenAI Style) (#15533)

2025-09-08 16:59:48 +02:00

test-double-float.cpp

ggml : minor naming changes (#8433)

2024-07-12 10:46:02 +03:00

test-gbnf-validator.cpp

cmake : do not include ./src as public for libllama (#13062)

2025-04-24 16:00:10 +03:00

test-gguf.cpp

gguf: fix failure on version == 0 (#13956)

2025-06-01 18:08:05 +02:00

test-grammar-integration.cpp

sync : vendor (#13901)

2025-05-30 16:25:45 +03:00

test-grammar-llguidance.cpp

cmake : do not include ./src as public for libllama (#13062)

2025-04-24 16:00:10 +03:00

test-grammar-parser.cpp

cmake : do not include ./src as public for libllama (#13062)

2025-04-24 16:00:10 +03:00

test-json-partial.cpp

server: streaming of tool calls and thoughts when --jinja is on (#12379)

2025-05-25 01:48:08 +01:00

test-json-schema-to-grammar.cpp

json : support enum values within allOf (#15830)

2025-09-08 16:14:32 -05:00

test-llama-grammar.cpp

cmake : do not include ./src as public for libllama (#13062)

2025-04-24 16:00:10 +03:00

test-log.cpp

common : use common_ prefix for common library functions (#9805)

2024-10-10 22:57:42 +02:00

test-lora-conversion-inference.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

test-model-load-cancel.cpp

llama : update llama_model API names (#11063)

2025-01-06 10:55:18 +02:00

test-mtmd-c-api.c

mtmd : add C public API (#13184)

2025-05-04 23:43:42 +02:00

test-opt.cpp

tests : fix test-opt with GGML_BACKEND_DL (#15599)

2025-08-26 22:14:38 +02:00

test-quantize-fns.cpp

tests : fix test-quantize-fns to init the CPU backend (#12306)

2025-03-10 14:07:15 +02:00

test-quantize-perf.cpp

ggml : inttypes.h -> cinttypes (#0)

2024-11-17 08:30:29 +02:00

test-quantize-stats.cpp

docker : do not build tests (#13204)

2025-04-30 10:44:07 +02:00

test-regex-partial.cpp

common: add partial regex support (#12808)

2025-05-14 19:50:57 +01:00

test-rope.cpp

llama : add Qwen2VL support + multimodal RoPE (#10361)

2024-12-14 14:43:46 +02:00

test-sampling.cpp

sampling : optimize samplers by reusing bucket sort (#15665)

2025-08-31 20:41:02 +03:00

test-thread-safety.cpp

tests : update for LLAMA_SET_ROWS=1 (#14961)

2025-07-30 15:12:02 +03:00

test-tokenizer-0.cpp

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

test-tokenizer-0.py

py : logging and flake8 suppression refactoring (#7081)

2024-05-05 08:07:48 +03:00

test-tokenizer-0.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

test-tokenizer-1-bpe.cpp

cmake : do not include ./src as public for libllama (#13062)

2025-04-24 16:00:10 +03:00

test-tokenizer-1-spm.cpp

cmake : do not include ./src as public for libllama (#13062)

2025-04-24 16:00:10 +03:00

test-tokenizer-random.py

requirements : update transformers/torch for Embedding Gemma (#15828)

2025-09-09 06:06:52 +02:00

test-tokenizers-repo.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00