2026-02-23:22:20:49,920 INFO [__main__.py:279] Verbosity set to INFO 2026-02-23:22:20:56,465 INFO [__main__.py:376] Selected Tasks: ['arc_challenge', 'boolq', 'gsm8k', 'hellaswag', 'mmlu', 'piqa', 'truthfulqa_mc2', 'winogrande'] 2026-02-23:22:20:56,466 INFO [evaluator.py:164] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234 2026-02-23:22:20:56,466 INFO [evaluator.py:201] Initializing hf model, with arguments: {'pretrained': 'strykes/emberforge-3b-reasoner', 'trust_remote_code': True, 'dtype': 'float16'} 2026-02-23:22:20:56,650 INFO [huggingface.py:132] Using device 'cuda:0' 2026-02-23:22:20:59,192 INFO [huggingface.py:369] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'} Downloading shards: 0%| | 0/2 [00:00