Yhyu13/LMCocktail-10.7B-v1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
512cc0315f6ec2dfea06e27f7f7c42f34c857c56
LMCocktail-10.7B-v1/alpaca_eval/chatgpt_fn_--SOLAR-10-7B-LMCocktail/alpaca_eval_log.txt
ModelHub XC 512cc0315f 初始化项目，由ModelHub XC社区提供模型 
Model: Yhyu13/LMCocktail-10.7B-v1
Source: Original Platform
2026-05-07 15:59:14 +08:00

3830 lines
318 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

Chunking for generation: 0%| | 0/13 [00:00<?, ?it/s]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 64. Only generating 0 .
INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 64. Only generating 64 .
INFO:root:vllm: loading model: /media/hangyu5/Home/Documents/Hugging-Face/LM_cocktail/LMCocktail-10.7B-v1, tp=2, trust_remote_code=0
2023-12-23 08:57:45,951 INFO worker.py:1673 -- Started a local Ray instance.
INFO 12-23 08:57:46 llm_engine.py:73] Initializing an LLM engine with config: model='/media/hangyu5/Home/Documents/Hugging-Face/LM_cocktail/LMCocktail-10.7B-v1', tokenizer='/media/hangyu5/Home/Documents/Hugging-Face/LM_cocktail/LMCocktail-10.7B-v1', tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=False, dtype=torch.float16, max_seq_len=4096, download_dir=None, load_format=auto, tensor_parallel_size=2, quantization=None, enforce_eager=False, seed=0)
INFO 12-23 08:58:02 llm_engine.py:223] # GPU blocks: 4457, # CPU blocks: 2730
(RayWorkerVllm pid=57929) [W CUDAGraph.cpp:145] Warning: Waiting for pending NCCL work to finish before starting graph capture. (function operator())
(RayWorkerVllm pid=57929) INFO 12-23 08:58:05 model_runner.py:394] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.36s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.36s/it]
(RayWorkerVllm pid=57929) INFO 12-23 08:58:39 model_runner.py:437] Graph capturing finished in 34 secs.
(RayWorkerVllm pid=57928) INFO 12-23 08:58:05 model_runner.py:394] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.40s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.38s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.68s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.61s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.98s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.85s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.85s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.73s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.73s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.25s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.72s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.72s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.71s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.25s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.53s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.43s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.42s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.42s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.13s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.45s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.48s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.99s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.04s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.18s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.00s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.95s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.19s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.27s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.36s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.36s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.53s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.86s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.01s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.01s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.38s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.64s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.21s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.04s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it]
Chunking for generation: 15%|█▌ | 2/13 [07:49<43:04, 234.92s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 128. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.39s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.15s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.15s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.77s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.85s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.85s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.66s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.75s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.75s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.89s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.13s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.08s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.08s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.66s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.90s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.95s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.43s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.86s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.52s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.52s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.54s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.75s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.75s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:23<00:00, 23.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:23<00:00, 23.12s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.64s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.55s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:19<00:00, 19.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:19<00:00, 19.67s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.39s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.67s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.39s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.21s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.86s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.27s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.18s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.24s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.62s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.48s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.39s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.87s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.61s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.80s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.42s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.42s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.91s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.58s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.54s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.05it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.05it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.02s/it]
Chunking for generation: 23%|██▎ | 3/13 [16:30<59:01, 354.16s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 192. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.83s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.71s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.37it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.37it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.31s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.43s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.41s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:32<00:00, 32.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:32<00:00, 32.62s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.60s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.68s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.94s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.14s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.99s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.40s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.71s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.20s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.35s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.35s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.21s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.40s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.50s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.33s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.55s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.72s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.72s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.00s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.06s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.71s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.58s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.32s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.14s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.53s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.48s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.27s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.28s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.22s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.07s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.34s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.62s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.89s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.28s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.76s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.47s/it]
Chunking for generation: 31%|███ | 4/13 [23:50<57:52, 385.86s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 256. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.17s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.51s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.43s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.30it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.30it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.46s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.58s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.83s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.87s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.99s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.94s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.88s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.43s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.70s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.09s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.82s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:26<00:00, 26.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:26<00:00, 26.21s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.84s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.84s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.19s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.43s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.95s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.18s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.31s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.62s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.36s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.36s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.98s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.21s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.45s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.46s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.76s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.13s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.31s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.22s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.27s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.17s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.72s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.72s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.89s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.51s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.13s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.01s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.01s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.40s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.23s/it]
Chunking for generation: 38%|███▊ | 5/13 [32:12<56:51, 426.44s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 320. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.61s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.39s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.56s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.71s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.39s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.88s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.67s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.54s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.82s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.47s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.17s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.47s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.86s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.82s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.41s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.22s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.67s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.38s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.12s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.14s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.31s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.70s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.76s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.00s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.68s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.89s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.16s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.05it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.05it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.69s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.06s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.69s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.41s/it]
Chunking for generation: 46%|████▌ | 6/13 [39:18<49:44, 426.29s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 384. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.73s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.73s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.66s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.32s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.79s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.51s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.04s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.14s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.32s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.04s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.54s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.61s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.21s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.12s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.34s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.80s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:27<00:00, 27.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:27<00:00, 27.13s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.61s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.20s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.41s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.09s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.67s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.33s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.33s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.45s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.61s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.77s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.24s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.56s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.36s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.36s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.80s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.04s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.98s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.13s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.31s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.32s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.62s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.79s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.88s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it]
Chunking for generation: 54%|█████▍ | 7/13 [45:53<41:37, 416.20s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 448. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.44s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.91s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.35s/it]
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.35s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.12s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.94s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.04s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.07s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.83s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.70s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.59s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.16s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.97s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.95s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.14it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.14it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.40it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.40it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.24s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.92s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.61s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.90s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.68s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.50s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.88s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.49s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.19s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.56s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.69s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.07s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.93s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.93s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.60s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.47s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.91s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.69s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.27s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.01s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.01s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.27s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.84s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.84s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.72s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.72s/it]
Chunking for generation: 62%|██████▏ | 8/13 [51:36<32:45, 393.15s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 512. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.29s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.29s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.86s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.94s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.69s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.27s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.56s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.55s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.20s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:53<00:00, 53.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:53<00:00, 53.91s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.38s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.34s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.16s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.16s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.92s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.92s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.67it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.67it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.48s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.25s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.80it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.80it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.44s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.66s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.03it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.03it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.35s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.35s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.96s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.85s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.85s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.17s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.40s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.08s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.08s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.55s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.67s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.28s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.79s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.15s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.15s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.18s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.22s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.99s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.83s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.55s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.61s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.27s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.69s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it]
Chunking for generation: 69%|██████▉ | 9/13 [58:17<26:22, 395.73s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 576. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.39s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.09s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.95s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.35s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.36s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.79s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.81s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.62s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.62s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.51s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.50s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.64s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.49s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 8.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 8.00s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.31s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.25s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.30it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.30it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.88s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.09s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.94s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.96s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.29s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.29s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.99s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.80s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.99s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.51s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.82s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.45s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.37s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.10s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.10s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.73s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.73s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.99s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.83s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.44it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.44it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.39s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.49s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.54s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.33s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.33s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.00it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.00it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.31s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.62s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.49it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.48it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.00it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.00it/s]
Chunking for generation: 77%|███████▋ | 10/13 [1:04:30<19:25, 388.50s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 640. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.98it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.98it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.93s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.93s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.91s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.06s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.41s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.53s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.74s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.74it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.74it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.45s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.75s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.75s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.27it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.26it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.06it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.06it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.80s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.19s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.43it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.43it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.61it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.61it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.54it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.53it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:51<00:00, 51.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:51<00:00, 51.11s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.58s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.07it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.07it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.20it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.20it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.52it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.52it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.21it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.21it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.95it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.95it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.05it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.04it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.71it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.71it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.87s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.45it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.45it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.07s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.31s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.08s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.08s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.69s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.95s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.87s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.09s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.52s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.52s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.69it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.69it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.92s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.19s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.53s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.82s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.60s/it]
Chunking for generation: 85%|████████▍ | 11/13 [1:08:47<11:36, 348.42s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 704. Only generating 64 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.59s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.97s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.15s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.15s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.01it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.01it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.22s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.41s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.61it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.61it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.81s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.51it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.51it/s]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.54s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.19s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.43s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.29s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.29s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.83s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.53s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.63s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.63s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.04s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.25s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.64s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.69s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.44s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.32s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.22s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.98s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.44s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.12s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.12s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.14s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.95s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.83s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.70s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.81s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.15s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.15s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.22s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.40s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.07s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.30s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.28s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.90s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.41s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.84s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.84s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.65s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.23s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.70s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.32s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.53s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.49s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.57s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.86s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.79s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.98s/it]
Chunking for generation: 92%|█████████▏| 12/13 [1:15:10<05:59, 359.02s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 768. Only generating 37 .
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.28s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.12s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.07s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.27s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.91s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.90s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.61s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.96s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.86s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.25s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.60s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.03s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.63s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.54s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.89s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.16s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.97s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.93s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.93s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.16s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.94s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.89s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.94s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.71s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:21<00:00, 21.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:21<00:00, 21.78s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.39s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 9.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 9.00s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.07s/it]
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.05s/it]
Chunking for generation: 100%|██████████| 13/13 [1:20:27<00:00, 346.18s/it]
Chunking for generation: 100%|██████████| 13/13 [1:20:27<00:00, 371.32s/it]
INFO:root:Evaluating the SOLAR-10.7B-LMCocktail outputs.
INFO:root:Creating the annotator from `chatgpt_fn`.
INFO:root:Saving annotations to `/home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json`.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
https://api.openai-proxy.org/v1
Annotation chunk: 0%| | 0/7 [00:00<?, ?it/s]INFO:root:Annotating 128 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
prompt_batches: 0%| | 0/128 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 1%| | 1/128 [00:01<02:22, 1.12s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 2%|▏ | 2/128 [00:01<01:17, 1.62it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 5%|▍ | 6/128 [00:02<00:34, 3.50it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 5%|▌ | 7/128 [00:02<00:31, 3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 6%|▋ | 8/128 [00:03<00:48, 2.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 9%|▉ | 12/128 [00:03<00:25, 4.51it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 12%|█▏ | 15/128 [00:04<00:29, 3.79it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 14%|█▍ | 18/128 [00:04<00:20, 5.46it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▌ | 20/128 [00:05<00:21, 4.96it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▋ | 21/128 [00:05<00:24, 4.38it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 17%|█▋ | 22/128 [00:05<00:23, 4.51it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 19%|█▉ | 24/128 [00:05<00:17, 5.87it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 20%|█▉ | 25/128 [00:06<00:22, 4.64it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 20%|██ | 26/128 [00:06<00:24, 4.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 21%|██ | 27/128 [00:06<00:24, 4.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 22%|██▏ | 28/128 [00:06<00:21, 4.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 23%|██▎ | 30/128 [00:07<00:29, 3.29it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 27%|██▋ | 34/128 [00:08<00:16, 5.73it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 27%|██▋ | 35/128 [00:08<00:26, 3.46it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 29%|██▉ | 37/128 [00:09<00:19, 4.66it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 30%|███ | 39/128 [00:09<00:15, 5.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 32%|███▏ | 41/128 [00:10<00:21, 4.05it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 34%|███▍ | 44/128 [00:10<00:14, 5.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 36%|███▌ | 46/128 [00:11<00:26, 3.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 39%|███▉ | 50/128 [00:12<00:18, 4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 40%|███▉ | 51/128 [00:12<00:17, 4.39it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 41%|████▏ | 53/128 [00:12<00:15, 4.96it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 43%|████▎ | 55/128 [00:13<00:16, 4.52it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 44%|████▍ | 56/128 [00:13<00:15, 4.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 45%|████▍ | 57/128 [00:13<00:16, 4.25it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 46%|████▌ | 59/128 [00:13<00:12, 5.39it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 47%|████▋ | 60/128 [00:14<00:14, 4.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 48%|████▊ | 61/128 [00:14<00:15, 4.29it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 48%|████▊ | 62/128 [00:14<00:15, 4.19it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 50%|█████ | 64/128 [00:14<00:11, 5.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 51%|█████ | 65/128 [00:15<00:14, 4.40it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 52%|█████▏ | 66/128 [00:15<00:14, 4.42it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 52%|█████▏ | 67/128 [00:15<00:14, 4.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 54%|█████▍ | 69/128 [00:16<00:12, 4.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 55%|█████▍ | 70/128 [00:16<00:14, 4.06it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 56%|█████▋ | 72/128 [00:16<00:10, 5.16it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 58%|█████▊ | 74/128 [00:17<00:10, 5.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 59%|█████▊ | 75/128 [00:17<00:12, 4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 60%|██████ | 77/128 [00:17<00:08, 5.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 61%|██████ | 78/128 [00:17<00:09, 5.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 62%|██████▏ | 79/128 [00:18<00:10, 4.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 62%|██████▎ | 80/128 [00:18<00:11, 4.26it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 63%|██████▎ | 81/128 [00:18<00:09, 4.85it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 64%|██████▍ | 82/128 [00:18<00:10, 4.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 65%|██████▍ | 83/128 [00:19<00:12, 3.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 66%|██████▋ | 85/128 [00:19<00:08, 4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 67%|██████▋ | 86/128 [00:19<00:08, 5.14it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 68%|██████▊ | 87/128 [00:20<00:09, 4.15it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 69%|██████▉ | 88/128 [00:20<00:10, 4.00it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 70%|███████ | 90/128 [00:20<00:08, 4.64it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 71%|███████ | 91/128 [00:20<00:07, 4.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 72%|███████▏ | 92/128 [00:21<00:07, 5.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 73%|███████▎ | 93/128 [00:21<00:07, 4.42it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 74%|███████▍ | 95/128 [00:21<00:06, 5.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 75%|███████▌ | 96/128 [00:21<00:07, 4.20it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 76%|███████▌ | 97/128 [00:22<00:06, 4.83it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 77%|███████▋ | 98/128 [00:22<00:08, 3.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 79%|███████▉ | 101/128 [00:22<00:05, 5.07it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 80%|███████▉ | 102/128 [00:23<00:05, 4.95it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 80%|████████ | 103/128 [00:23<00:05, 4.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 81%|████████▏ | 104/128 [00:23<00:05, 4.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 82%|████████▏ | 105/128 [00:23<00:05, 4.56it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 83%|████████▎ | 106/128 [00:24<00:04, 5.07it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 84%|████████▎ | 107/128 [00:24<00:03, 5.45it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 84%|████████▍ | 108/128 [00:24<00:04, 4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 85%|████████▌ | 109/128 [00:24<00:04, 4.40it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 86%|████████▌ | 110/128 [00:24<00:03, 5.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 87%|████████▋ | 111/128 [00:25<00:03, 4.50it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 88%|████████▊ | 112/128 [00:25<00:03, 4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 88%|████████▊ | 113/128 [00:25<00:03, 4.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 89%|████████▉ | 114/128 [00:25<00:02, 4.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 90%|████████▉ | 115/128 [00:26<00:03, 3.93it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 91%|█████████ | 116/128 [00:26<00:03, 4.00it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 92%|█████████▏| 118/128 [00:26<00:02, 4.24it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 94%|█████████▍| 120/128 [00:27<00:01, 4.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 95%|█████████▌| 122/128 [00:27<00:01, 4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 96%|█████████▌| 123/128 [00:28<00:01, 3.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 98%|█████████▊| 125/128 [00:28<00:00, 4.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 99%|█████████▉| 127/128 [00:28<00:00, 4.56it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 100%|██████████| 128/128 [00:29<00:00, 4.50it/s]
prompt_batches: 100%|██████████| 128/128 [00:29<00:00, 4.39it/s]
*** SIGTERM received at time=1703326722 on cpu 18 ***
PC: @ 0x5547b8 (unknown) _PyObject_VectorcallTstate.lto_priv.14
@ 0x7fb277d26520 96618656 (unknown)
@ 0x7fb27745d200 (unknown) (unknown)
@ 0x869d20 (unknown) (unknown)
[2023-12-23 10:18:42,710 E 206008 55975] logging.cc:361: *** SIGTERM received at time=1703326722 on cpu 18 ***
[2023-12-23 10:18:42,710 E 206008 55975] logging.cc:361: PC: @ 0x5547b8 (unknown) _PyObject_VectorcallTstate.lto_priv.14
[2023-12-23 10:18:42,712 E 206008 55975] logging.cc:361: @ 0x7fb277d26520 96618656 (unknown)
[2023-12-23 10:18:42,714 E 206008 55975] logging.cc:361: @ 0x7fb27745d200 (unknown) (unknown)
[2023-12-23 10:18:42,719 E 206008 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
INFO:root:Completed 128 examples in 29.3 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
Annotation chunk: 14%|█▍ | 1/7 [00:29<02:58, 29.67s/it]INFO:root:Annotating 128 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
prompt_batches: 0%| | 0/128 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 1%| | 1/128 [00:01<02:53, 1.37s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 3%|▎ | 4/128 [00:01<00:42, 2.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 5%|▍ | 6/128 [00:02<00:43, 2.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 5%|▌ | 7/128 [00:02<00:36, 3.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 9%|▊ | 11/128 [00:03<00:29, 3.99it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 10%|█ | 13/128 [00:03<00:28, 4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 12%|█▎ | 16/128 [00:04<00:24, 4.58it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 14%|█▍ | 18/128 [00:04<00:22, 4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 15%|█▍ | 19/128 [00:05<00:24, 4.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▌ | 20/128 [00:05<00:23, 4.65it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▋ | 21/128 [00:05<00:20, 5.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 17%|█▋ | 22/128 [00:05<00:25, 4.19it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 18%|█▊ | 23/128 [00:07<01:01, 1.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 23%|██▎ | 30/128 [00:08<00:23, 4.20it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 25%|██▌ | 32/128 [00:08<00:20, 4.73it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 26%|██▌ | 33/128 [00:08<00:20, 4.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 27%|██▋ | 35/128 [00:09<00:21, 4.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 29%|██▉ | 37/128 [00:09<00:21, 4.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 30%|███ | 39/128 [00:09<00:18, 4.79it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 31%|███▏ | 40/128 [00:10<00:21, 4.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 33%|███▎ | 42/128 [00:10<00:22, 3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 34%|███▍ | 44/128 [00:11<00:20, 4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 36%|███▌ | 46/128 [00:11<00:15, 5.19it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 37%|███▋ | 47/128 [00:11<00:18, 4.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 38%|███▊ | 48/128 [00:12<00:20, 3.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 38%|███▊ | 49/128 [00:12<00:17, 4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 41%|████ | 52/128 [00:12<00:14, 5.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 41%|████▏ | 53/128 [00:13<00:18, 4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 42%|████▏ | 54/128 [00:13<00:17, 4.22it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 43%|████▎ | 55/128 [00:13<00:15, 4.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 45%|████▍ | 57/128 [00:14<00:15, 4.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 45%|████▌ | 58/128 [00:14<00:14, 4.77it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 46%|████▌ | 59/128 [00:14<00:15, 4.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 48%|████▊ | 61/128 [00:14<00:13, 4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 48%|████▊ | 62/128 [00:15<00:16, 3.93it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 50%|█████ | 64/128 [00:15<00:16, 3.89it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 52%|█████▏ | 66/128 [00:15<00:11, 5.46it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 52%|█████▏ | 67/128 [00:16<00:15, 3.86it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 53%|█████▎ | 68/128 [00:16<00:16, 3.66it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 55%|█████▌ | 71/128 [00:16<00:09, 6.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 56%|█████▋ | 72/128 [00:17<00:15, 3.69it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 57%|█████▋ | 73/128 [00:17<00:13, 4.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 58%|█████▊ | 74/128 [00:17<00:12, 4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 60%|██████ | 77/128 [00:18<00:12, 4.12it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 61%|██████ | 78/128 [00:19<00:12, 3.98it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 64%|██████▍ | 82/128 [00:19<00:10, 4.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 65%|██████▍ | 83/128 [00:20<00:09, 4.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 66%|██████▌ | 84/128 [00:20<00:08, 4.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 66%|██████▋ | 85/128 [00:20<00:08, 5.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 68%|██████▊ | 87/128 [00:20<00:10, 4.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 70%|███████ | 90/128 [00:21<00:07, 4.81it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 72%|███████▏ | 92/128 [00:22<00:09, 3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 74%|███████▍ | 95/128 [00:22<00:05, 5.51it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 75%|███████▌ | 96/128 [00:22<00:06, 4.99it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 76%|███████▌ | 97/128 [00:23<00:07, 4.38it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 77%|███████▋ | 98/128 [00:23<00:06, 4.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 78%|███████▊ | 100/128 [00:23<00:05, 4.80it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 80%|███████▉ | 102/128 [00:24<00:06, 4.27it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 80%|████████ | 103/128 [00:24<00:06, 4.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 82%|████████▏ | 105/128 [00:24<00:04, 5.39it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 83%|████████▎ | 106/128 [00:24<00:03, 5.80it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 84%|████████▎ | 107/128 [00:25<00:05, 4.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 85%|████████▌ | 109/128 [00:25<00:03, 5.15it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 86%|████████▌ | 110/128 [00:25<00:03, 5.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 87%|████████▋ | 111/128 [00:26<00:04, 3.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 88%|████████▊ | 112/128 [00:26<00:03, 4.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 88%|████████▊ | 113/128 [00:26<00:02, 5.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 89%|████████▉ | 114/128 [00:26<00:02, 4.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 90%|████████▉ | 115/128 [00:26<00:02, 5.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 91%|█████████ | 116/128 [00:27<00:02, 4.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 91%|█████████▏| 117/128 [00:27<00:02, 4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 93%|█████████▎| 119/128 [00:27<00:01, 4.69it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 94%|█████████▍| 120/128 [00:27<00:01, 5.35it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 95%|█████████▍| 121/128 [00:28<00:01, 4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 95%|█████████▌| 122/128 [00:28<00:01, 3.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 97%|█████████▋| 124/128 [00:29<00:01, 3.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 99%|█████████▉| 127/128 [00:29<00:00, 4.23it/s]
prompt_batches: 100%|██████████| 128/128 [00:29<00:00, 4.29it/s]
INFO:root:Completed 128 examples in 29.9 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
Annotation chunk: 29%|██▊ | 2/7 [01:00<02:30, 30.06s/it]INFO:root:Annotating 128 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
prompt_batches: 0%| | 0/128 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 1%| | 1/128 [00:01<02:54, 1.37s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 5%|▍ | 6/128 [00:02<00:36, 3.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 5%|▌ | 7/128 [00:02<00:32, 3.69it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 7%|▋ | 9/128 [00:02<00:23, 5.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 8%|▊ | 10/128 [00:02<00:22, 5.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 9%|▊ | 11/128 [00:03<00:31, 3.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 9%|▉ | 12/128 [00:03<00:36, 3.15it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 12%|█▏ | 15/128 [00:03<00:21, 5.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 12%|█▎ | 16/128 [00:04<00:25, 4.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 13%|█▎ | 17/128 [00:04<00:24, 4.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 14%|█▍ | 18/128 [00:04<00:24, 4.55it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▌ | 20/128 [00:04<00:19, 5.45it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▋ | 21/128 [00:05<00:27, 3.84it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 18%|█▊ | 23/128 [00:05<00:22, 4.62it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 20%|█▉ | 25/128 [00:06<00:21, 4.84it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 20%|██ | 26/128 [00:06<00:23, 4.38it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 21%|██ | 27/128 [00:06<00:25, 3.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 22%|██▏ | 28/128 [00:07<00:27, 3.67it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 24%|██▍ | 31/128 [00:07<00:19, 5.09it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 25%|██▌ | 32/128 [00:07<00:20, 4.61it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 27%|██▋ | 34/128 [00:08<00:23, 3.94it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 28%|██▊ | 36/128 [00:08<00:21, 4.27it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 30%|██▉ | 38/128 [00:09<00:19, 4.70it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 31%|███▏ | 40/128 [00:12<00:55, 1.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 38%|███▊ | 49/128 [00:12<00:17, 4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 41%|████ | 52/128 [00:12<00:13, 5.80it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 43%|████▎ | 55/128 [00:13<00:16, 4.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 45%|████▌ | 58/128 [00:14<00:17, 4.05it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 47%|████▋ | 60/128 [00:14<00:14, 4.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 49%|████▉ | 63/128 [00:16<00:24, 2.68it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 55%|█████▍ | 70/128 [00:17<00:11, 4.87it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 56%|█████▋ | 72/128 [00:17<00:12, 4.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 58%|█████▊ | 74/128 [00:18<00:12, 4.40it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 59%|█████▉ | 76/128 [00:18<00:12, 4.09it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 60%|██████ | 77/128 [00:19<00:12, 4.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 61%|██████ | 78/128 [00:19<00:12, 3.85it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 63%|██████▎ | 81/128 [00:19<00:10, 4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 64%|██████▍ | 82/128 [00:20<00:09, 4.65it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 65%|██████▍ | 83/128 [00:20<00:09, 4.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 66%|██████▌ | 84/128 [00:20<00:08, 4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 66%|██████▋ | 85/128 [00:20<00:09, 4.61it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 67%|██████▋ | 86/128 [00:20<00:08, 5.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 68%|██████▊ | 87/128 [00:21<00:08, 4.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 69%|██████▉ | 88/128 [00:21<00:08, 4.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 70%|██████▉ | 89/128 [00:21<00:07, 5.32it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 70%|███████ | 90/128 [00:21<00:10, 3.52it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 73%|███████▎ | 93/128 [00:22<00:09, 3.72it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 73%|███████▎ | 94/128 [00:22<00:08, 4.19it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 74%|███████▍ | 95/128 [00:23<00:09, 3.45it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 77%|███████▋ | 98/128 [00:23<00:07, 4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 77%|███████▋ | 99/128 [00:23<00:06, 4.73it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 78%|███████▊ | 100/128 [00:24<00:06, 4.66it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 79%|███████▉ | 101/128 [00:24<00:05, 4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 80%|████████ | 103/128 [00:25<00:06, 3.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 82%|████████▏ | 105/128 [00:25<00:04, 4.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 83%|████████▎ | 106/128 [00:25<00:04, 4.79it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 84%|████████▎ | 107/128 [00:25<00:03, 5.44it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 84%|████████▍ | 108/128 [00:25<00:04, 4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 85%|████████▌ | 109/128 [00:26<00:03, 5.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 86%|████████▌ | 110/128 [00:26<00:03, 5.12it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 87%|████████▋ | 111/128 [00:26<00:03, 4.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 88%|████████▊ | 112/128 [00:26<00:02, 5.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 88%|████████▊ | 113/128 [00:27<00:03, 3.96it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 90%|████████▉ | 115/128 [00:27<00:02, 5.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 91%|█████████ | 116/128 [00:27<00:02, 4.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 91%|█████████▏| 117/128 [00:27<00:02, 4.38it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 92%|█████████▏| 118/128 [00:28<00:02, 3.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 95%|█████████▍| 121/128 [00:28<00:01, 5.55it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 95%|█████████▌| 122/128 [00:28<00:01, 5.33it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 96%|█████████▌| 123/128 [00:29<00:01, 4.04it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 97%|█████████▋| 124/128 [00:29<00:00, 4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 98%|█████████▊| 125/128 [00:29<00:00, 4.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 99%|█████████▉| 127/128 [00:29<00:00, 5.16it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 100%|██████████| 128/128 [00:30<00:00, 3.62it/s]
prompt_batches: 100%|██████████| 128/128 [00:30<00:00, 4.21it/s]
INFO:root:Completed 128 examples in 30.5 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
Annotation chunk: 43%|████▎ | 3/7 [01:30<02:01, 30.44s/it]INFO:root:Annotating 127 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 127 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
prompt_batches: 0%| | 0/127 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 1%| | 1/127 [00:01<02:13, 1.06s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 2%|▏ | 3/127 [00:01<00:41, 2.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 5%|▍ | 6/127 [00:02<00:40, 2.96it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 8%|▊ | 10/127 [00:02<00:20, 5.64it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 9%|▉ | 12/127 [00:03<00:28, 4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 10%|█ | 13/127 [00:03<00:29, 3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 13%|█▎ | 16/127 [00:04<00:26, 4.21it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 13%|█▎ | 17/127 [00:04<00:27, 4.05it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▌ | 20/127 [00:04<00:17, 6.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 17%|█▋ | 22/127 [00:05<00:26, 4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 18%|█▊ | 23/127 [00:05<00:24, 4.22it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 20%|██ | 26/127 [00:06<00:24, 4.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 21%|██▏ | 27/127 [00:06<00:22, 4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 22%|██▏ | 28/127 [00:06<00:20, 4.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 24%|██▎ | 30/127 [00:06<00:16, 5.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 24%|██▍ | 31/127 [00:07<00:24, 3.95it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 25%|██▌ | 32/127 [00:07<00:27, 3.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 28%|██▊ | 35/127 [00:08<00:16, 5.42it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 28%|██▊ | 36/127 [00:08<00:20, 4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 29%|██▉ | 37/127 [00:08<00:21, 4.22it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 30%|██▉ | 38/127 [00:09<00:26, 3.42it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 32%|███▏ | 41/127 [00:09<00:15, 5.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 33%|███▎ | 42/127 [00:09<00:16, 5.04it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 34%|███▍ | 43/127 [00:10<00:26, 3.23it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 36%|███▌ | 46/127 [00:10<00:16, 4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 38%|███▊ | 48/127 [00:11<00:23, 3.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 42%|████▏ | 53/127 [00:12<00:19, 3.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 46%|████▌ | 58/127 [00:13<00:15, 4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 46%|████▋ | 59/127 [00:14<00:15, 4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 50%|████▉ | 63/127 [00:14<00:13, 4.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 51%|█████ | 65/127 [00:14<00:11, 5.44it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 52%|█████▏ | 66/127 [00:15<00:10, 5.56it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:openai._base_client:Retrying request to /chat/completions in 0.939927 seconds
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 54%|█████▎ | 68/127 [00:21<01:02, 1.06s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 68%|██████▊ | 86/127 [00:22<00:09, 4.15it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 70%|███████ | 89/127 [00:22<00:09, 4.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 72%|███████▏ | 92/127 [00:23<00:07, 4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 74%|███████▍ | 94/127 [00:23<00:07, 4.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 76%|███████▌ | 96/127 [00:24<00:06, 4.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 77%|███████▋ | 98/127 [00:24<00:05, 5.36it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 79%|███████▊ | 100/127 [00:25<00:09, 2.99it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 82%|████████▏ | 104/127 [00:26<00:05, 4.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 84%|████████▍ | 107/127 [00:26<00:03, 5.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 86%|████████▌ | 109/127 [00:27<00:04, 4.29it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 87%|████████▋ | 110/127 [00:27<00:03, 4.29it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 89%|████████▉ | 113/127 [00:28<00:03, 3.85it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 92%|█████████▏| 117/127 [00:28<00:01, 5.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 93%|█████████▎| 118/127 [00:29<00:02, 4.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 94%|█████████▎| 119/127 [00:30<00:02, 2.81it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 98%|█████████▊| 124/127 [00:30<00:00, 5.44it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 99%|█████████▉| 126/127 [00:30<00:00, 4.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 100%|██████████| 127/127 [00:31<00:00, 4.07it/s]
*** SIGTERM received at time=1703326815 on cpu 43 ***
PC: @ 0x5138fa (unknown) _PyEval_EvalFrameDefault
@ 0x7fb277d26520 96618512 (unknown)
@ 0x7fb277426740 (unknown) (unknown)
@ 0x869d20 (unknown) (unknown)
[2023-12-23 10:20:15,631 E 209804 55975] logging.cc:361: *** SIGTERM received at time=1703326815 on cpu 43 ***
[2023-12-23 10:20:15,631 E 209804 55975] logging.cc:361: PC: @ 0x5138fa (unknown) _PyEval_EvalFrameDefault
[2023-12-23 10:20:15,633 E 209804 55975] logging.cc:361: @ 0x7fb277d26520 96618512 (unknown)
[2023-12-23 10:20:15,635 E 209804 55975] logging.cc:361: @ 0x7fb277426740 (unknown) (unknown)
[2023-12-23 10:20:15,640 E 209804 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
INFO:root:Completed 127 examples in 31.3 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
Annotation chunk: 57%|█████▋ | 4/7 [02:02<01:32, 30.94s/it]INFO:root:Annotating 128 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
prompt_batches: 0%| | 0/128 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 1%| | 1/128 [00:01<02:54, 1.38s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 5%|▍ | 6/128 [00:02<00:35, 3.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 5%|▌ | 7/128 [00:02<00:34, 3.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 8%|▊ | 10/128 [00:02<00:20, 5.69it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 9%|▉ | 12/128 [00:03<00:36, 3.20it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 12%|█▎ | 16/128 [00:04<00:26, 4.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 13%|█▎ | 17/128 [00:04<00:26, 4.16it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▌ | 20/128 [00:04<00:20, 5.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▋ | 21/128 [00:05<00:29, 3.62it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 20%|█▉ | 25/128 [00:06<00:20, 5.00it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 20%|██ | 26/128 [00:06<00:22, 4.58it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 21%|██ | 27/128 [00:06<00:25, 4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 23%|██▎ | 30/128 [00:07<00:18, 5.43it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
INFO:root:Max rate limit reached.
prompt_batches: 24%|██▍ | 31/128 [01:21<20:26, 12.65s/it]
prompt_batches: 100%|██████████| 128/128 [01:21<00:00, 1.56it/s]
*** SIGTERM received at time=1703326898 on cpu 6 ***
*** SIGTERM received at time=1703326898 on cpu 8 ***
PC: @ 0x50f2b9 (unknown) _PyEval_EvalFrameDefault
@ 0x7fb277d26520 (unknown) (unknown)
PC: @ 0x50fdd5 (unknown) _PyEval_EvalFrameDefault
@ 0x7fb277d26520 96618360 (unknown)
@ 0x7fb2770c16c0 965637776 (unknown)
@ 0x7fb277426740 (unknown) (unknown)
@ 0x869d20 (unknown) (unknown)
[2023-12-23 10:21:38,138 E 211132 55975] logging.cc:361: *** SIGTERM received at time=1703326898 on cpu 6 ***
[2023-12-23 10:21:38,138 E 211132 55975] logging.cc:361: PC: @ 0x50f2b9 (unknown) _PyEval_EvalFrameDefault
[2023-12-23 10:21:38,141 E 211132 55975] logging.cc:361: @ 0x7fb277d26520 (unknown) (unknown)
[2023-12-23 10:21:38,143 E 211132 55975] logging.cc:361: @ 0x7fb2770c16c0 965637776 (unknown)
@ 0x869d20 (unknown) (unknown)
[2023-12-23 10:21:38,144 E 211134 55975] logging.cc:361: *** SIGTERM received at time=1703326898 on cpu 8 ***
[2023-12-23 10:21:38,144 E 211134 55975] logging.cc:361: PC: @ 0x50fdd5 (unknown) _PyEval_EvalFrameDefault
[2023-12-23 10:21:38,147 E 211134 55975] logging.cc:361: @ 0x7fb277d26520 96618360 (unknown)
[2023-12-23 10:21:38,147 E 211132 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
[2023-12-23 10:21:38,151 E 211134 55975] logging.cc:361: @ 0x7fb277426740 (unknown) (unknown)
[2023-12-23 10:21:38,157 E 211134 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
INFO:root:Completed 128 examples in 82.1 seconds.
WARNING:root:Found 0 annotations in:'''
''' but expected 1. We are setting all annotations to None.
WARNING:root:1 samples had no auto annotation. We are filtering them for now. If you are using chain of thought it might be that max_tokens limit is too low.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
Annotation chunk: 71%|███████▏ | 5/7 [03:25<01:39, 49.53s/it]INFO:root:Annotating 125 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 125 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
prompt_batches: 0%| | 0/125 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 1%| | 1/125 [00:03<07:07, 3.45s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 8%|▊ | 10/125 [00:03<00:31, 3.68it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 11%|█ | 14/125 [00:04<00:28, 3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 14%|█▎ | 17/125 [00:04<00:21, 5.08it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 15%|█▌ | 19/125 [00:05<00:26, 4.06it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 18%|█▊ | 22/125 [00:05<00:19, 5.26it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 19%|█▉ | 24/125 [00:06<00:24, 4.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 20%|██ | 25/125 [00:06<00:23, 4.26it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 22%|██▏ | 28/125 [00:07<00:17, 5.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 23%|██▎ | 29/125 [00:07<00:22, 4.23it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 25%|██▍ | 31/125 [00:07<00:18, 5.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 26%|██▋ | 33/125 [00:08<00:15, 5.85it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 27%|██▋ | 34/125 [00:08<00:24, 3.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 28%|██▊ | 35/125 [00:08<00:20, 4.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 30%|███ | 38/125 [00:09<00:15, 5.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 31%|███ | 39/125 [00:10<00:26, 3.25it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 32%|███▏ | 40/125 [00:10<00:22, 3.77it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 33%|███▎ | 41/125 [00:10<00:28, 2.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 35%|███▌ | 44/125 [00:11<00:18, 4.49it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 37%|███▋ | 46/125 [00:11<00:15, 5.12it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 38%|███▊ | 48/125 [00:11<00:14, 5.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 39%|███▉ | 49/125 [00:12<00:16, 4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 41%|████ | 51/125 [00:12<00:14, 5.04it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 42%|████▏ | 52/125 [00:12<00:13, 5.49it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 42%|████▏ | 53/125 [00:12<00:14, 5.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 43%|████▎ | 54/125 [00:13<00:17, 4.06it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 44%|████▍ | 55/125 [00:13<00:18, 3.77it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 46%|████▌ | 57/125 [00:13<00:12, 5.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 46%|████▋ | 58/125 [00:13<00:12, 5.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 47%|████▋ | 59/125 [00:14<00:14, 4.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 48%|████▊ | 60/125 [00:14<00:12, 5.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 49%|████▉ | 61/125 [00:14<00:12, 5.24it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 50%|████▉ | 62/125 [00:14<00:13, 4.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 50%|█████ | 63/125 [00:14<00:13, 4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 51%|█████ | 64/125 [00:15<00:17, 3.56it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 52%|█████▏ | 65/125 [00:15<00:15, 3.79it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 54%|█████▎ | 67/125 [00:18<00:43, 1.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 61%|██████ | 76/125 [00:19<00:15, 3.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 66%|██████▋ | 83/125 [00:19<00:07, 5.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 68%|██████▊ | 85/125 [00:20<00:08, 4.81it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 70%|██████▉ | 87/125 [00:21<00:07, 4.77it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 71%|███████ | 89/125 [00:21<00:07, 4.52it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 72%|███████▏ | 90/125 [00:21<00:07, 4.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 74%|███████▎ | 92/125 [00:21<00:06, 5.49it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 74%|███████▍ | 93/125 [00:22<00:07, 4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 75%|███████▌ | 94/125 [00:23<00:10, 2.83it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 77%|███████▋ | 96/125 [00:23<00:07, 4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 79%|███████▉ | 99/125 [00:23<00:04, 5.70it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 81%|████████ | 101/125 [00:24<00:05, 4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 83%|████████▎ | 104/125 [00:24<00:03, 5.32it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 84%|████████▍ | 105/125 [00:24<00:03, 5.07it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 85%|████████▍ | 106/125 [00:25<00:05, 3.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 87%|████████▋ | 109/125 [00:25<00:02, 5.43it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 88%|████████▊ | 110/125 [00:26<00:03, 4.45it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 90%|████████▉ | 112/125 [00:26<00:02, 5.98it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 91%|█████████ | 114/125 [00:27<00:02, 4.51it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 92%|█████████▏| 115/125 [00:27<00:02, 4.99it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 93%|█████████▎| 116/125 [00:27<00:01, 4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 94%|█████████▍| 118/125 [00:27<00:01, 5.07it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 95%|█████████▌| 119/125 [00:27<00:01, 4.72it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 96%|█████████▌| 120/125 [00:28<00:01, 4.00it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 98%|█████████▊| 122/125 [00:28<00:00, 4.82it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 99%|█████████▉| 124/125 [00:29<00:00, 3.54it/s]
prompt_batches: 100%|██████████| 125/125 [00:29<00:00, 4.24it/s]
INFO:root:Completed 125 examples in 29.6 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
Annotation chunk: 86%|████████▌ | 6/7 [03:55<00:42, 42.88s/it]INFO:root:Annotating 37 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 37 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
prompt_batches: 0%| | 0/37 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 3%|▎ | 1/37 [00:01<00:44, 1.23s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 16%|█▌ | 6/37 [00:02<00:10, 2.89it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 19%|█▉ | 7/37 [00:02<00:08, 3.36it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 27%|██▋ | 10/37 [00:02<00:04, 5.70it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 32%|███▏ | 12/37 [00:03<00:07, 3.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 43%|████▎ | 16/37 [00:04<00:05, 4.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 46%|████▌ | 17/37 [00:04<00:05, 3.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 57%|█████▋ | 21/37 [00:05<00:03, 4.35it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 62%|██████▏ | 23/37 [00:05<00:02, 4.89it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 68%|██████▊ | 25/37 [00:06<00:02, 4.80it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 73%|███████▎ | 27/37 [00:06<00:01, 5.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 76%|███████▌ | 28/37 [00:06<00:01, 4.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 81%|████████ | 30/37 [00:07<00:01, 4.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 84%|████████▍ | 31/37 [00:08<00:01, 3.22it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 95%|█████████▍| 35/37 [00:08<00:00, 4.93it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 97%|█████████▋| 36/37 [00:08<00:00, 5.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
prompt_batches: 100%|██████████| 37/37 [00:09<00:00, 3.84it/s]
prompt_batches: 100%|██████████| 37/37 [00:09<00:00, 4.06it/s]
*** SIGTERM received at time=1703326937 on cpu 3 ***
*** SIGTERM received at time=1703326937 on cpu 22 ***
PC: @ 0x50eb9c (unknown) _PyEval_EvalFrameDefault
@ 0x7fb277d26520 96618360 (unknown)
@ 0x7fb277426740 (unknown) (unknown)
PC: @ 0x522eec (unknown) _PyObject_GenericGetAttrWithDict
@ 0x7fb277d26520 84386496 (unknown)
@ 0x85eea0 (unknown) (unknown)
[2023-12-23 10:22:17,677 E 215931 55975] logging.cc:361: *** SIGTERM received at time=1703326937 on cpu 3 ***
[2023-12-23 10:22:17,677 E 215931 55975] logging.cc:361: PC: @ 0x522eec (unknown) _PyObject_GenericGetAttrWithDict
[2023-12-23 10:22:17,679 E 215931 55975] logging.cc:361: @ 0x7fb277d26520 84386496 (unknown)
@ 0x869d20 (unknown) (unknown)
[2023-12-23 10:22:17,680 E 215932 55975] logging.cc:361: *** SIGTERM received at time=1703326937 on cpu 22 ***
[2023-12-23 10:22:17,680 E 215932 55975] logging.cc:361: PC: @ 0x50eb9c (unknown) _PyEval_EvalFrameDefault
[2023-12-23 10:22:17,681 E 215931 55975] logging.cc:361: @ 0x85eea0 (unknown) (unknown)
[2023-12-23 10:22:17,683 E 215932 55975] logging.cc:361: @ 0x7fb277d26520 96618360 (unknown)
[2023-12-23 10:22:17,686 E 215932 55975] logging.cc:361: @ 0x7fb277426740 (unknown) (unknown)
[2023-12-23 10:22:17,691 E 215932 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
INFO:root:Completed 37 examples in 9.2 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
Annotation chunk: 100%|██████████| 7/7 [04:04<00:00, 31.99s/it]
Annotation chunk: 100%|██████████| 7/7 [04:04<00:00, 34.95s/it]
INFO:root:drop 1 outputs that are not[0, 1, 2]
/home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/metrics.py:26: FutureWarning: Setting an item of incompatible dtype is deprecated and will raise in a future error of pandas. Value '1.5' has dtype incompatible with int64, please explicitly cast to a compatible dtype first.
series_preferences[series_preferences == 0] = 1.5
INFO:root:Saving all results to output/chatgpt_fn_--SOLAR-10-7B-LMCocktail
INFO:root:Saving result to the precomputed leaderboard at /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv
win_rate standard_error n_total avg_length
gpt4 73.79 1.54 805 1365
SOLAR-10.7B-LMCocktail 73.45 1.56 804 1203
claude 70.37 1.60 805 1082
chatgpt 66.09 1.66 805 811
wizardlm-13b 65.16 1.67 805 985
vicuna-13b 64.10 1.69 805 1037
guanaco-65b 62.36 1.71 805 1249
oasst-rlhf-llama-33b 62.05 1.71 805 1079
alpaca-farm-ppo-human 60.25 1.72 805 803
falcon-40b-instruct 56.52 1.74 805 662
text_davinci_003 50.00 0.00 805 307
alpaca-7b 45.22 1.74 805 396
text_davinci_001 28.07 1.56 805 296
(RayWorkerVllm pid=57928) [W CUDAGraph.cpp:145] Warning: Waiting for pending NCCL work to finish before starting graph capture. (function operator())
(RayWorkerVllm pid=57928) INFO 12-23 08:58:39 model_runner.py:437] Graph capturing finished in 34 secs.
Reference in New Issue View Git Blame Copy Permalink