3830 lines
318 KiB
Plaintext
3830 lines
318 KiB
Plaintext
|
||
Chunking for generation: 0%| | 0/13 [00:00<?, ?it/s]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 64. Only generating 0 .
|
||
INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 64. Only generating 64 .
|
||
INFO:root:vllm: loading model: /media/hangyu5/Home/Documents/Hugging-Face/LM_cocktail/LMCocktail-10.7B-v1, tp=2, trust_remote_code=0
|
||
2023-12-23 08:57:45,951 INFO worker.py:1673 -- Started a local Ray instance.
|
||
INFO 12-23 08:57:46 llm_engine.py:73] Initializing an LLM engine with config: model='/media/hangyu5/Home/Documents/Hugging-Face/LM_cocktail/LMCocktail-10.7B-v1', tokenizer='/media/hangyu5/Home/Documents/Hugging-Face/LM_cocktail/LMCocktail-10.7B-v1', tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=False, dtype=torch.float16, max_seq_len=4096, download_dir=None, load_format=auto, tensor_parallel_size=2, quantization=None, enforce_eager=False, seed=0)
|
||
INFO 12-23 08:58:02 llm_engine.py:223] # GPU blocks: 4457, # CPU blocks: 2730
|
||
[36m(RayWorkerVllm pid=57929)[0m [W CUDAGraph.cpp:145] Warning: Waiting for pending NCCL work to finish before starting graph capture. (function operator())
|
||
[36m(RayWorkerVllm pid=57929)[0m INFO 12-23 08:58:05 model_runner.py:394] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.36s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.36s/it]
|
||
[36m(RayWorkerVllm pid=57929)[0m INFO 12-23 08:58:39 model_runner.py:437] Graph capturing finished in 34 secs.
|
||
[36m(RayWorkerVllm pid=57928)[0m INFO 12-23 08:58:05 model_runner.py:394] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.40s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.40s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.38s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.38s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.68s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.68s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.61s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.98s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.98s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.85s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.85s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.73s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.73s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.25s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.25s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.72s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.72s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.71s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.71s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.25s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.25s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.53s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.53s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.43s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.43s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.42s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.42s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.13s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.13s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.45s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.45s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.48s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.48s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.99s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.99s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.04s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.04s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.18s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.18s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.00s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.00s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.95s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.95s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.19s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.19s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.27s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.36s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.36s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.53s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.53s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.86s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.86s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.57s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.01s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.01s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.38s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.38s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.64s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.64s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.21s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.21s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.04s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.04s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it]
|
||
|
||
Chunking for generation: 15%|█▌ | 2/13 [07:49<43:04, 234.92s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 128. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.39s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.39s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.15s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.15s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.77s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.77s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.85s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.85s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.66s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.66s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.75s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.75s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.88s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.89s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.13s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.13s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.08s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.08s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.66s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.66s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.90s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.90s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.95s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.95s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.43s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.43s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.86s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.86s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.52s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.52s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.54s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.54s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.75s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.75s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:23<00:00, 23.12s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:23<00:00, 23.12s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.64s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.64s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.55s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.55s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:19<00:00, 19.67s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:19<00:00, 19.67s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.39s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.39s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.67s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.67s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.39s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.39s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.21s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.21s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.86s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.86s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.27s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.27s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.18s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.18s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.24s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.62s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.62s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.48s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.48s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.39s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.39s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.87s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.87s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.61s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.80s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.80s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.42s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.42s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.91s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.91s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.58s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.58s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.54s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.54s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.05it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.05it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.02s/it]
|
||
|
||
Chunking for generation: 23%|██▎ | 3/13 [16:30<59:01, 354.16s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 192. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.83s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.83s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.71s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.71s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.37it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.37it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.31s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.31s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.43s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.43s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.41s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.41s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:32<00:00, 32.62s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:32<00:00, 32.62s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.60s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.60s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.68s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.68s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.94s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.94s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.14s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.14s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.99s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.99s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.40s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.40s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.71s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.71s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.20s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.20s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.35s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.35s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.21s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.21s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.40s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.40s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.50s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.50s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.33s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.55s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.55s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.72s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.72s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.00s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.00s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.06s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.06s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.71s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.71s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.58s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.58s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.32s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.32s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.55s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.14s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.14s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.53s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.53s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.48s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.48s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.27s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.27s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.28s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.28s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.22s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.22s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.07s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.07s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.34s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.34s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.62s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.62s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.89s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.89s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.28s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.28s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.57s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.76s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.76s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.47s/it]
|
||
|
||
Chunking for generation: 31%|███ | 4/13 [23:50<57:52, 385.86s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 256. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.56s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.17s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.17s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.51s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.51s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.43s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.43s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.30it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.30it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.57s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.46s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.46s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.58s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.58s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.83s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.83s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.87s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.87s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.99s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.99s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.94s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.94s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.88s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.88s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.43s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.43s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.70s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.70s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.09s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.09s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.82s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.82s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:26<00:00, 26.21s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:26<00:00, 26.21s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.84s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.84s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.19s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.19s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.43s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.43s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.95s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.95s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.18s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.18s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.31s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.31s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.62s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.62s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.36s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.36s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.98s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.98s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.21s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.21s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.45s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.45s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.46s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.46s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.76s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.76s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.13s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.13s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.31s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.31s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.22s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.22s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.27s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.27s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.17s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.17s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.72s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.72s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.89s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.89s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.51s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.51s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.13s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.13s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.01s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.01s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.40s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.40s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.23s/it]
|
||
|
||
Chunking for generation: 38%|███▊ | 5/13 [32:12<56:51, 426.44s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 320. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.61s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.39s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.39s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.56s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.56s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.71s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.71s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.39s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.39s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.87s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.88s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.67s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.67s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.54s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.54s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.82s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.82s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.47s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.17s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.17s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.47s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.86s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.86s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.81s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.82s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.41s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.41s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.22s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.22s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.67s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.67s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.38s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.38s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.12s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.12s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.14s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.14s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.31s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.31s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.70s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.70s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.64s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.76s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.76s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.00s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.00s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.68s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.68s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.89s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.89s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.16s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.16s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.05it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.05it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.69s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.69s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.06s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.06s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.68s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.69s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.41s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.41s/it]
|
||
|
||
Chunking for generation: 46%|████▌ | 6/13 [39:18<49:44, 426.29s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 384. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.73s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.73s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.66s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.66s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.32s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.32s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.79s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.79s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.51s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.04s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.04s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.14s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.14s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.32s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.32s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.04s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.04s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.54s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.54s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.61s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.21s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.21s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.57s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.12s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.12s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.34s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.34s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.80s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.80s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:27<00:00, 27.13s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:27<00:00, 27.13s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.61s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.20s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.20s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.41s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.41s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.09s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.09s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.67s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.67s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.33s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.33s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.45s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.45s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.61s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.77s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.77s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.24s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.24s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.56s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.56s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.36s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.36s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.80s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.80s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.04s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.04s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.98s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.98s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.13s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.13s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.31s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.31s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.32s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.32s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.62s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.62s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.47s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.79s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.79s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.88s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.88s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it]
|
||
|
||
Chunking for generation: 54%|█████▍ | 7/13 [45:53<41:37, 416.20s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 448. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.44s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.44s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.91s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.91s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.35s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.35s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.12s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.94s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.94s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.04s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.04s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.07s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.07s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.68s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.83s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.83s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.70s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.70s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.59s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.59s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.16s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.16s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.97s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.97s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.95s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.95s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.14it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.14it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.40it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.40it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.24s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.24s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.92s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.92s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.61s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.44s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.90s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.90s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.68s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.68s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.50s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.50s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.88s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.88s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.49s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.49s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.19s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.19s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.56s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.56s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.69s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.69s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.07s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.07s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.93s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.93s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.60s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.60s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.47s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.91s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.91s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.69s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.69s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.27s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.27s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.01s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.01s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.27s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.27s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.88s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.84s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.84s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.72s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.72s/it]
|
||
|
||
Chunking for generation: 62%|██████▏ | 8/13 [51:36<32:45, 393.15s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 512. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.29s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.29s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.86s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.86s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.94s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.94s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.69s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.69s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.27s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.27s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.56s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.56s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.55s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.55s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.20s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.20s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:53<00:00, 53.91s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:53<00:00, 53.91s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.38s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.38s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.34s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.34s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.16s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.16s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.16s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.16s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.92s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.92s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.20s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.92s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.92s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.67it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.67it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.48s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.48s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.24s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.25s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.80it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.80it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.44s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.44s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.66s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.66s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.03it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.03it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.35s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.35s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.96s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.96s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.85s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.85s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.17s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.17s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.40s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.40s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.08s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.08s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.55s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.55s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.67s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.67s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.28s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.28s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.79s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.15s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.15s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.18s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.18s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.22s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.22s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.99s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.99s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.83s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.83s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.55s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.55s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.61s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.27s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.27s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.69s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.69s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it]
|
||
|
||
Chunking for generation: 69%|██████▉ | 9/13 [58:17<26:22, 395.73s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 576. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.39s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.39s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.09s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.09s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.95s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.95s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.35s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.36s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.79s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.79s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.81s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.81s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.62s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.62s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.62s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.51s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.51s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.50s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.50s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.64s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.64s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.49s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.49s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 8.00s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 8.00s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.31s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.31s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.25s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.25s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.30it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.30it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.88s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.88s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.09s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.09s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.94s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.94s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.96s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.96s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.29s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.29s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.99s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.99s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.80s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.80s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.99s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.99s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.51s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.51s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.82s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.82s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.45s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.45s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.37s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.37s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.10s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.10s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.73s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.73s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.99s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.99s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.83s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.83s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.44it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.44it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.39s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.39s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.49s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.49s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.54s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.54s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.33s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.33s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.00it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.00it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.31s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.31s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.62s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.62s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.49it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.48it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.00it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.00it/s]
|
||
|
||
Chunking for generation: 77%|███████▋ | 10/13 [1:04:30<19:25, 388.50s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 640. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.98it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.98it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.93s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.93s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.91s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.91s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.06s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.41s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.41s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.53s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.53s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.74s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.74s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.74it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.74it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.45s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.45s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.75s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.75s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.27it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.26it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.06it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.06it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.80s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.80s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.19s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.19s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.43it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.43it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.61it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.61it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.54it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.53it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:51<00:00, 51.11s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:51<00:00, 51.11s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.58s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.58s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.07it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.07it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.20it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.20it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.52it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.52it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.21it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.21it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.95it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.95it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.05it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.04it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.71it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.71it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.87s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.87s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.45it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.45it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.07s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.07s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.31s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.31s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.08s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.08s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.69s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.69s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.95s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.95s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.87s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.87s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.09s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.09s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.52s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.52s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.69it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.69it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.92s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.92s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.19s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.19s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.53s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.53s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.82s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.82s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.60s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.60s/it]
|
||
|
||
Chunking for generation: 85%|████████▍ | 11/13 [1:08:47<11:36, 348.42s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 704. Only generating 64 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.59s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.59s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.97s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.97s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.15s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.15s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.01it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.01it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.22s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.22s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.41s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.41s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.61it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.61it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.81s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.81s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.51it/s][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.51it/s]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.54s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.54s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.57s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.19s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.19s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.43s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.43s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.29s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.29s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.83s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.83s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.53s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.53s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.63s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.63s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.46s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.04s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.04s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.25s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.25s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.64s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.64s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.69s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.69s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.44s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.44s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.32s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.32s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.22s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.22s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.98s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.98s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.44s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.44s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.12s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.12s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.12s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.12s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.14s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.14s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.95s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.95s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.83s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.83s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.70s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.70s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.81s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.81s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.15s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.15s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.22s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.22s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.40s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.40s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.07s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.07s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.30s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.30s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.28s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.28s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.90s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.90s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.41s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.41s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.57s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.84s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.84s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.65s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.65s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.23s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.23s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.70s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.70s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.32s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.32s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.53s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.53s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.49s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.49s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.57s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.57s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.86s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.86s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.79s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.79s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.98s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.98s/it]
|
||
|
||
Chunking for generation: 92%|█████████▏| 12/13 [1:15:10<05:59, 359.02s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
|
||
INFO:root:Found 768. Only generating 37 .
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.28s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.28s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.38s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.05s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.12s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.12s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.07s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.07s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.27s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.27s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.91s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.91s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.90s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.90s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.61s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.61s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.96s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.96s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.78s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.86s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.86s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.25s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.25s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.60s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.60s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.17s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.03s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.03s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.63s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.64s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.54s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.54s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.89s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.89s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.16s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.16s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.97s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.97s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.93s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.93s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.16s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.16s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.94s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.94s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.89s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.89s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.94s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.94s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.71s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.71s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:21<00:00, 21.77s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:21<00:00, 21.78s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.39s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.39s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 9.00s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 9.00s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.07s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.07s/it]
|
||
|
||
|
||
Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A
|
||
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.05s/it][A
|
||
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.05s/it]
|
||
|
||
Chunking for generation: 100%|██████████| 13/13 [1:20:27<00:00, 346.18s/it]
|
||
Chunking for generation: 100%|██████████| 13/13 [1:20:27<00:00, 371.32s/it]
|
||
INFO:root:Evaluating the SOLAR-10.7B-LMCocktail outputs.
|
||
INFO:root:Creating the annotator from `chatgpt_fn`.
|
||
INFO:root:Saving annotations to `/home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json`.
|
||
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
https://api.openai-proxy.org/v1
|
||
|
||
Annotation chunk: 0%| | 0/7 [00:00<?, ?it/s]INFO:root:Annotating 128 examples with chatgpt_fn
|
||
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
|
||
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
|
||
|
||
prompt_batches: 0%| | 0/128 [00:00<?, ?it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 1%| | 1/128 [00:01<02:22, 1.12s/it][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 2%|▏ | 2/128 [00:01<01:17, 1.62it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 5%|▍ | 6/128 [00:02<00:34, 3.50it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 5%|▌ | 7/128 [00:02<00:31, 3.88it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 6%|▋ | 8/128 [00:03<00:48, 2.47it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 9%|▉ | 12/128 [00:03<00:25, 4.51it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 12%|█▏ | 15/128 [00:04<00:29, 3.79it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 14%|█▍ | 18/128 [00:04<00:20, 5.46it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▌ | 20/128 [00:05<00:21, 4.96it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▋ | 21/128 [00:05<00:24, 4.38it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 17%|█▋ | 22/128 [00:05<00:23, 4.51it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 19%|█▉ | 24/128 [00:05<00:17, 5.87it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 20%|█▉ | 25/128 [00:06<00:22, 4.64it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 20%|██ | 26/128 [00:06<00:24, 4.10it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 21%|██ | 27/128 [00:06<00:24, 4.13it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 22%|██▏ | 28/128 [00:06<00:21, 4.71it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 23%|██▎ | 30/128 [00:07<00:29, 3.29it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 27%|██▋ | 34/128 [00:08<00:16, 5.73it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 27%|██▋ | 35/128 [00:08<00:26, 3.46it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 29%|██▉ | 37/128 [00:09<00:19, 4.66it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 30%|███ | 39/128 [00:09<00:15, 5.88it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 32%|███▏ | 41/128 [00:10<00:21, 4.05it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 34%|███▍ | 44/128 [00:10<00:14, 5.91it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 36%|███▌ | 46/128 [00:11<00:26, 3.13it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 39%|███▉ | 50/128 [00:12<00:18, 4.28it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 40%|███▉ | 51/128 [00:12<00:17, 4.39it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 41%|████▏ | 53/128 [00:12<00:15, 4.96it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 43%|████▎ | 55/128 [00:13<00:16, 4.52it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 44%|████▍ | 56/128 [00:13<00:15, 4.60it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 45%|████▍ | 57/128 [00:13<00:16, 4.25it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 46%|████▌ | 59/128 [00:13<00:12, 5.39it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 47%|████▋ | 60/128 [00:14<00:14, 4.71it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 48%|████▊ | 61/128 [00:14<00:15, 4.29it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 48%|████▊ | 62/128 [00:14<00:15, 4.19it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 50%|█████ | 64/128 [00:14<00:11, 5.59it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 51%|█████ | 65/128 [00:15<00:14, 4.40it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 52%|█████▏ | 66/128 [00:15<00:14, 4.42it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 52%|█████▏ | 67/128 [00:15<00:14, 4.13it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 54%|█████▍ | 69/128 [00:16<00:12, 4.88it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 55%|█████▍ | 70/128 [00:16<00:14, 4.06it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 56%|█████▋ | 72/128 [00:16<00:10, 5.16it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 58%|█████▊ | 74/128 [00:17<00:10, 5.17it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 59%|█████▊ | 75/128 [00:17<00:12, 4.28it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 60%|██████ | 77/128 [00:17<00:08, 5.71it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 61%|██████ | 78/128 [00:17<00:09, 5.18it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 62%|██████▏ | 79/128 [00:18<00:10, 4.76it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 62%|██████▎ | 80/128 [00:18<00:11, 4.26it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 63%|██████▎ | 81/128 [00:18<00:09, 4.85it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 64%|██████▍ | 82/128 [00:18<00:10, 4.31it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 65%|██████▍ | 83/128 [00:19<00:12, 3.74it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 66%|██████▋ | 85/128 [00:19<00:08, 4.90it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 67%|██████▋ | 86/128 [00:19<00:08, 5.14it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 68%|██████▊ | 87/128 [00:20<00:09, 4.15it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 69%|██████▉ | 88/128 [00:20<00:10, 4.00it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 70%|███████ | 90/128 [00:20<00:08, 4.64it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 71%|███████ | 91/128 [00:20<00:07, 4.74it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 72%|███████▏ | 92/128 [00:21<00:07, 5.01it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 73%|███████▎ | 93/128 [00:21<00:07, 4.42it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 74%|███████▍ | 95/128 [00:21<00:06, 5.47it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 75%|███████▌ | 96/128 [00:21<00:07, 4.20it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 76%|███████▌ | 97/128 [00:22<00:06, 4.83it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 77%|███████▋ | 98/128 [00:22<00:08, 3.60it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 79%|███████▉ | 101/128 [00:22<00:05, 5.07it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 80%|███████▉ | 102/128 [00:23<00:05, 4.95it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 80%|████████ | 103/128 [00:23<00:05, 4.54it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 81%|████████▏ | 104/128 [00:23<00:05, 4.18it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 82%|████████▏ | 105/128 [00:23<00:05, 4.56it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 83%|████████▎ | 106/128 [00:24<00:04, 5.07it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 84%|████████▎ | 107/128 [00:24<00:03, 5.45it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 84%|████████▍ | 108/128 [00:24<00:04, 4.02it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 85%|████████▌ | 109/128 [00:24<00:04, 4.40it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 86%|████████▌ | 110/128 [00:24<00:03, 5.02it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 87%|████████▋ | 111/128 [00:25<00:03, 4.50it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 88%|████████▊ | 112/128 [00:25<00:03, 4.02it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 88%|████████▊ | 113/128 [00:25<00:03, 4.88it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 89%|████████▉ | 114/128 [00:25<00:02, 4.97it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 90%|████████▉ | 115/128 [00:26<00:03, 3.93it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 91%|█████████ | 116/128 [00:26<00:03, 4.00it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 92%|█████████▏| 118/128 [00:26<00:02, 4.24it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 94%|█████████▍| 120/128 [00:27<00:01, 4.01it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 95%|█████████▌| 122/128 [00:27<00:01, 4.28it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 96%|█████████▌| 123/128 [00:28<00:01, 3.90it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 98%|█████████▊| 125/128 [00:28<00:00, 4.59it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 99%|█████████▉| 127/128 [00:28<00:00, 4.56it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 100%|██████████| 128/128 [00:29<00:00, 4.50it/s][A
|
||
prompt_batches: 100%|██████████| 128/128 [00:29<00:00, 4.39it/s]
|
||
*** SIGTERM received at time=1703326722 on cpu 18 ***
|
||
PC: @ 0x5547b8 (unknown) _PyObject_VectorcallTstate.lto_priv.14
|
||
@ 0x7fb277d26520 96618656 (unknown)
|
||
@ 0x7fb27745d200 (unknown) (unknown)
|
||
@ 0x869d20 (unknown) (unknown)
|
||
[2023-12-23 10:18:42,710 E 206008 55975] logging.cc:361: *** SIGTERM received at time=1703326722 on cpu 18 ***
|
||
[2023-12-23 10:18:42,710 E 206008 55975] logging.cc:361: PC: @ 0x5547b8 (unknown) _PyObject_VectorcallTstate.lto_priv.14
|
||
[2023-12-23 10:18:42,712 E 206008 55975] logging.cc:361: @ 0x7fb277d26520 96618656 (unknown)
|
||
[2023-12-23 10:18:42,714 E 206008 55975] logging.cc:361: @ 0x7fb27745d200 (unknown) (unknown)
|
||
[2023-12-23 10:18:42,719 E 206008 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
|
||
INFO:root:Completed 128 examples in 29.3 seconds.
|
||
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
|
||
Annotation chunk: 14%|█▍ | 1/7 [00:29<02:58, 29.67s/it]INFO:root:Annotating 128 examples with chatgpt_fn
|
||
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
|
||
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
|
||
|
||
prompt_batches: 0%| | 0/128 [00:00<?, ?it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 1%| | 1/128 [00:01<02:53, 1.37s/it][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 3%|▎ | 4/128 [00:01<00:42, 2.90it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 5%|▍ | 6/128 [00:02<00:43, 2.78it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 5%|▌ | 7/128 [00:02<00:36, 3.34it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 9%|▊ | 11/128 [00:03<00:29, 3.99it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 10%|█ | 13/128 [00:03<00:28, 4.03it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 12%|█▎ | 16/128 [00:04<00:24, 4.58it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 14%|█▍ | 18/128 [00:04<00:22, 4.90it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 15%|█▍ | 19/128 [00:05<00:24, 4.47it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▌ | 20/128 [00:05<00:23, 4.65it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▋ | 21/128 [00:05<00:20, 5.18it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 17%|█▋ | 22/128 [00:05<00:25, 4.19it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 18%|█▊ | 23/128 [00:07<01:01, 1.71it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 23%|██▎ | 30/128 [00:08<00:23, 4.20it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 25%|██▌ | 32/128 [00:08<00:20, 4.73it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 26%|██▌ | 33/128 [00:08<00:20, 4.71it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 27%|██▋ | 35/128 [00:09<00:21, 4.41it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 29%|██▉ | 37/128 [00:09<00:21, 4.30it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 30%|███ | 39/128 [00:09<00:18, 4.79it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 31%|███▏ | 40/128 [00:10<00:21, 4.17it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 33%|███▎ | 42/128 [00:10<00:22, 3.88it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 34%|███▍ | 44/128 [00:11<00:20, 4.03it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 36%|███▌ | 46/128 [00:11<00:15, 5.19it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 37%|███▋ | 47/128 [00:11<00:18, 4.41it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 38%|███▊ | 48/128 [00:12<00:20, 3.91it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 38%|███▊ | 49/128 [00:12<00:17, 4.53it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 41%|████ | 52/128 [00:12<00:14, 5.17it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 41%|████▏ | 53/128 [00:13<00:18, 4.03it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 42%|████▏ | 54/128 [00:13<00:17, 4.22it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 43%|████▎ | 55/128 [00:13<00:15, 4.71it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 45%|████▍ | 57/128 [00:14<00:15, 4.54it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 45%|████▌ | 58/128 [00:14<00:14, 4.77it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 46%|████▌ | 59/128 [00:14<00:15, 4.37it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 48%|████▊ | 61/128 [00:14<00:13, 4.90it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 48%|████▊ | 62/128 [00:15<00:16, 3.93it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 50%|█████ | 64/128 [00:15<00:16, 3.89it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 52%|█████▏ | 66/128 [00:15<00:11, 5.46it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 52%|█████▏ | 67/128 [00:16<00:15, 3.86it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 53%|█████▎ | 68/128 [00:16<00:16, 3.66it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 55%|█████▌ | 71/128 [00:16<00:09, 6.03it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 56%|█████▋ | 72/128 [00:17<00:15, 3.69it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 57%|█████▋ | 73/128 [00:17<00:13, 4.01it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 58%|█████▊ | 74/128 [00:17<00:12, 4.28it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 60%|██████ | 77/128 [00:18<00:12, 4.12it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 61%|██████ | 78/128 [00:19<00:12, 3.98it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 64%|██████▍ | 82/128 [00:19<00:10, 4.54it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 65%|██████▍ | 83/128 [00:20<00:09, 4.60it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 66%|██████▌ | 84/128 [00:20<00:08, 4.97it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 66%|██████▋ | 85/128 [00:20<00:08, 5.10it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 68%|██████▊ | 87/128 [00:20<00:10, 4.01it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 70%|███████ | 90/128 [00:21<00:07, 4.81it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 72%|███████▏ | 92/128 [00:22<00:09, 3.88it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 74%|███████▍ | 95/128 [00:22<00:05, 5.51it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 75%|███████▌ | 96/128 [00:22<00:06, 4.99it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 76%|███████▌ | 97/128 [00:23<00:07, 4.38it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 77%|███████▋ | 98/128 [00:23<00:06, 4.34it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 78%|███████▊ | 100/128 [00:23<00:05, 4.80it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 80%|███████▉ | 102/128 [00:24<00:06, 4.27it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 80%|████████ | 103/128 [00:24<00:06, 4.01it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 82%|████████▏ | 105/128 [00:24<00:04, 5.39it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 83%|████████▎ | 106/128 [00:24<00:03, 5.80it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 84%|████████▎ | 107/128 [00:25<00:05, 4.18it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 85%|████████▌ | 109/128 [00:25<00:03, 5.15it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 86%|████████▌ | 110/128 [00:25<00:03, 5.03it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 87%|████████▋ | 111/128 [00:26<00:04, 3.97it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 88%|████████▊ | 112/128 [00:26<00:03, 4.59it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 88%|████████▊ | 113/128 [00:26<00:02, 5.34it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 89%|████████▉ | 114/128 [00:26<00:02, 4.76it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 90%|████████▉ | 115/128 [00:26<00:02, 5.11it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 91%|█████████ | 116/128 [00:27<00:02, 4.18it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 91%|█████████▏| 117/128 [00:27<00:02, 4.02it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 93%|█████████▎| 119/128 [00:27<00:01, 4.69it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 94%|█████████▍| 120/128 [00:27<00:01, 5.35it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 95%|█████████▍| 121/128 [00:28<00:01, 4.63it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 95%|█████████▌| 122/128 [00:28<00:01, 3.17it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 97%|█████████▋| 124/128 [00:29<00:01, 3.01it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 99%|█████████▉| 127/128 [00:29<00:00, 4.23it/s][A
|
||
prompt_batches: 100%|██████████| 128/128 [00:29<00:00, 4.29it/s]
|
||
INFO:root:Completed 128 examples in 29.9 seconds.
|
||
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
|
||
Annotation chunk: 29%|██▊ | 2/7 [01:00<02:30, 30.06s/it]INFO:root:Annotating 128 examples with chatgpt_fn
|
||
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
|
||
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
|
||
|
||
prompt_batches: 0%| | 0/128 [00:00<?, ?it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 1%| | 1/128 [00:01<02:54, 1.37s/it][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 5%|▍ | 6/128 [00:02<00:36, 3.30it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 5%|▌ | 7/128 [00:02<00:32, 3.69it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 7%|▋ | 9/128 [00:02<00:23, 5.11it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 8%|▊ | 10/128 [00:02<00:22, 5.34it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 9%|▊ | 11/128 [00:03<00:31, 3.76it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 9%|▉ | 12/128 [00:03<00:36, 3.15it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 12%|█▏ | 15/128 [00:03<00:21, 5.37it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 12%|█▎ | 16/128 [00:04<00:25, 4.41it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 13%|█▎ | 17/128 [00:04<00:24, 4.60it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 14%|█▍ | 18/128 [00:04<00:24, 4.55it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▌ | 20/128 [00:04<00:19, 5.45it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▋ | 21/128 [00:05<00:27, 3.84it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 18%|█▊ | 23/128 [00:05<00:22, 4.62it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 20%|█▉ | 25/128 [00:06<00:21, 4.84it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 20%|██ | 26/128 [00:06<00:23, 4.38it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 21%|██ | 27/128 [00:06<00:25, 3.91it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 22%|██▏ | 28/128 [00:07<00:27, 3.67it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 24%|██▍ | 31/128 [00:07<00:19, 5.09it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 25%|██▌ | 32/128 [00:07<00:20, 4.61it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 27%|██▋ | 34/128 [00:08<00:23, 3.94it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 28%|██▊ | 36/128 [00:08<00:21, 4.27it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 30%|██▉ | 38/128 [00:09<00:19, 4.70it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 31%|███▏ | 40/128 [00:12<00:55, 1.60it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 38%|███▊ | 49/128 [00:12<00:17, 4.63it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 41%|████ | 52/128 [00:12<00:13, 5.80it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 43%|████▎ | 55/128 [00:13<00:16, 4.30it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 45%|████▌ | 58/128 [00:14<00:17, 4.05it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 47%|████▋ | 60/128 [00:14<00:14, 4.59it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 49%|████▉ | 63/128 [00:16<00:24, 2.68it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 55%|█████▍ | 70/128 [00:17<00:11, 4.87it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 56%|█████▋ | 72/128 [00:17<00:12, 4.34it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 58%|█████▊ | 74/128 [00:18<00:12, 4.40it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 59%|█████▉ | 76/128 [00:18<00:12, 4.09it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 60%|██████ | 77/128 [00:19<00:12, 4.10it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 61%|██████ | 78/128 [00:19<00:12, 3.85it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 63%|██████▎ | 81/128 [00:19<00:10, 4.53it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 64%|██████▍ | 82/128 [00:20<00:09, 4.65it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 65%|██████▍ | 83/128 [00:20<00:09, 4.75it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 66%|██████▌ | 84/128 [00:20<00:08, 4.90it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 66%|██████▋ | 85/128 [00:20<00:09, 4.61it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 67%|██████▋ | 86/128 [00:20<00:08, 5.01it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 68%|██████▊ | 87/128 [00:21<00:08, 4.91it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 69%|██████▉ | 88/128 [00:21<00:08, 4.97it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 70%|██████▉ | 89/128 [00:21<00:07, 5.32it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 70%|███████ | 90/128 [00:21<00:10, 3.52it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 73%|███████▎ | 93/128 [00:22<00:09, 3.72it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 73%|███████▎ | 94/128 [00:22<00:08, 4.19it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 74%|███████▍ | 95/128 [00:23<00:09, 3.45it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 77%|███████▋ | 98/128 [00:23<00:07, 4.28it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 77%|███████▋ | 99/128 [00:23<00:06, 4.73it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 78%|███████▊ | 100/128 [00:24<00:06, 4.66it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 79%|███████▉ | 101/128 [00:24<00:05, 4.53it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 80%|████████ | 103/128 [00:25<00:06, 3.75it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 82%|████████▏ | 105/128 [00:25<00:04, 4.74it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 83%|████████▎ | 106/128 [00:25<00:04, 4.79it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 84%|████████▎ | 107/128 [00:25<00:03, 5.44it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 84%|████████▍ | 108/128 [00:25<00:04, 4.48it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 85%|████████▌ | 109/128 [00:26<00:03, 5.13it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 86%|████████▌ | 110/128 [00:26<00:03, 5.12it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 87%|████████▋ | 111/128 [00:26<00:03, 4.75it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 88%|████████▊ | 112/128 [00:26<00:02, 5.47it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 88%|████████▊ | 113/128 [00:27<00:03, 3.96it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 90%|████████▉ | 115/128 [00:27<00:02, 5.31it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 91%|█████████ | 116/128 [00:27<00:02, 4.75it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 91%|█████████▏| 117/128 [00:27<00:02, 4.38it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 92%|█████████▏| 118/128 [00:28<00:02, 3.76it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 95%|█████████▍| 121/128 [00:28<00:01, 5.55it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 95%|█████████▌| 122/128 [00:28<00:01, 5.33it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 96%|█████████▌| 123/128 [00:29<00:01, 4.04it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 97%|█████████▋| 124/128 [00:29<00:00, 4.63it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 98%|█████████▊| 125/128 [00:29<00:00, 4.74it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 99%|█████████▉| 127/128 [00:29<00:00, 5.16it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 100%|██████████| 128/128 [00:30<00:00, 3.62it/s][A
|
||
prompt_batches: 100%|██████████| 128/128 [00:30<00:00, 4.21it/s]
|
||
INFO:root:Completed 128 examples in 30.5 seconds.
|
||
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
|
||
Annotation chunk: 43%|████▎ | 3/7 [01:30<02:01, 30.44s/it]INFO:root:Annotating 127 examples with chatgpt_fn
|
||
INFO:root:Using `openai_completions` on 127 prompts using gpt-3.5-turbo-16k-0613.
|
||
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
|
||
|
||
prompt_batches: 0%| | 0/127 [00:00<?, ?it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 1%| | 1/127 [00:01<02:13, 1.06s/it][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 2%|▏ | 3/127 [00:01<00:41, 2.97it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 5%|▍ | 6/127 [00:02<00:40, 2.96it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 8%|▊ | 10/127 [00:02<00:20, 5.64it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 9%|▉ | 12/127 [00:03<00:28, 4.02it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 10%|█ | 13/127 [00:03<00:29, 3.88it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 13%|█▎ | 16/127 [00:04<00:26, 4.21it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 13%|█▎ | 17/127 [00:04<00:27, 4.05it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▌ | 20/127 [00:04<00:17, 6.18it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 17%|█▋ | 22/127 [00:05<00:26, 4.03it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 18%|█▊ | 23/127 [00:05<00:24, 4.22it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 20%|██ | 26/127 [00:06<00:24, 4.11it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 21%|██▏ | 27/127 [00:06<00:22, 4.48it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 22%|██▏ | 28/127 [00:06<00:20, 4.91it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 24%|██▎ | 30/127 [00:06<00:16, 5.91it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 24%|██▍ | 31/127 [00:07<00:24, 3.95it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 25%|██▌ | 32/127 [00:07<00:27, 3.47it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 28%|██▊ | 35/127 [00:08<00:16, 5.42it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 28%|██▊ | 36/127 [00:08<00:20, 4.48it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 29%|██▉ | 37/127 [00:08<00:21, 4.22it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 30%|██▉ | 38/127 [00:09<00:26, 3.42it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 32%|███▏ | 41/127 [00:09<00:15, 5.54it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 33%|███▎ | 42/127 [00:09<00:16, 5.04it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 34%|███▍ | 43/127 [00:10<00:26, 3.23it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 36%|███▌ | 46/127 [00:10<00:16, 4.90it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 38%|███▊ | 48/127 [00:11<00:23, 3.37it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 42%|████▏ | 53/127 [00:12<00:19, 3.78it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 46%|████▌ | 58/127 [00:13<00:15, 4.53it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 46%|████▋ | 59/127 [00:14<00:15, 4.48it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 50%|████▉ | 63/127 [00:14<00:13, 4.78it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 51%|█████ | 65/127 [00:14<00:11, 5.44it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 52%|█████▏ | 66/127 [00:15<00:10, 5.56it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:openai._base_client:Retrying request to /chat/completions in 0.939927 seconds
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 54%|█████▎ | 68/127 [00:21<01:02, 1.06s/it][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 68%|██████▊ | 86/127 [00:22<00:09, 4.15it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 70%|███████ | 89/127 [00:22<00:09, 4.11it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 72%|███████▏ | 92/127 [00:23<00:07, 4.48it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 74%|███████▍ | 94/127 [00:23<00:07, 4.13it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 76%|███████▌ | 96/127 [00:24<00:06, 4.75it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 77%|███████▋ | 98/127 [00:24<00:05, 5.36it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 79%|███████▊ | 100/127 [00:25<00:09, 2.99it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 82%|████████▏ | 104/127 [00:26<00:05, 4.30it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 84%|████████▍ | 107/127 [00:26<00:03, 5.54it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 86%|████████▌ | 109/127 [00:27<00:04, 4.29it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 87%|████████▋ | 110/127 [00:27<00:03, 4.29it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 89%|████████▉ | 113/127 [00:28<00:03, 3.85it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 92%|█████████▏| 117/127 [00:28<00:01, 5.48it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 93%|█████████▎| 118/127 [00:29<00:02, 4.31it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 94%|█████████▎| 119/127 [00:30<00:02, 2.81it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 98%|█████████▊| 124/127 [00:30<00:00, 5.44it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 99%|█████████▉| 126/127 [00:30<00:00, 4.97it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
prompt_batches: 100%|██████████| 127/127 [00:31<00:00, 4.07it/s]
|
||
*** SIGTERM received at time=1703326815 on cpu 43 ***
|
||
PC: @ 0x5138fa (unknown) _PyEval_EvalFrameDefault
|
||
@ 0x7fb277d26520 96618512 (unknown)
|
||
@ 0x7fb277426740 (unknown) (unknown)
|
||
@ 0x869d20 (unknown) (unknown)
|
||
[2023-12-23 10:20:15,631 E 209804 55975] logging.cc:361: *** SIGTERM received at time=1703326815 on cpu 43 ***
|
||
[2023-12-23 10:20:15,631 E 209804 55975] logging.cc:361: PC: @ 0x5138fa (unknown) _PyEval_EvalFrameDefault
|
||
[2023-12-23 10:20:15,633 E 209804 55975] logging.cc:361: @ 0x7fb277d26520 96618512 (unknown)
|
||
[2023-12-23 10:20:15,635 E 209804 55975] logging.cc:361: @ 0x7fb277426740 (unknown) (unknown)
|
||
[2023-12-23 10:20:15,640 E 209804 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
|
||
INFO:root:Completed 127 examples in 31.3 seconds.
|
||
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
|
||
Annotation chunk: 57%|█████▋ | 4/7 [02:02<01:32, 30.94s/it]INFO:root:Annotating 128 examples with chatgpt_fn
|
||
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
|
||
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
|
||
|
||
prompt_batches: 0%| | 0/128 [00:00<?, ?it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 1%| | 1/128 [00:01<02:54, 1.38s/it][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 5%|▍ | 6/128 [00:02<00:35, 3.41it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 5%|▌ | 7/128 [00:02<00:34, 3.47it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 8%|▊ | 10/128 [00:02<00:20, 5.69it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 9%|▉ | 12/128 [00:03<00:36, 3.20it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 12%|█▎ | 16/128 [00:04<00:26, 4.18it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 13%|█▎ | 17/128 [00:04<00:26, 4.16it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▌ | 20/128 [00:04<00:20, 5.37it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▋ | 21/128 [00:05<00:29, 3.62it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 20%|█▉ | 25/128 [00:06<00:20, 5.00it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 20%|██ | 26/128 [00:06<00:22, 4.58it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 21%|██ | 27/128 [00:06<00:25, 4.03it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 23%|██▎ | 30/128 [00:07<00:18, 5.43it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Sleeping 2 before retrying to call openai API...
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
|
||
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
|
||
WARNING:root:Unknown error.
|
||
It's likely a rate limit so we are retrying...
|
||
INFO:root:Max rate limit reached.
|
||
|
||
|
||
prompt_batches: 24%|██▍ | 31/128 [01:21<20:26, 12.65s/it][A
|
||
prompt_batches: 100%|██████████| 128/128 [01:21<00:00, 1.56it/s]
|
||
*** SIGTERM received at time=1703326898 on cpu 6 ***
|
||
*** SIGTERM received at time=1703326898 on cpu 8 ***
|
||
PC: @ 0x50f2b9 (unknown) _PyEval_EvalFrameDefault
|
||
@ 0x7fb277d26520 (unknown) (unknown)
|
||
PC: @ 0x50fdd5 (unknown) _PyEval_EvalFrameDefault
|
||
@ 0x7fb277d26520 96618360 (unknown)
|
||
@ 0x7fb2770c16c0 965637776 (unknown)
|
||
@ 0x7fb277426740 (unknown) (unknown)
|
||
@ 0x869d20 (unknown) (unknown)
|
||
[2023-12-23 10:21:38,138 E 211132 55975] logging.cc:361: *** SIGTERM received at time=1703326898 on cpu 6 ***
|
||
[2023-12-23 10:21:38,138 E 211132 55975] logging.cc:361: PC: @ 0x50f2b9 (unknown) _PyEval_EvalFrameDefault
|
||
[2023-12-23 10:21:38,141 E 211132 55975] logging.cc:361: @ 0x7fb277d26520 (unknown) (unknown)
|
||
[2023-12-23 10:21:38,143 E 211132 55975] logging.cc:361: @ 0x7fb2770c16c0 965637776 (unknown)
|
||
@ 0x869d20 (unknown) (unknown)
|
||
[2023-12-23 10:21:38,144 E 211134 55975] logging.cc:361: *** SIGTERM received at time=1703326898 on cpu 8 ***
|
||
[2023-12-23 10:21:38,144 E 211134 55975] logging.cc:361: PC: @ 0x50fdd5 (unknown) _PyEval_EvalFrameDefault
|
||
[2023-12-23 10:21:38,147 E 211134 55975] logging.cc:361: @ 0x7fb277d26520 96618360 (unknown)
|
||
[2023-12-23 10:21:38,147 E 211132 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
|
||
[2023-12-23 10:21:38,151 E 211134 55975] logging.cc:361: @ 0x7fb277426740 (unknown) (unknown)
|
||
[2023-12-23 10:21:38,157 E 211134 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
|
||
INFO:root:Completed 128 examples in 82.1 seconds.
|
||
WARNING:root:Found 0 annotations in:'''
|
||
|
||
''' but expected 1. We are setting all annotations to None.
|
||
WARNING:root:1 samples had no auto annotation. We are filtering them for now. If you are using chain of thought it might be that max_tokens limit is too low.
|
||
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
|
||
Annotation chunk: 71%|███████▏ | 5/7 [03:25<01:39, 49.53s/it]INFO:root:Annotating 125 examples with chatgpt_fn
|
||
INFO:root:Using `openai_completions` on 125 prompts using gpt-3.5-turbo-16k-0613.
|
||
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
|
||
|
||
prompt_batches: 0%| | 0/125 [00:00<?, ?it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 1%| | 1/125 [00:03<07:07, 3.45s/it][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 8%|▊ | 10/125 [00:03<00:31, 3.68it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 11%|█ | 14/125 [00:04<00:28, 3.88it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 14%|█▎ | 17/125 [00:04<00:21, 5.08it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 15%|█▌ | 19/125 [00:05<00:26, 4.06it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 18%|█▊ | 22/125 [00:05<00:19, 5.26it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 19%|█▉ | 24/125 [00:06<00:24, 4.10it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 20%|██ | 25/125 [00:06<00:23, 4.26it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 22%|██▏ | 28/125 [00:07<00:17, 5.54it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 23%|██▎ | 29/125 [00:07<00:22, 4.23it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 25%|██▍ | 31/125 [00:07<00:18, 5.02it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 26%|██▋ | 33/125 [00:08<00:15, 5.85it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 27%|██▋ | 34/125 [00:08<00:24, 3.76it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 28%|██▊ | 35/125 [00:08<00:20, 4.30it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 30%|███ | 38/125 [00:09<00:15, 5.48it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 31%|███ | 39/125 [00:10<00:26, 3.25it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 32%|███▏ | 40/125 [00:10<00:22, 3.77it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 33%|███▎ | 41/125 [00:10<00:28, 2.90it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 35%|███▌ | 44/125 [00:11<00:18, 4.49it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 37%|███▋ | 46/125 [00:11<00:15, 5.12it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 38%|███▊ | 48/125 [00:11<00:14, 5.18it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 39%|███▉ | 49/125 [00:12<00:16, 4.53it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 41%|████ | 51/125 [00:12<00:14, 5.04it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 42%|████▏ | 52/125 [00:12<00:13, 5.49it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 42%|████▏ | 53/125 [00:12<00:14, 5.10it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 43%|████▎ | 54/125 [00:13<00:17, 4.06it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 44%|████▍ | 55/125 [00:13<00:18, 3.77it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 46%|████▌ | 57/125 [00:13<00:12, 5.48it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 46%|████▋ | 58/125 [00:13<00:12, 5.31it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 47%|████▋ | 59/125 [00:14<00:14, 4.60it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 48%|████▊ | 60/125 [00:14<00:12, 5.31it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 49%|████▉ | 61/125 [00:14<00:12, 5.24it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 50%|████▉ | 62/125 [00:14<00:13, 4.59it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 50%|█████ | 63/125 [00:14<00:13, 4.63it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 51%|█████ | 64/125 [00:15<00:17, 3.56it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 52%|█████▏ | 65/125 [00:15<00:15, 3.79it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 54%|█████▎ | 67/125 [00:18<00:43, 1.34it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 61%|██████ | 76/125 [00:19<00:15, 3.18it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 66%|██████▋ | 83/125 [00:19<00:07, 5.53it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 68%|██████▊ | 85/125 [00:20<00:08, 4.81it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 70%|██████▉ | 87/125 [00:21<00:07, 4.77it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 71%|███████ | 89/125 [00:21<00:07, 4.52it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 72%|███████▏ | 90/125 [00:21<00:07, 4.41it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 74%|███████▎ | 92/125 [00:21<00:06, 5.49it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 74%|███████▍ | 93/125 [00:22<00:07, 4.48it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 75%|███████▌ | 94/125 [00:23<00:10, 2.83it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 77%|███████▋ | 96/125 [00:23<00:07, 4.02it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 79%|███████▉ | 99/125 [00:23<00:04, 5.70it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 81%|████████ | 101/125 [00:24<00:05, 4.63it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 83%|████████▎ | 104/125 [00:24<00:03, 5.32it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 84%|████████▍ | 105/125 [00:24<00:03, 5.07it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 85%|████████▍ | 106/125 [00:25<00:05, 3.71it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 87%|████████▋ | 109/125 [00:25<00:02, 5.43it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 88%|████████▊ | 110/125 [00:26<00:03, 4.45it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 90%|████████▉ | 112/125 [00:26<00:02, 5.98it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 91%|█████████ | 114/125 [00:27<00:02, 4.51it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 92%|█████████▏| 115/125 [00:27<00:02, 4.99it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 93%|█████████▎| 116/125 [00:27<00:01, 4.63it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 94%|█████████▍| 118/125 [00:27<00:01, 5.07it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 95%|█████████▌| 119/125 [00:27<00:01, 4.72it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 96%|█████████▌| 120/125 [00:28<00:01, 4.00it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 98%|█████████▊| 122/125 [00:28<00:00, 4.82it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 99%|█████████▉| 124/125 [00:29<00:00, 3.54it/s][A
|
||
prompt_batches: 100%|██████████| 125/125 [00:29<00:00, 4.24it/s]
|
||
INFO:root:Completed 125 examples in 29.6 seconds.
|
||
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
|
||
Annotation chunk: 86%|████████▌ | 6/7 [03:55<00:42, 42.88s/it]INFO:root:Annotating 37 examples with chatgpt_fn
|
||
INFO:root:Using `openai_completions` on 37 prompts using gpt-3.5-turbo-16k-0613.
|
||
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
|
||
To disable this warning, you can either:
|
||
- Avoid using `tokenizers` before the fork if possible
|
||
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
|
||
|
||
|
||
prompt_batches: 0%| | 0/37 [00:00<?, ?it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 3%|▎ | 1/37 [00:01<00:44, 1.23s/it][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 16%|█▌ | 6/37 [00:02<00:10, 2.89it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 19%|█▉ | 7/37 [00:02<00:08, 3.36it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 27%|██▋ | 10/37 [00:02<00:04, 5.70it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 32%|███▏ | 12/37 [00:03<00:07, 3.37it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 43%|████▎ | 16/37 [00:04<00:05, 4.17it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 46%|████▌ | 17/37 [00:04<00:05, 3.78it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 57%|█████▋ | 21/37 [00:05<00:03, 4.35it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 62%|██████▏ | 23/37 [00:05<00:02, 4.89it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 68%|██████▊ | 25/37 [00:06<00:02, 4.80it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 73%|███████▎ | 27/37 [00:06<00:01, 5.28it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 76%|███████▌ | 28/37 [00:06<00:01, 4.74it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 81%|████████ | 30/37 [00:07<00:01, 4.78it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 84%|████████▍ | 31/37 [00:08<00:01, 3.22it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 95%|█████████▍| 35/37 [00:08<00:00, 4.93it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 97%|█████████▋| 36/37 [00:08<00:00, 5.11it/s][AINFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
|
||
|
||
|
||
prompt_batches: 100%|██████████| 37/37 [00:09<00:00, 3.84it/s][A
|
||
prompt_batches: 100%|██████████| 37/37 [00:09<00:00, 4.06it/s]
|
||
*** SIGTERM received at time=1703326937 on cpu 3 ***
|
||
*** SIGTERM received at time=1703326937 on cpu 22 ***
|
||
PC: @ 0x50eb9c (unknown) _PyEval_EvalFrameDefault
|
||
@ 0x7fb277d26520 96618360 (unknown)
|
||
@ 0x7fb277426740 (unknown) (unknown)
|
||
PC: @ 0x522eec (unknown) _PyObject_GenericGetAttrWithDict
|
||
@ 0x7fb277d26520 84386496 (unknown)
|
||
@ 0x85eea0 (unknown) (unknown)
|
||
[2023-12-23 10:22:17,677 E 215931 55975] logging.cc:361: *** SIGTERM received at time=1703326937 on cpu 3 ***
|
||
[2023-12-23 10:22:17,677 E 215931 55975] logging.cc:361: PC: @ 0x522eec (unknown) _PyObject_GenericGetAttrWithDict
|
||
[2023-12-23 10:22:17,679 E 215931 55975] logging.cc:361: @ 0x7fb277d26520 84386496 (unknown)
|
||
@ 0x869d20 (unknown) (unknown)
|
||
[2023-12-23 10:22:17,680 E 215932 55975] logging.cc:361: *** SIGTERM received at time=1703326937 on cpu 22 ***
|
||
[2023-12-23 10:22:17,680 E 215932 55975] logging.cc:361: PC: @ 0x50eb9c (unknown) _PyEval_EvalFrameDefault
|
||
[2023-12-23 10:22:17,681 E 215931 55975] logging.cc:361: @ 0x85eea0 (unknown) (unknown)
|
||
[2023-12-23 10:22:17,683 E 215932 55975] logging.cc:361: @ 0x7fb277d26520 96618360 (unknown)
|
||
[2023-12-23 10:22:17,686 E 215932 55975] logging.cc:361: @ 0x7fb277426740 (unknown) (unknown)
|
||
[2023-12-23 10:22:17,691 E 215932 55975] logging.cc:361: @ 0x869d20 (unknown) (unknown)
|
||
INFO:root:Completed 37 examples in 9.2 seconds.
|
||
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
|
||
|
||
Annotation chunk: 100%|██████████| 7/7 [04:04<00:00, 31.99s/it]
|
||
Annotation chunk: 100%|██████████| 7/7 [04:04<00:00, 34.95s/it]
|
||
INFO:root:drop 1 outputs that are not[0, 1, 2]
|
||
/home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/metrics.py:26: FutureWarning: Setting an item of incompatible dtype is deprecated and will raise in a future error of pandas. Value '1.5' has dtype incompatible with int64, please explicitly cast to a compatible dtype first.
|
||
series_preferences[series_preferences == 0] = 1.5
|
||
INFO:root:Saving all results to output/chatgpt_fn_--SOLAR-10-7B-LMCocktail
|
||
INFO:root:Saving result to the precomputed leaderboard at /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv
|
||
win_rate standard_error n_total avg_length
|
||
gpt4 73.79 1.54 805 1365
|
||
SOLAR-10.7B-LMCocktail 73.45 1.56 804 1203
|
||
claude 70.37 1.60 805 1082
|
||
chatgpt 66.09 1.66 805 811
|
||
wizardlm-13b 65.16 1.67 805 985
|
||
vicuna-13b 64.10 1.69 805 1037
|
||
guanaco-65b 62.36 1.71 805 1249
|
||
oasst-rlhf-llama-33b 62.05 1.71 805 1079
|
||
alpaca-farm-ppo-human 60.25 1.72 805 803
|
||
falcon-40b-instruct 56.52 1.74 805 662
|
||
text_davinci_003 50.00 0.00 805 307
|
||
alpaca-7b 45.22 1.74 805 396
|
||
text_davinci_001 28.07 1.56 805 296
|
||
[36m(RayWorkerVllm pid=57928)[0m [W CUDAGraph.cpp:145] Warning: Waiting for pending NCCL work to finish before starting graph capture. (function operator())
|
||
[36m(RayWorkerVllm pid=57928)[0m INFO 12-23 08:58:39 model_runner.py:437] Graph capturing finished in 34 secs.
|