Meta-Llama-3-8B-Instruct-W4A16-compressed-tensors-test/configuration.json

{"framework": "pytorch", "task": "text-generation", "allow_remote": true}