Exception: ERROR

[yuqian2003]

When I used Llama3-8b (downloaded from huggingface) to test RAP on the Blocksworld dataset, things went wrong 🤔️:

blocksworld: 0%| | 0/45 [01:06<?, ?it/s]

[rank0]: Traceback (most recent call last):
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/examples/RAP/blocksworld/rap_inference.py", line 227, in
[rank0]: fire.Fire(llama3_main) # user will need to switch the model in the code
[rank0]: File "/opt/conda/envs/reasoners/lib/python3.10/site-packages/fire/core.py", line 135, in Fire
[rank0]: component_trace = _Fire(component, args, parsed_flag_args, context, name)
[rank0]: File "/opt/conda/envs/reasoners/lib/python3.10/site-packages/fire/core.py", line 468, in _Fire
[rank0]: component, remaining_args = _CallAndUpdateTrace(
[rank0]: File "/opt/conda/envs/reasoners/lib/python3.10/site-packages/fire/core.py", line 684, in _CallAndUpdateTrace
[rank0]: component = fn(*varargs, **kwargs)
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/examples/RAP/blocksworld/rap_inference.py", line 217, in llama3_main
[rank0]: RAP_bw(llama_model,
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/examples/RAP/blocksworld/rap_inference.py", line 42, in RAP_bw
[rank0]: accuracy = evaluator.evaluate(reasoner, shuffle_prompt=True, num_shot=4, resume=resume, log_dir=log_dir)
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/reasoners/base.py", line 241, in evaluate
[rank0]: algo_output = reasoner(self.input_processor(example),
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/reasoners/base.py", line 191, in call
[rank0]: return self.search_algo(self.dynamics, self.search_config, **kwargs)
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/reasoners/algorithm/mcts.py", line 314, in call
[rank0]: self.search()
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/reasoners/algorithm/mcts.py", line 284, in search
[rank0]: path = self.iterate(self.root)
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/reasoners/algorithm/mcts.py", line 188, in iterate
[rank0]: self._simulate(path)
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/reasoners/algorithm/mcts.py", line 249, in _simulate
[rank0]: self._expand(node)
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/reasoners/algorithm/mcts.py", line 224, in _expand
[rank0]: node.state, aux = self.world_model.step(node.parent.state, node.action)
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/examples/RAP/blocksworld/world_model.py", line 60, in step
[rank0]: blocks_state = self.update_blocks(blocks_state, action)
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/examples/RAP/blocksworld/world_model.py", line 93, in update_blocks
[rank0]: new_state = utils.apply_change(world_output, block_states)
[rank0]: File "/home/jovyan/shared/yuqianwu/Agent/Memory/llm-reasoners/reasoners/benchmark/bw_utils.py", line 398, in apply_change
[rank0]: raise Exception("ERROR")
[rank0]: Exception: ERROR