feat: change exp4 prompts from expr2

This commit is contained in:
Ting-Jun Wang 2025-01-12 17:35:58 +08:00
parent d39bdb54e6
commit f977d61ea8
Signed by: snsd0805
GPG Key ID: 48D331A3D6160354

View File

@ -244,9 +244,9 @@ Instruction: {action_plan}
Initial Observation: {init_observation}
Thought: I should start navigation according to the instruction, {agent_scratchpad}"""
VLN_GPT35_PROMPT = """As an intelligent embodied agent, you will navigate in an indoor environment to reach a target viewpoint to find the object based on a given instruction, performing the Vision and Language Navigation (VLN) task.
VLN_GPT35_PROMPT = """As an intelligent embodied agent, you will navigate in an indoor environment to reach a target viewpoint based on a given instruction, performing the Vision and Language Navigation (VLN) task.
The instruction will let you find all the target objects in a room. You should have a good stratedy to check all the object in the shortest path in the room.
The instruction will let you find all the target objects in a building.
But if you find the target object, don't stop, keep exploring the whole room to find other objects but you still should have a good strategy, don't waste time and anergy to move.
@ -258,15 +258,14 @@ And we will calculate how many meters extend in the direction of each viewpoint
For example, if I have 2 viewpoints to choose (A: 1m, B: 5m) but I cannot find the target object so I better choose viewpoint B because I may have more exploration space to find the target.
- Notice: You should have a good strategy to check whether the target object exists in the target room, and stop when you exploring all viewpoint in the target room.
Explore the environment while avoiding revisiting viewpoints by comparing current and previously visited IDs and the most important thing is that you should not leave the room so you better not move closed to the door.
Notice: You should have a good strategy to check whether the target object exists in this room, and stop when you exploring all viewpoint in this room.
Explore the environment while avoiding revisiting viewpoints by comparing current and previously visited IDs
If you think you are moving in circles, please stop and think whether any other objects may be hiden. If no, please output 'Final Answer: Not found'.
Continue by considering your location and the next viewpoint based on the instruction, using the action_maker tool.
And if you explored all room(no other viewpoint to move to), stop and output 'Final Answer: Not found!'.
And if you explored all the target room(no other viewpoint to move to), stop and output 'Final Answer: Not found!'.
Show your reasoning in the Thought section.
Follow the given format and use provided tools.
@ -296,3 +295,4 @@ Begin!
Instruction: {action_plan}
Initial Observation: {init_observation}
Thought: I should start navigation according to the instruction, {agent_scratchpad}"""