Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(rai_node): execute mission as ros2 action #208

Merged
merged 12 commits into from
Sep 17, 2024

Conversation

boczekbartek
Copy link
Member

@boczekbartek boczekbartek commented Sep 6, 2024

Purpose

  • This PR adds support for the execution of missions as ros2 actions.

Proposed Changes

  • implement mission in rai_node as ros2 actions. Action server is /perform_task.
  • refactor src/rai/rai/node.py
  • add expanders in streamlit UI for mission messages
  • slightly adjusted prompts

Issues

Testing

Terminal 1

. ./setup_shell.sh
ros2 run rai_whoami rai_whoami_node --ros-args -p robot_description_package:="rosbot_xl_whoami"

Terminal 2
Run simulation:
https://github.com/RobotecAI/rai-rosbot-xl-demo/releases/tag/v0.1.0

Terminal 3

cd src/examples/rosbot-xl-demo
./run-nav.bash

Terminal 4

. ./setup_shell.sh
python examples/rosbot-xl-generic-node-demo.py

Terminal 5

. ./setup_shell.sh
streamlit run src/rai_hmi/rai_hmi/streamlit_hmi_node.py rosbot_xl_whoami
  • User Streamlit Web UI to add tasks to husarion. For example:
  • "spin 90 degrees to the right"

TODOs

  • Only 1 mission is supported at once:
    image
  • Agent can respond in a template to easily parse to rai_interfaces/../Task.action
  • Fix [WARN] [1725631842.744809111] [rai_node.action_server]: Goal state not set, assuming aborted. Goal ID: [143 141 99 196 101 201 72 161 176 90 69 28 3 219 125 208]
  • Fix tool calling in src/rai/rai/node.py

@boczekbartek boczekbartek changed the title feat(rai_node): handle tasks as ros2 actions feat(rai_node): execute mission as ros2 action Sep 6, 2024
@boczekbartek boczekbartek force-pushed the bb/rai_node/handle_task_as_action branch from 0c7080f to c652e4c Compare September 6, 2024 10:45
@boczekbartek boczekbartek force-pushed the bb/rai_node/handle_task_as_action branch from 6022271 to 165b51d Compare September 17, 2024 08:11
@boczekbartek boczekbartek marked this pull request as ready for review September 17, 2024 08:19
@boczekbartek boczekbartek merged commit f84f3ec into refactor/hmi Sep 17, 2024
1 check passed
@boczekbartek boczekbartek deleted the bb/rai_node/handle_task_as_action branch September 17, 2024 10:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants