Perception and Decision-Making Methods for Multi-Task Collaborative Robots Based on Embodied Intelligence

Authors

  • Noah Albright Department of Mechanical and Automation Engineering, Chinese University of Hong Kong, Hong Kong, China
  • Noah Dominguez Department of Mechanical and Automation Engineering, Chinese University of Hong Kong, Hong Kong, China

Keywords:

Embodied Intelligence, Multi-Agent Systems, Collaborative Robotics, Reinforcement Learning, Multi-Modal Perception

Abstract

The paradigm of embodied intelligence emphasizes the indispensable role of physical interaction and morphology in the development of cognitive abilities for artificial agents. As the demand for scalable and flexible automation grows, multi-task collaborative robotics has emerged as a critical domain necessitating sophisticated perception and decision-making capabilities. This paper investigates advanced methodologies for enabling distributed robotic swarms and collaborative manipulators to perceive complex, dynamic environments and execute joint actions in multi-task scenarios. We propose a comprehensive framework that integrates multi-modal sensory fusion with decentralized reinforcement learning to address the high-dimensional state spaces and partial observability inherent in multi-agent physical systems. By treating perception not as a passive data collection process but as an active, task-driven mechanism, the proposed architecture drastically reduces the cognitive load on individual agents while maintaining robust collective performance. Furthermore, we introduce an embodied decision-making algorithm based on a multi-agent actor-critic architecture, formulated to optimize long-horizon collaborative tasks through intrinsic motivation and communication-efficient state sharing. Extensive simulations conducted in realistic physics environments demonstrate that our method significantly outperforms traditional centralized control and independent reinforcement learning baselines in terms of task success rate, collision avoidance, and adaptability to novel scenarios. The findings presented in this study provide a robust theoretical and empirical foundation for the next generation of embodied robotic systems operating in unconstrained, human-centric environments.

References

1. Norris, J., He, Z., Qu, Y., Chen, G., Hertzog, C., & Jin, D. (2025, September). An in-network approach for pmu missing data recovery with data plane programmability. In 2025 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) (pp. 1-7). IEEE.

2. Xu, Y., Shao, K., Ishikawa, I., Hashimoto, Y., Logothetis, N., & Shen, Z. (2025). A data-driven framework for Koopman semigroup estimation in stochastic dynamical systems. Chaos: An Interdisciplinary Journal of Nonlinear Science, 35(10).

3. Lv, Q., Kong, W., Li, H., Zeng, J., Qiu, Z., Qu, D., ... & Pang, J. (2025). F1: A vision-language-action model bridging understanding and generation to actions. arXiv preprint arXiv:2509.06951.

4. Wang, Y., Ding, P., Li, L., Cui, C., Ge, Z., Tong, X., ... & Wang, D. (2025). Vla-adapter: An effective paradigm for tiny-scale vision-language-action model. arXiv preprint arXiv:2509.09372.

5. Zhao, H., Wang, Q., Zhan, G., Min, W., Zou, Y., & Cui, S. (2022). Need only one more point (NOOMP): Perspective adaptation crowd counting in complex scenes. IEEE Transactions on Multimedia, 25, 1414-1426.

6. Tang, Y., Kojima, K., Gotoda, M., Nishikawa, S., Hayashi, S., Koike-Akino, T., ... & Klamkin, J. (2020). InP grating coupler design for vertical coupling of InP and silicon chips. Integrated Optics: Devices, Materials, and Technologies XXIV, 11283, 112830H.

7. Zhang, W., Zhang, C., Luo, Z., Ma, J., Yuan, W., Gu, C., & Feng, C. (2025). SemanticForge: Repository-Level Code Generation through Semantic Knowledge Graphs and Constraint Satisfaction. arXiv preprint arXiv:2511.07584.

8. Fan, J., Liang, W., & Zhang, W. Q. (2025). SARNet: A Spike-Aware consecutive validation Framework for Accurate Remaining Useful Life Prediction. arXiv preprint arXiv:2510.22955.

9. Wu, J., Sun, Y., Xie, T., Chen, S., Bao, J., Xu, Y., ... & Wang, X. (2026). Cross-Modal Memory Compression for Efficient Multi-Agent Debate. arXiv preprint arXiv:2602.00454.

10. Liu, J. (2025, May). Reinforcement learning-controlled subspace ensemble sampling for complex data structures. In 2025 IEEE 7th International Conference on Communications, Information System and Computer Engineering (CISCE) (pp. 590-594). IEEE.

11. Huang, Z., Xu, M., & Perry, S. (2025, November). RLD-GS: Reinforcement Learning-Driven Gaussian Splatting for High-Fidelity Neural Rendering. In International Conference on Neural Information Processing (pp. 268-282). Singapore: Springer Nature Singapore.

12. Huang, Y., Xu, J., Badiu, M. A., Chen, G., Coon, J., & Alouini, M. S. (2026). ISAC-Enabled Low-Overhead Beam Management: Performance Analysis and Pilot Optimization. IEEE Transactions on Wireless Communications.

13. Yang, D., Gao, Y., Wang, X., Yue, Y., Yang, Y., & Fu, M. (2025, May). Opengs-slam: Open-set dense semantic slam with 3d gaussian splatting for object-level scene understanding. In 2025 IEEE International Conference on Robotics and Automation (ICRA) (pp. 8486-8492). IEEE.

14. Mnih, V., Badia, A. P., Mirza, M., Graves, A., Harley, T., Lillicrap, T., et al. (2016). Asynchronous methods for deep reinforcement learning. In Proceedings of ICML.

15. Wang, J., Feng, X., Yu, Y., Wang, X., Werghi, N., Han, X., ... & Tashi, N. (2025). Fuzzy actor–critic learning-based interpretable control and stability-informed guarantee with error mapping for discrete-time nonlinear system. Chaos, Solitons & Fractals, 199, 116878.

16. Zhang, W., Luo, M., & Chen, Z. (2024, October). Hybrid Forecasting: ML Predictions of Lake-Effect Regional Extreme Precipitations. In 2024 7th International Conference on Universal Village (UV) (pp. 1-11). IEEE.

17. Zou, Y., Jin, S., Deng, A., Zhao, Y., Wang, J., & Chen, C. (2025). AIR: Enabling Adaptive, Iterative, and Reasoning-based Frame Selection For Video Question Answering. arXiv preprint arXiv:2510.04428.

18. Mur-Artal, R., & Tardós, J. D. (2017). ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Transactions on Robotics, 33(5), 1255–1262.

19. Xu, Y., Li, F., Fujisawa, M., Cheng, X., Marzouk, Y., & Ishikawa, I. (2025). Generative Modeling through Koopman Spectral Analysis: An Operator-Theoretic Perspective. arXiv preprint arXiv:2512.18837.

20. Lv, Q., Li, H., Deng, X., Shao, R., Li, Y., Hao, J., ... & Nie, L. (2025). Spatial-temporal graph diffusion policy with kinematic modeling for bimanual robotic manipulation. In Proceedings of the Computer Vision and Pattern Recognition Conference (pp. 17394-17404).

21. Wang, J., Feng, X., Yu, Y., Wang, X., Han, X., Shi, K., ... & Cai, J. (2024). Function-dependent neural-network-driven state feedback control and self-verification stability for discrete-time nonlinear system. Neurocomputing, 609, 128422.

22. Fan, P., Li, H., & Hu, M. (2026). Profit-Oriented Production and Pricing Optimization for Manufacturing Enterprises Using Proximal Policy Optimization. Economics and Management Innovation, 3(2), 8-17.

23. Fan, D., Feng, Q., Zhang, A., Liu, M., Ren, Y., & Wang, Y. (2023). Optimization of scheduling and timetabling for multiple electric bus lines considering nonlinear energy consumption model. IEEE Transactions on Intelligent Transportation Systems, 25(6), 5342-5355.

24. Wang, K., Hou, W., Hong, L., & Guo, J. (2025). Smart transparency: A user-centered approach to improving human–machine interaction in high-risk supervisory control tasks. Electronics, 14(3), 420.

25. Zhou Z, Leng N, Ma H, et al. Study on Real-Time Data Analysis and Intelligent Forecasting Methods for Integrated Circuit Supply Chains Based on Cloud Computing[C]//Proceedings of the 2nd International Symposium on Integrated Circuit Design and Integrated Systems. 2025: 245-250.

26. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017). Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347.

27. Tian, Y. (2025). Exploration of Power Market Dynamic Scheduling Algorithm Based on Reinforcement Learning. In Image Processing, Electronics and Computers (pp. 836-845). IOS Press.

28. Wang, C., Song, R., Muller, R., Monteuuis, J. P., Celik, Z. B., Petit, J., ... & Li, M. (2026, March). Cp-freezer: Latency attacks against vehicular cooperative perception. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 40, No. 2, pp. 1114-1122).

29. Wang, Y., Zhang, R., & Liu, J. (2023). RLS-DTS: Reinforcement-learning linguistic steganalysis in distribution-transformed scenario. IEEE Signal Processing Letters, 30, 1232-1236.

30. Bao, Z., Zhu, D., Jiang, L., Sheng, S., Wang, Z., & Zhang, H. (2025). SLOFetch: Compressed-Hierarchical Instruction Prefetching for Cloud Microservices. arXiv preprint arXiv:2511.04774.

31. Wang, R., Guo, T., Li, Y., Meng, D., & Liang, B. (2025). Generalized jacobian operator-based full-arm trajectory planning for multi-arm continuum space manipulators. Aerospace Science and Technology, 111559.

32. Muller, R., Song, R., Wang, C., Zhan, Y., Monteuuis, J. P., Man, Y., ... & Celik, Z. B. (2025, May). Investigating physical latency attacks against camera-based perception. In 2025 IEEE Symposium on Security and Privacy (SP) (pp. 4588-4605). IEEE.

33. Lv, Q., Deng, X., Chen, G., Wang, M. Y., & Nie, L. (2024). Decision mamba: A multi-grained state space model with self-evolution regularization for offline rl. Advances in neural information processing systems, 37, 22827-22849.

Porter, M. E. (1985). Competitive advantage: Creating and sustaining superior performance. Free Press.

Wirtz, B. W., Weyerer, J. C., & Geyer, C. (2019). Artificial intelligence and the public sector—Applications and challenges. International Journal of Public Administration, 42(7), 596–615. https://doi.org/10.1080/01900692.2018.1498103

Lee, I., & Shin, Y. J. (2018). Fintech: Ecosystem, business models, investment decisions, and challenges. Business Horizons, 61(1), 35–46. https://doi.org/10.1016/j.bushor.2017.09.003

Hart, S. L., & Dowell, G. (2011). A natural-resource-based view of the firm: Fifteen years after. Journal of Management, 37(5), 1464–1479. https://doi.org/10.1177/0149206310390219

Downloads

Published

2026-04-05