Foto von Hu Cao

Dr. rer. nat. Hu Cao

Technische Universität München

Informatik 6 - Lehrstuhl für Robotik, Künstliche Intelligenz und Echtzeitsysteme (Prof. Knoll)

Postadresse

Postal:
Boltzmannstr. 3
85748 Garching b. München

Dienstort

Informatik 6 - Lehrstuhl für Robotik, Künstliche Intelligenz und Echtzeitsysteme (Prof. Knoll)

Work:
Boltzmannstr. 3(5607)/III
85748 Garching b. München

  • Sprechstunde: Appointment by e-mail
  • Raum: 5607.03.057
  • hu.cao(at)tum.de

Curriculum Vitae

I am a postdoctoral research associate at the Chair of Robotics, AI, and Real-Time Systems at TUM, under the supervision of Prof. Alois Knoll (IEEE Fellow). I earned my Ph.D. from the same lab. Before joining TUM, I conducted research at Tongji University. My research interests include autonomous driving, robotic grasping, medical image analysis, and dense prediction (classification, detection, and segmentation). I have been a guest academic at ETH Zurich (supervised by Prof. Lothar Thiele) and HKU (working with Prof. Hengshuang Zhao), and I completed a research internship at Huawei under the supervision of Prof. Qi Tian (IEEE Fellow).

I have published several papers at top AI and robotics conferences and journals, including TPAMI, TAI, SPM, TITS, TIV, T-MECH, TIM, CVPR, ECCV, ICRA, and IROS. My works have garnered over 3808 Google Scholar citations. Additionally, I was a distinguished reviewer for IEEE TMI for 2022–2023 and was invited to organize special issues for Frontiers in Neuroscience and Frontiers in Robotics and AI (both SCI journals).

Online Profile

Academic Activities

Offered Research Topics (Guided Research, FP, IDP, SA, BA, MA, etc.)

The general research focus is as follows:

  • Topic 1: Vision language model for robotic grasp pose estimation (4D and 6D).
  • Topic 2: Object detection and semantic segmentation for autonomous driving.
  • Topic 3: Multi-modal or multi-sensor fusion for robust object perception (2D/3D detection, segmentation, depth estimation, end-to-end autonomous driving, etc.).
  • Topic 4: Correspondence-free absolute pose estimation algorithm (point cloud registration or globally optimal algorithms).
  • Topic 5: Large language model and vision language model for robotics (autonomous vehicles or robotic grasping).
  • Topic 6: Medical image segmentation.

I am also looking for highly self-motivated students to work on risk-based safety autonomous driving research. The topics include:

  • Topic 1: LLM for safety-critical scenario generation for autonomous vehicles.
  • Topic 2: Bayesian networks for real-time risk assessment in ADS.
  • Topic 3: Risk quantification for automated driving systems based on SOTIF (ISO 21448), Responsibility Sensitive Safety (RSS), and Safety Force Field (SFF).
  • Topic 4: Uncertainty estimation for autonomous driving perception.
  • Topic 5: Modality-Incomplete autonomous driving perception (e.g., sensor failure).
  • Topic 6: Autonomous driving perception based on adverse weather image restoration.

If you are interested in these research topics, please send me an email with your CV and transcript of records. We also have several other open topics in robotics and welcome proposals or ideas from your side. For more information, please contact hu.cao@tum.de

Demos for Autonomous Driving and Robotic Grasping

Publications

2024

  • Cao, Hu; Chen, Guang; Zhao, Hengshuang; Jiang, Dongsheng; Zhang, Xiaopeng; Tian, Qi; Knoll, Alois: SDPT: Semantic-Aware Dimension-Pooling Transformer for Image Segmentation. IEEE Transactions on Intelligent Transportation Systems, 2024, 1-13 more… BibTeX Full text ( DOI )
  • Cao, Hu; Zhang, Zehua; Xia, Yan; Li, Xinyi; Xia, Jiahao; Chen, Guang; Knoll, Alois: Embracing Events and Frames with Hierarchical Feature Refinement Network for Object Detection. ECCV, 2024 more… BibTeX Full text ( DOI )
  • Hümmer, Christoph; Schwonberg, Manuel; Zhou, Liangwei; Cao, Hu; Knoll, Alois; Gottschalk, Hanno: VLTSeg: Simple Transfer of CLIP-Based Vision-Language Representations for Domain Generalized Semantic Segmentation. ACCV, 2024 more… BibTeX Full text ( DOI )
  • Li, Xinyi; Cao, Hu; Liu, Yinlong; Liu, Xueli; Zhang, Feihu; Knoll, Alois: Efficient and Deterministic Search Strategy Based on Residual Projections for Point Cloud Registration With Correspondences. IEEE Transactions on Intelligent Vehicles, 2024, 1-16 more… BibTeX Full text ( DOI )
  • Li, Xinyi; Ma, Zijian; Liu, Yinlong; Zimmer, Walter; Cao, Hu; Zhang, Feihu; Knoll, Alois: Transformation Decoupling Strategy based on Screw Theory for Deterministic Point Cloud Registration with Gravity Prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 1-18 more… BibTeX Full text ( DOI )
  • Song, Rui; Liang, Chenwei; Cao, Hu; Yan, Zhiran; Zimmer, Walter; Gross, Markus; Festag, Andreas; Knoll, Alois: Collaborative Semantic Occupancy Prediction with Hybrid Feature Fusion in Connected Automated Vehicles. 2024 IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR), 2024 more… BibTeX
  • Zhou, Xingcheng; Liu, Mingyu; Yurtsever, Ekim; Zagar, Bare Luka; Zimmer, Walter; Cao, Hu; Knoll, Alois C.: Vision Language Models in Autonomous Driving: A Survey and Outlook. IEEE Transactions on Intelligent Vehicles, 2024, 1-20 more… BibTeX Full text ( DOI )

2023

  • Cao, Hu; Qu, Zhongnan; Chen, Guang; Li, Xinyi; Thiele, Lothar; Knoll, Alois: GhostViT: Expediting Vision Transformers Via Cheap Operations. IEEE Transactions on Artificial Intelligence, 2023, 1-9 more… BibTeX Full text ( DOI )
  • Li, Xinyi; Liu, Yinlong; Lakshminarasimhan, Venkatnarayanan; Cao, Hu; Zhang, Feihu; Knoll, Alois: Globally Optimal Robust Radar Calibration in Intelligent Transportation Systems. IEEE Transactions on Intelligent Transportation Systems, 2023, 1-14 more… BibTeX Full text ( DOI ) Full text (mediaTUM)
  • Li, Xinyi; Liu, Yinlong; Xia, Yan; Lakshminarasimhan, Venkatnarayanan; Cao, Hu; Zhang, Feihu; Stilla, Uwe; Knoll, Alois: Fast and deterministic (3+1)DOF point set registration with gravity prior. ISPRS Journal of Photogrammetry and Remote Sensing 199, 2023, 118-132 more… BibTeX Full text ( DOI )

2022

  • Cao, Hu; Chen, Guang; Li, Zhijun; Feng, Qian; Lin, Jianjie; Knoll, Alois: Efficient Grasp Detection Network With Gaussian-Based Grasp Representation for Robotic Manipulation. IEEE/ASME Transactions on Mechatronics, 2022, 1-11 more… BibTeX Full text ( DOI )
  • Cao, Hu; Chen, Guang; Li, Zhijun; Hu, Yingbai; Knoll, Alois: NeuroGrasp: Multimodal Neural Network With Euler Region Regression for Neuromorphic Vision-Based Grasp Pose Estimation. IEEE Transactions on Instrumentation and Measurement 71, 2022, 1-11 more… BibTeX Full text ( DOI ) Full text (mediaTUM)
  • Cao, Hu; Peng, Boyang; Jia, Linxuan; Li, Bin; Knoll, Alois; Chen, Guang: Orientation-aware People Detection and Counting Method based on Overhead Fisheye Camera. 2022 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), IEEE, 2022 more… BibTeX Full text ( DOI )
  • Zhuang, Genghang; Cagnetta, Carlo; Bing, Zhenshan; Cao, Hu; Li, Xinyi; Huang, Kai; Knoll, Alois: A Biologically-Inspired Global Localization System for Mobile Robots Using LiDAR Sensor. 2022 IEEE Intelligent Vehicles Symposium (IV), IEEE, 2022 more… BibTeX Full text ( DOI ) Full text (mediaTUM)

2021

  • Cao, Hu; Chen, Guang; Li, Zhijun; Lin, Jianjie; Knoll, Alois: Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection. , 2021 more… BibTeX Full text ( DOI )
  • Cao, Hu; Chen, Guang; Li, Zhijun; Lin, Jianjie; Knoll, Alois: Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection. 2021 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2021 more… BibTeX Full text ( DOI ) Full text (mediaTUM)
  • Cao, Hu; Chen, Guang; Xia, Jiahao; Zhuang, Genghang; Knoll, Alois: Fusion-based Feature Attention Gate Component for Vehicle Detection based on Event Camera. IEEE Sensors Journal, 2021, 1-1 more… BibTeX Full text ( DOI ) Full text (mediaTUM)

2020

  • Chen, Guang and Cao, Hu and Conradt, Jörg and Tang, Huajin and Röhrbein, Florian and Knoll, Alois: Event-based Neuromorphic Vision for Autonomous Driving: A Paradigm Shift for Bio-inspired Visual Sensing and Perception. IEEE Signal Processing Magazine, 2020 more… BibTeX Full text ( DOI ) Full text (mediaTUM)
  • Hu, Yingbai; Chen, Guang; Zhang, Longbin; Su, Hang; Li, Mengyao; Schmirander, Yunus; Cao, Hu; Knoll, Alois: Fuzzy Adaptive Control-based Real-time Obstacle Avoidance under Uncertain Perturbations. 2020 5th International Conference on Advanced Robotics and Mechatronics (ICARM), 2020 more… BibTeX Full text ( DOI ) Full text (mediaTUM)
  • Li, Wei; Cao, Hu; Liao, Jiacai; Xia, Jiahao; Cao, Libo; Knoll, Alois: Parking Slot Detection on Around-View Images Using DCNN. Frontiers in Neurorobotics 14, 2020 more… BibTeX Full text ( DOI ) Full text (mediaTUM)

2019

  • Chen, Guang; Cao, Hu; Ye, Canbo; Zhang, Zhenyan; Liu, Xingbo; Mo, Xuhui; Qu, Zhongnan; Conradt, Jörg; Röhrbein, Florian; Knoll, Alois: Multi-Cue Event Information Fusion for Pedestrian Detection With Neuromorphic Vision Sensors. Frontiers in Neurorobotics 13, 2019 more… BibTeX Full text ( DOI ) Full text (mediaTUM)

2018

  • Chen, Guang; Cao, Hu; Aafaque, Muhammad; Chen, Jieneng; Ye, Canbo; Röhrbein, Florian; Conradt, Jörg; Chen, Kai; Bing, Zhenshan; Liu, Xingbo; Hinz, Gereon; Stechele, Walter; Knoll, Alois: Neuromorphic Vision Based Multivehicle Detection and Tracking for Intelligent Transportation System. Journal of Advanced Transportation 2018, 2018, 1-13 more… BibTeX Full text ( DOI ) Full text (mediaTUM)