个人资料:
姓名:徐宁
职称:副教授/硕士生导师/博士生导师团
学科专业:信息与通信工程(一级学科)/信号与信息处理(二级学科)
通讯地址:天津大学电气自动化与信息工程学院26教学楼D区
电子信箱:ningxu@tju.edu.cn
个人主页:https://ningxu1990.github.io
主要经历:
(1) 2022.05-至今 天津大学电气自动化与信息工程学院,信息与通信工程,副教授
(2) 2019.07-2022.04 天津大学电气自动化与信息工程学院,信息与通信工程,讲师
(3) 2016.03-2017.03 新加坡国立大学,计算机学院,博士联合培养
(4) 2013.09-2019.06 天津大学电气自动化与信息工程学院,信息与通信工程,硕博连读
研究方向:
(1) 计算机视觉
(2) 因果推理
(3) “视觉-语言”相互生成
(4) 视觉关系识别
(5) 视觉问答与对话
主要科研项目:
(1) 2021.01-2023.12 国家自然科学基金青年项目,负责人
(2) 2021.07-2023.06 中国博士后科学基金面上项目,负责人
(3) 2022.01-2025.12 国家自然科学基金联合重点项目,主要参与人
(4) 2020.11-2023.10 国家重点研发计划项目子课题,主要参与人
代表性论著、学术著作:
录用/发表学术论文40余篇,部分代表性论文如下:
(1) Ning Xu, Yifei Gao, An-An Liu*, Hongshuo Tian, Yongdong Zhang: Multi-modal Validation and Domain Interaction Learning for Knowledge-based Visual Question Answering. IEEE Trans. Knowl. Data Eng. (DOI: 10.1109/TKDE.2024.3384270)
(2) Ning Xu, Zimu Lu, Hongshuo Tian, Rongbao Kang, Jinbo Cao, Yongdong Zhang, An-An Liu*: Learning to Supervise Knowledge Retrieval over a Tree Structure for Visual Question Answering. IEEE Trans. Multim. 26: 6689-6700 (2024)
(3) An-An Liu, Yingchen Zhai, Ning Xu*, Hongshuo Tian, Weizhi Nie, Yongdong Zhang: Event-aware Retrospective Learning for Knowledge-based Image Captioning. IEEE Trans. Multim. 26: 4898-4911 (2024)
(4) An-An Liu, Chenxi Huang, Ning Xu*, Hongshuo Tian, Jing Liu, Yongdong Zhang: Counterfactual Visual Dialog: Robust Commonsense Knowledge Learning from Unbiased Training. IEEE Trans. Multim. 26: 1639-1651 (2024)
(5) Hongshuo Tian, Ning Xu*, Yanhui Wang, Chenggang Yan, Bolun Zheng, Xuanya Li, An-An Liu*: Towards Confidence-Aware Commonsense Knowledge Integration for Scene Graph Generation. ICME 2023: 2255-2260.
(6) An-An Liu, Hongwei Du, Ning Xu*, Quan Zhang, Shenyuan Zhang, Yejun Tang, Xuanya Li: Exploring visual relationship for social media popularity prediction. J. Vis. Commun. Image Represent. 90: 103738 (2023).
(7) An-An Liu, Hongshuo Tian, Ning Xu*, Weizhi Nie, Yongdong Zhang, M. Kankanhalli: Toward Region-Aware Attention Learning for Scene Graph Generation. IEEE Trans. Neural Networks Learn. Syst. 33(12): 7655-7666 (2022)
(8) Yanhui Wang, Ning Xu*, An-An Liu*, Wenhui Li, Yongdong Zhang: High-Order Interaction Learning for Image Captioning. IEEE Trans. Circuits Syst. Video Techn. 32(7): 4417-4430 (2022)
(9) An-An Liu, Yingchen Zhai, Ning Xu∗, Weizhi Nie, Wenhui Li∗, Yongdong Zhang: Region-Aware Image Captioning via Interaction Learning. IEEE Trans. Circuits Syst. Video Technol. 32(6): 3685-3696 (2022)
(10) Ning Xu, An-An Liu*, Yongkang Wong, Weizhi Nie, Yuting Su, Mohan S. Kankanhalli: Scene Graph Inference via Multi-Scale Context Modeling. IEEE Trans. Circuits Syst. Video Technol. 31(3): 1031-1041 (2021)
(11) An-An Liu, Yanhui Wang, Ning Xu*, Weizhi Nie, Jie Nie*, Yongdong Zhang: Adaptively Clustering-Driven Learning for Visual Relationship Detection. IEEE Trans. Multim. 23: 4515-4525 (2021)
(12) Weizhi Nie, Jiesi Li, Ning Xu*, An-An Liu*, Xuanya Li, Yongdong Zhang: Triangle-Reward Reinforcement Learning: A Visual-Linguistic Semantic Alignment for Image Captioning. ACM Multimedia 2021: 4510-4518
(13) Ning Xu, Hongshuo Tian, Yanhui Wang, Weizhi Nie, Dan Song, An-An Liu*, Wu Liu: Coupled-dynamic learning for vision and language: Exploring Interaction between different tasks. Pattern Recognit.113:107829 (2021)
(14) Ning Xu, Hanwang Zhang, An-An Liu*, Weizhi Nie, Yuting Su, Jie Nie*, Yongdong Zhang: Multi-Level Policy and Reward-Based Deep Reinforcement Learning Framework for Image Captioning. IEEE Trans. Multim. 22(5): 1372-1383 (2020)
(15) Hongshuo Tian, Ning Xu*, An-An Liu*, Yongdong Zhang: Part-Aware Interactive Learning for Scene Graph Generation. ACM Multimedia 2020: 3155-3163
(16) Ning Xu, An-An Liu*, Yongkang Wong, Yongdong Zhang, Weizhi Nie, Yuting Su, Mohan S. Kankanhalli: Dual-Stream Recurrent Neural Network for Video Captioning. IEEE Trans. Circuits Syst. Video Technol. 29(8): 2482-2493 (2019)
(17) An-An Liu*, Ning Xu*, Weizhi Nie*, Yuting Su, Yong-Dong Zhang: Multi-Domain and Multi-Task Learning for Human Action Recognition. IEEE Trans. Image Process. 28(2): 853-867 (2019)
(18) Ning Xu, An-An Liu*, Jing Liu*, Weizhi Nie, Yuting Su: Scene graph captioner: Image captioning based on structural visual representation. J. Visual Communication and Image Representation 58: 477-485 (2019)
(19) Ning Xu, An-An Liu*, Weizhi Nie, Yuting Su: Attention-in-Attention Networks for Surveillance Video Understanding in Internet of Things. IEEE Internet of Things Journal 5(5): 3419-3429 (2018)
(20) An-An Liu*, Ning Xu, Hanwang Zhang, Weizhi Nie, Yuting Su, Yongdong Zhang: Multi-Level Policy and Reward Reinforcement Learning for Image Captioning. IJCAI 2018: 821-827
(21) An-An Liu*, Ning Xu, Weizhi Nie, Yuting Su*, Yongkang Wong, Mohan S. Kankanhalli: Benchmarking a Multimodal and Multiview and Interactive Dataset for Human Action Recognition. IEEE Trans. Cybern. 47(7): 1781-1794 (2017)
(22) An-An Liu*, Ning Xu, Yongkang Wong, Junnan Li, Yuting Su, Mohan S. Kankanhalli: Hierarchical & multimodal video captioning: Discovering and transferring multimodal knowledge for vision to language. Computer Vision and Image Understanding 163: 113-125 (2017)
授权国内外发明专利6项,部分授权专利如下:
(1) 一种基于多粒度语义融合的视觉关系检测方法, 专利号: ZL202010998182.1
(2) 一种基于多模态学习的视觉对话生成方法及装置, 专利号: ZL202110848206.X
(3) Visual relationship detection method and system based on region-aware learning mechanisms, Patent No: US 11,301,725 B2
(4) Visual relationship detection method and system based on adaptive clustering learning, Patent No: US 11,361,186 B2
主要讲授课程:
(1) “视觉-语言”智能理解与生成(本科生)
(2) 信号处理实践(本科生)
(3) 视觉大数据学习和理解(博士生)
主要学术成就、奖励及荣誉:
(1) 2022年度天津市科学技术进步奖特等奖
(2) ACM Multimedia 2016 Grand Challenge MSR Video to Language, 排名第六(50个参赛队)
(3) TRECVID 2015国际顶级评测单项第一
学术服务:
(1) SCI期刊客座编辑:Information Processing & Management
(2) 审稿人:IEEE T-NNLS、IEEE T-MM、IEEE T-CSVT、ACM MM、IJCAI等
招生信息:
欢迎电子信息类、计算机类、软件类、数学类等有科研热情的同学参与课题研究