Minheng Ni

Minheng Ni

He/Him

Research Intern @ Microsoft | Ph.D. Candidate @ PolyU

Research

Publications

  1. M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
    Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Dongdong Zhang, Nan Duan
    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  2. ImaginaryNet: Learning Object Detectors without Real Images and Annotations
    Minheng Ni, Zitong Huang, Kailai Feng, Wangmeng Zuo
    Proceedings of the International Conference on Learning Representations (ICLR), 2023.
  3. NÜWA-LIP: Language Guided Image Inpainting with Defect-free VQGAN
    Minheng Ni, Xiaoming Li, Wangmeng Zuo
    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  4. ORES: Open-vocabulary Responsible Visual Synthesis
    Minheng Ni, Chenfei Wu, Xiaodong Wang, Shengming Yin, Lijuan Wang, Zicheng Liu, Nan Duan
    Proceedings of the AAAI conference on Artificial Intelligence (AAAI), 2023.
  5. Responsible Visual Editing
    Minheng Ni, Yeli Shen, Lei Zhang, Wangmeng Zuo
    Proceedings of the European Conference on Computer Vision (ECCV), 2024.
  6. Ref-diff: Zero-shot Referring Image Segmentation with Generative Models
    Minheng Ni, Yabo Zhang, Kailai Feng, Xiaoming Li, Yiwen Guo, Wangmeng Zuo
    ArXiv Preprint, 2023.
  7. AutoDirector: Online Auto-scheduling Agents for Multi-sensory Composition
    Minheng Ni, Chenfei Wu, Huaying Yuan, Zhengyuan Yang, Ming Gong, Lijuan Wang, Zicheng Liu, Wangmeng Zuo, Nan Duan
    ArXiv Preprint, 2024.
  8. Visual-O1: Understanding Ambiguous Instructions via Multi-modal Multi-turn Chain-of-thoughts Reasoning
    Minheng Ni, Yutao Fan, Lei Zhang, Wangmeng Zuo
    ArXiv Preprint, 2024.
  9. Cosda-ml: Multi-lingual Code-switching Data Augmentation for Zero-shot Cross-lingual NLP
    Libo Qin, Minheng Ni, Yue Zhang, Wanxiang Che
    Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence (IJCAI), 2021.
  10. Multi-Attentional Distance for Zero-Shot Classification with Text-to-Image Diffusion Model
    Kailai Feng, Minheng Ni, Jiaxiu Jiang, Zhilu Zhang, Wangmeng Zuo
    Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), 2024
  11. Knowing Where to Leverage: Context-aware Graph Convolutional Network with an Adaptive Fusion Layer for Contextual Spoken Language Understanding
    Libo Qin, Wanxiang Che, Minheng Ni, Yangming Li, Ting Liu
    IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP), 2021.
  12. Multi-domain Spoken Language Understanding Using Domain-and Task-aware Parameterization
    Libo Qin, Wanxiang Che, Minheng Ni, Yangming Li, Ting Liu
    ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 2022.
  13. Dcr-net: A Deep Co-interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classification
    Libo Qin, Wanxiang Che, Yangming Li, Minheng Ni, Ting Liu
    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2020.
  14. Co-gat: A Co-interactive Graph Attention Network for Joint Dialog Act Recognition and Sentiment Classification
    Libo Qin, Zhouyang Li, Wanxiang Che, Minheng Ni, Ting Liu
    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2021.
  15. StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis
    Zecheng Tang, Chenfei Wu, Zekai Zhang, Minheng Ni, Shengming Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan
    Proceedings of the International Conference on Machine Learning (ICML), 2024.
  16. Learning 3D Photography Videos via Self-supervised Diffusion on Single Images
    Xiaodong Wang, Chenfei Wu, Shengming Yin, Minheng Ni, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Fan Yang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan
    Proceedings of the Thirty-Second International Conference on International Joint Conferences on Artificial Intelligence (IJCAI), 2023.
  17. NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
    Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Gong Ming, Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
    Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), 2023.
Please find my most up-to-date papers on my Google Scholar profile.

Services

Journal Reviewer

Conference Reviewer