| Google Scholar | Linkedin |
| Semantic Scholar | GitHub |
| WoS | ORCID | DBLP | CV |

I am looking for Postdoc opportunity starting from Mar 2025.
Please feel free to contact me :)

I'm a final year Ph.D. student in the ARISE Lab of the Computer Science and Engineering (CSE) Department at the Chinese University of Hong Kong (CUHK), supervised by Prof. Michael R. Lyu. Currently, my research interest lies in large language models + social science, such as psychology, sociology, and economics. Also, I work closely with Dr. Wenxiang Jiao and Dr. Zhaopeng Tu at the NLP Center of Tencent AI Lab.

I obtained my B.Sc. in Computer Science at Peking University in 2019. I was a student in Yuanpei College, where students can choose any majors and take any courses from the entire university. This chance made me able to enjoy the knowledge not only in computer science, but also psychology, sociology, economics, and philosophy.

• [Jan. 2024] Two papers are accepted to ICLR'24! Our PsychoBench will have an ORAL presentation.
• [Oct. 2023] One paper is accepted to Findings of EMNLP'23!
• [Jul. 2023] One paper is accepted to ASE'23!
• [Feb. 2023] One paper is accepted to CVPR'23!
---- show more ----
[Dec. 2022] One paper is accepted to ICSE'23!
[Sep. 2022] We win the first place in WMT'22: Large-Scale Machine Translation Evaluation for African Languages!
[Apr. 2022] One paper is accepted to ISSTA'22!
[Mar. 2022] I join the NLP Center of Tencent AI Lab as a research intern, supervised by Dr. Wenxiang Jiao and Dr. Zhaopeng Tu.
[Mar. 2022] One paper is accepted to CVPR'22!
[Aug. 2020] I join the ARISE Lab as a Ph.D. student in CSE Department at the Chinese University of Hong Kong (CUHK), supervised by Prof. Michael R. Lyu.
[Feb. 2020] I become a research assistant of Prof. Michael R. Lyu in CSE Department at the Chinese University of Hong Kong (CUHK).
[Sep. 2019] I have to fulfill the compulsory military service in Taiwan. See you four months later!
[Jun. 2019] I graduate from Yuanpei College at Peking University!
[Nov. 2018] My undergraduate final year project is supervised by Prof. Bolei Zhou and Prof. Jiaying Liu.
[Feb. 2018] I join the Research Department at SenseTime as a research intern, supervised by Dr. Chen Qian and Prof. Bolei Zhou.

• [Apr 23 2024] "Studying Machine Intelligence through Social Science," at University of Southern California, Online.
• [Apr 3 2024] "On the Humanity of Large Language Models," at Shanghai Jiaotong University, Shanghai.
• [Apr 2 2024] "On the Humanity of Large Language Models," at Fudan University, Shanghai. [News (Chinese)]
• [Mar 6 2024] Youth PhD Talk-ICLR 2024, AI TIME, Online. [News (Chinese)]

How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environments
Jen-tse Huang, Eric John Li, Man Ho Lam, Tian Liang, Wenxuan Wang, Youliang Yuan, Wenxiang Jiao, Xing Wang, Zhaopeng Tu, Michael R. Lyu
arXiv, 2024
| arXiv | code |

Revisiting the Reliability of Psychological Scales on Large Language Models
Jen-tse Huang, Wenxuan Wang, Man Ho Lam, Eric John Li, Wenxiang Jiao, Michael R. Lyu
arXiv, 2023
| arXiv | code |

Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBench
Jen-tse Huang, Man Ho Lam, Eric John Li, Shujie Ren, Wenxuan Wang, Wenxiang Jiao, Zhaopeng Tu, Michael R. Lyu
arXiv, 2023
| arXiv | code |

Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models
Wenxuan Wang, Wenxiang Jiao, Jingyuan Huang, Ruyi Dai, Jen-tse Huang, Zhaopeng Tu, Michael R. Lyu
arXiv, 2023
| arXiv |

All Languages Matter: On the Multilingual Safety of Large Language Models
Wenxuan Wang, Zhaopeng Tu, Chang Chen, Youliang Yuan, Jen-tse Huang, Wenxiang Jiao, Michael R. Lyu
arXiv, 2023
| arXiv | code |

InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews
Xintao Wang, Yunze Xiao, Jen-tse Huang, Siyu Yuan, Rui Xu, Haoran Guo, Quan Tu, Yaying Fei, Ziang Leng, Wei Wang, Jiangjie Chen, Cheng Li, Yanghua Xiao
arXiv, 2023
| arXiv | code | demo | homepage |

Leveraging Word Guessing Games to Assess the Intelligence of Large Language Models
Tian Liang, Zhiwei He, Jen-tse Huang, Wenxuan Wang, Wenxiang Jiao, Rui Wang, Yujiu Yang, Zhaopeng Tu, Shuming Shi, Xing Wang
arXiv, 2023
| arXiv | code |

How Well Can LLMs Echo Us? Evaluating AI Chatbots' Role-Play Ability with ECHO
Man Tik Ng, Hui Tung Tse, Jen-tse Huang, Jingjing Li, Wenxuan Wang, Michael R. Lyu
arXiv, 2024
| arXiv | code |

A ∧ B ⇔ B ∧ A: Triggering Logical Reasoning Failures in Large Language Models
Yuxuan Wan, Wenxuan Wang, Yiliu Yang, Youliang Yuan, Jen-tse Huang, Pinjia He, Wenxiang Jiao, Michael R. Lyu
arXiv, 2024
| arXiv |

The Earth is Flat? Unveiling Factual Errors in Large Language Models
Wenxuan Wang, Juluan Shi, Zhaopeng Tu, Youliang Yuan, Jen-tse Huang, Wenxiang Jiao, Michael R. Lyu
arXiv, 2024
| arXiv |

New Job, New Gender? Measuring the Social Bias in Image Generation Models
Wenxuan Wang, Haonan Bai, Jen-tse Huang, Yuxuan Wan, Youliang Yuan, Haoyi Qiu, Nanyun Peng, Michael R. Lyu
arXiv, 2024
| arXiv |

Is ChatGPT A Good Translator? Yes With GPT-4 As The Engine
Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Xing Wang, Shuming Shi, Zhaopeng Tu
arXiv, 2023
| arXiv | code |

On the Humanity of Conversational AI: Evaluating the Psychological Portrayal of LLMs
Jen-tse Huang, Wenxuan Wang, Eric John Li, Man Ho Lam, Shujie Ren, Youliang Yuan, Wenxiang Jiao, Zhaopeng Tu, Michael R. Lyu
[Oral Presentation] ICLR, 2024
| arXiv | code |

GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher
Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Pinjia He, Shuming Shi, Zhaopeng Tu
ICLR, 2024
| arXiv | code |

ParroT: Translating During Chat Using Large Language Models tuned with Human Translation and Feedback
Wenxiang Jiao, Jen-tse Huang, Wenxuan Wang, Zhiwei He, Tian Liang, Xing Wang, Shuming Shi, Zhaopeng Tu
EMNLP Findings, 2023
| arXiv | code |

An Image is Worth a Thousand Toxic Words: A Metamorphic Testing Framework for Content Moderation Software
Wenxuan Wang, Jingyuan Huang, Jen-tse Huang, Chang Chen, Jiazhen Gu, Pinjia He, Michael R. Lyu
ASE, 2023
| arXiv |

Improving the Transferability of Adversarial Samples by Path-Augmented Method
Jianping Zhang, Jen-tse Huang, Wenxuan Wang, Yichen Li, Weibin Wu, Xiaosen Wang, Yuxin Su, Michael R. Lyu
CVPR, 2023
| arXiv |

MTTM: Metamorphic Testing for Textual Content Moderation Software
Wenxuan Wang, Jen-tse Huang, Weibin Wu, Jianping Zhang, Yizhan Huang, Shuqing Li, Pinjia He, Michael Lyu
ICSE, 2023
| arXiv | code |

Tencent's Multilingual Machine Translation System for WMT22 Large-Scale African Languages
Wenxiang Jiao, Zhaopeng Tu, Jiarui Li, Wenxuan Wang, Jen-tse Huang, Shuming Shi
WMT, 2022
| arXiv | code |

AEON: A Method for Automatic Evaluation of NLP Test Cases
Jen-tse Huang, Jianping Zhang, Wenxuan Wang, Pinjia He, Yuxin Su, Michael R. Lyu
ISSTA, 2022
| arXiv | code |

Improving Adversarial Transferability via Neuron Attribution-Based Attacks
Jianping Zhang, Weibin Wu, Jen-tse Huang, Yizhan Huang, Wenxuan Wang, Yuxin Su, Michael R. Lyu
CVPR, 2022
| arXiv | code |

• LAM, Man Ho (林文昊), LLM + Psychology, CUHK Undergrad 2024
• LI, Eric John (李銘勳), LLM + Psychology, CUHK Undergrad 2024
• NG, Man Tik (吳文廸), Role-Playing LLM, CUHK Undergrad 2024
• TSE, Hui Tung (謝栩棟), Role-Playing LLM, CUHK Undergrad 2024
• LIU, Linqi (劉林其), LLM + Sociology, CUHK Undergrad 2025
• YAN, Yuhang (閆禹杭), LLM + Sociology, CUHK Undergrad 2025
• QIN, Jiantong (秦健桐), VLM Social Biases, CUHK Undergrad 2026

Rm 101A, 1F, Ho Sin-Hang Engineering Building
The Chinese University of Hong Kong
Sha Tin, New Territories, Hong Kong

Website design: ✩