Skip to content

Dataset and Source Code for EMNLP 2024 paper “NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding” (https://arxiv.org/abs/2404.13627)

License

Notifications You must be signed in to change notification settings

HKUST-KnowComp/NegotiationToM

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 

Repository files navigation

NegotiationToM

This repository provides the benchmark dataset for EMNLP 2024 paper NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding.

Dataset

The NegotiationToM dataset is in the NegotiationToM.zip file. To prevent data contamination, we set the password for the JSON file and the dataset password to "NegotiationToM."

Reference:

The details of this dataset and LLM performance are described in the following paper.

@article{DBLP:journals/corr/abs-2404-13627,
  author       = {Chunkit Chan and
                  Cheng Jiayang and
                  Yauwai Yim and
                  Zheye Deng and
                  Wei Fan and
                  Haoran Li and
                  Xin Liu and
                  Hongming Zhang and
                  Weiqi Wang and
                  Yangqiu Song},
  title        = {NegotiationToM: {A} Benchmark for Stress-testing Machine Theory of
                  Mind on Negotiation Surrounding},
  journal      = {CoRR},
  volume       = {abs/2404.13627},
  year         = {2024},
  url          = {https://doi.org/10.48550/arXiv.2404.13627},
  doi          = {10.48550/ARXIV.2404.13627},
  eprinttype    = {arXiv},
  eprint       = {2404.13627},
  timestamp    = {Wed, 26 Jun 2024 15:02:52 +0200},
  biburl       = {https://dblp.org/rec/journals/corr/abs-2404-13627.bib},
  bibsource    = {dblp computer science bibliography, https://dblp.org}
}

About

Dataset and Source Code for EMNLP 2024 paper “NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding” (https://arxiv.org/abs/2404.13627)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published