0
Secret Keepers: The Impact of LLMs on Linguistic Markers of Personal Traits
XaWzR08-T68q5yx4oxBon-QTRMRNx2mpea5ojwSccFs
File Type
PDF
Entry Count
108
Embed. Model
jina_embeddings_v2_base_en
Index Type
hnsw

Prior research has established associations between individuals’ languageusage and their personal traits; our linguistic patterns reveal informationabout our personalities, emotional states, and beliefs. However, with the increasing adoption of Large Language Models (LLMs) as writing assistantsin everyday writing, a critical question emerges: are authors’ linguisticpatterns still predictive of their personal traits when LLMs are involved inthe writing process? We investigate the impact of LLMs on the linguisticmarkers of demographic and psychological traits, specifically examiningthree LLMs — GPT3.5, Llama 2, and Gemini — across six different traits:gender, age, political affiliation, personality, empathy, and morality. Ourfindings indicate that although the use of LLMs slightly reduces the predictive power of linguistic patterns over authors’ personal traits, the significantchanges are infrequent, and the use of LLMs does not fully diminish thepredictive power of authors’ linguistic patterns over their personal traits.We also note that some theoretically established lexical-based linguisticmarkers lose their reliability as predictors when LLMs are used in the writing process. Our findings have important implications for the study oflinguistic markers of personal traits in the age of LLMs.

7 Ethics Statement As our research pertains to the identification of private information about authors, we recognize the ethical concerns related to potential misuse, particularly in determining private attributes of authors without their consent. However, the purpose of this study is to enhance our understanding of the impacts of LLMs on this sensitive field of study, and further to contribute to the privacy of the users of these LLMs. It is also noteworthy that the personality, empathy and morality data used in this study were completely anonymized with proper elicitation of consent from authors upon gathering their personal information in the respective studies that gathered this data. The other data source we used for demographic attributes is publicly available.
id: 1d96a7e70188725b92ecff12f6353aa4 - page: 10
8 Acknowledgements This research was supported, in part, by the Army Research Laboratory under contract W911NF-23-2-0183 and by DARPA INCAS HR001121C0165. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies, either expressed or implied, of DARPA or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for governmental purposes notwithstanding any copyright annotation therein. We also thank James W. Pennebaker for their support and invaluable insights throughout the research process. References
id: c8511c8b89cb1cc50cc56e761596f48e - page: 10
Marwa Abdulhai, Gregory Serapio-Garcia, Clement Crepy, Daria Valter, John Canny, arXiv preprint and Natasha Jaques. Moral foundations of large language models. arXiv:2310.15337, 2023. Suhaib Abdurahman, Mohammad Atari, Farzan Karimi-Malekabadi, Mona J Xue, Jackson Trager, Peter S Park, Preni Golazizian, Ali Omrani, and Morteza Dehghani. Perils and opportunities in using large language models in psychological research. PsyArXiv. URL: io/preprints/psyarxiv/d695y, 2023. 10 Mohammad Awad AlAfnan, Samira Dishari, Marina Jovic, and Koba Lomidze. Chatgpt as an educational tool: Opportunities, challenges, and recommendations for communication, business writing, and composition courses. Journal of Artificial Intelligence and Technology, 3(2):6068, 2023.
id: 19cd7687a953636fa2e703bf503f7a14 - page: 10
Mohammad Atari, Jonathan Haidt, Jesse Graham, Sena Koleva, Sean T Stevens, and Morteza Dehghani. Morality beyond the weird: How the nomological network of morality varies across cultures. Journal of Personality and Social Psychology, 2023. J.L. Baddeley and J.A. Singer. Telling losses: Personality correlates and functions of Journal of Research in Personality, 42(2):421438, 2008. doi:
id: 81bb0203ac0297acd0ccd66fe9cbe466 - page: 11
How to Retrieve?
# Search

curl -X POST "https://search.dria.co/hnsw/search" \
-H "x-api-key: <YOUR_API_KEY>" \
-H "Content-Type: application/json" \
-d '{"rerank": true, "top_n": 10, "contract_id": "XaWzR08-T68q5yx4oxBon-QTRMRNx2mpea5ojwSccFs", "query": "What is alexanDRIA library?"}'
        
# Query

curl -X POST "https://search.dria.co/hnsw/query" \
-H "x-api-key: <YOUR_API_KEY>" \
-H "Content-Type: application/json" \
-d '{"vector": [0.123, 0.5236], "top_n": 10, "contract_id": "XaWzR08-T68q5yx4oxBon-QTRMRNx2mpea5ojwSccFs", "level": 2}'