Pattern Analysis and Clustering of Generative AI Prompts

Authors

  • Tip-aroon Kiawkaew School of Information Technology, Sripatum University
  • Paralee Maneerat School of Information Technology, Sripatum University
  • Suparoek Chootongchai Faculty of Education, Chulalongkorn University

Keywords:

Pattern Analysis, Clustering, Generative AI, Prompts, Artificial Intelligent

Abstract

This research focuses on the analysis and clustering of prompts for a Generative AI system. In this study, prompts are generated from the ChatGPT. Then, techniques in Natural Language Processing (NLP) were applied in the data preparation process. For pattern analysis, the researcher employed three different Word Embedding techniques that are Word2Vec, BERT, and RoBERTa and employed dimensionality reduction methods by using PCA, t-SNE and UMAP. By comparing the clustering results using K-Means and Agglomerative methods, it was observed that the best clustering performance was achieved when combining K-Means clustering with Word2Vec Word Embedding and applying UMAP for dimensionality reduction. This approach resulted in the highest Silhouette Score of 0.5197482, indicating the effectiveness of this method in clustering prompts into six distinct groups.

References

Alexandra. (2023). Top AI & ChatGPT Prompts for Social Media Post Generation (Online). Available: https://socialbee.com/blog/ai-social-media-prompts/ [2023, October 1].

Bozkurt, A., & Sharma, R. C. (2023). Generative AI and prompt engineering: The art of whispering to let the genie out of the algorithmic world. Asian Journal of Distance Education, 18, pp. 1-6.

CloudHQ. (2023). How to Write ChatGPT Prompts for Email (Online). Available:https://blog.cloudhq.net/how-to-write-chatgpt-prompts-for-email/ [2023, October 1].

Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M., A., Al-Busaidi, A., S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., Carter, L., & Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642.

Hosseini, M., Rasmussen, L. M., & Resnik, D. B. (2023). Using AI to write scholarly publications. Accountability in Research Policies and Quality Assurance, pp. 1-9.

Korzynski, P., Mazurek, G., Krzypkowska, P., & Kurasinski, A. (2023). Artificial intelligence prompt engineering as a new digital competence: Analysis of generative AI technologies such as ChatGPT. Entrepreneurial Business and Economics Review, 11(3), pp. 25-37.

Khan, H. (2023). A formula for composing the best prompts (Online). Available:

https://twitter.com/slow_developer/status/1695027815958405471 [2023, October 20].

Kumar, A. (2023). ChatGPT Prompts Design Tips & Examples (Online). Available:

https://vitalflux.com/chatgpt-prompts-design-tips-examples/ [2023, October 1].

Leexi. (2023). Master the art of generating prompts with ChatGPT (Online). Available:

https://www.leexi.ai/en/business-intelligence/the-7-golden-rules-for-generating-efficient-prompts-with-chatgpt/ [2023, October 1].

Sohail, S. S., Farhat, F., Himeur, Y., Nadeem, M., Madsen, D. Ø., Singh, Y., Atalla, S., & Mansoor, W. (2023). Decoding ChatGPT: a taxonomy of existing research, current challenges, and possible future directions. Journal of King Saud University-Computer and

Information Sciences, 35(8), 101675.

Starita, L. (2023). How to Write AI Prompts: The Key to Better Outputs from Generative AI (Online). Available: https://contently.com/2023/04/13/how-to-write-ai-prompts-for-generative-ai/ [2023, October 1].

Tamsin, S. (2023). THE ART OF WRITING CHATGPT PROMPTS FOR ANY USE CASE (Online).

Available: https://sarahtamsin.com/the-art-of-writing-chatgpt-prompts/ [2023, October 1].

White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., Elnashar, A., Spencer-Smith, J., & Schmidt, D. C. (2023). A prompt pattern catalog to enhance prompt engineering with chatGPT (Online). Available: https://arxiv.org/pdf/2302.11382.pdf [2023, October 1].

Downloads

Published

2023-12-31

Issue

Section

research articles