Development and evaluation of the chatbot solution for Wikipedia editors

Student thesis: Master thesis (including HD thesis)

  • Wioletta Gluza
  • Izabela Anna Turaj
4. term, Information Science, Master (Master Programme)
Wikipedia strives to improve the diversity and inclusion of the community and make knowledge available to everyone. The goals set for 2030 to dedicate effort to knowledge gaps, knowledge entities, and foundations resemble the pursuit of being globally representative and more accessible. This paper explores how technology can support this initiative by improving the editor experience on Wikipedia. The study describes the development and evaluation process of the chatbot solution that can potentially impact editor activation and retention on Wikipedia. The chatbot is designed using the atomic design approach. The development is powered by IBM Watson Assistant and results in a full-stack application coded in React and Node.js and deployed to Heroku. The chatbot evaluation is gathered through a think-aloud test completed by eleven participants who rate the usability of the chatbot in post-task Single Ease Question and post-test Chatbot Usability Questionnaire. The qualitative data collected in the study is consolidated in the thematic analysis, which uncovered two themes of positive chatbot user experiences and negative chatbot user experiences. The final solution is assessed as usable, informative, and friendly; however, further work is necessary to improve the chatbot's personality.
LanguageEnglish
Publication date2 Jan 2022
Number of pages71
ID: 457518120