INFORMATION RETRIEVAL, QUESTION ANSWERING SYSTEMS, AND CHATGPT: TECHNOLOGY, CAPABILITY, AND INTELLIGENCE
Received: 11th April 2023; Revised: 31st July 2023, 10th August 2023, 16th August 2023; Accepted: 1st September 2023
Keywords:
Artificial Intelligence, Information Retrieval, Question Answering SystemsAbstract
The question is will ChatGPT replace Google? To answer the question, we have a look at the engine that powers ChatGPT. Knowing the engine that drives it, we may be able to estimate its capability and power. Information retrieval and question answering systems have been around for decades using well known technology to serve their purposes, such as keywords approach, semantic technology, predicate logic, and natural language processing. Several WH questions have been tested to assess the quality and the correctness of the answers given by ChatGPT. With respect to What, Where, and How questions, we found that ChatGPT seems to understand the questions and answer them quite well. But some facts embedded in the answers are found to be inaccurate. These may be due to the “hallucination” problem caused by the Large Language Models (LLMs) adopted in the engine. We wonder here whether ChatGPT, which adopts the Generative Pre-trained Transformer based on LLMs, has reasoning mechanism as in the rule-based systems. In conclusion, ChatGPT represents a significant leap forward in the field of question answering systems. However, it is important to recognize that ChatGPT and Google are not direct competitors, but rather complementary tools that serve different purposes.
References
BBC (2023, April 7) "ChatGPT: Mayor starts legal bid over false bribery claim". [News Article]. BBC News. https://www.bbc.com/news/technology-65202597
Chiang, T. (2023, February 17). "ChatGPT Is a Blurry JPEG of the Web". The New Yorker. https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web
Chomsky, N., Roberts, I., Watumull, J. (2023, March 12). "Opinion | Noam Chomsky: The False Promise of ChatGPT". The New York Times. https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chatgpt-ai.html
Columbia Encyclopedia. (2023, April 23). Intelligence. Infoplease. https://www.infoplease.com/encyclopedia/medicine/psychology/discipline/intelligence#:~:text=intelligence%2C%20in%20psychology%2C%20the%20general,and%20adjusting%20to%20new%20situations
Hurst, L. (2023, March 30). “Profound risk to humanity”; “Tech leaders call for 'pause' on advanced AI development". Euronews. https://www.euronews.com/next/2023/03/29/profound-risk-to-humanity-elon-musk-and-steve-wozniak-join-calls-to-halt-ai-development
Kadir, R. A., Sembok, T. M. T., & Zaman, H. B. (2012). Intelligent Information Access Based on Logical Semantic Binding Method. In Advances in Knowledge Representation. https://www.intechopen.com/chapters/36659
Kadir, R.A., & Sembok, T.M.T. (2009). “Improvement of document understanding ability through the notion of answer literal expansion in logical-linguistic approach”. WSEAS Transactions on Information Science and Applications, 6, 966-975. https://www.researchgate.net/publication/265745875_Improvement_of_Document_Understanding_Ability_through_the_Notion_of_Answer_Literal_Expansion_in_Logical-linguistic_Approach
Karp, P. (2023, February 6). "MP tells Australia's parliament AI could be used for 'mass destruction' in speech part-written by ChatGPT". The Guardian. https://www.theguardian.com/australia-news/2023/feb/06/labor-mp-julian-hill-australia-parliament-speech-ai-part-written-by-chatgpt
Lock, Samantha (2022, December 5). "What is AI chatbot phenomenon ChatGPT and could it replace humans?". The Guardian. https://web.archive.org/web/20230116100346/https://www.theguardian.com/technology/2022/dec/05/what-is-ai-chatbot-phenomenon-chatgpt-and-could-it-replace-humans
McGuinnes, D. L. Question Answering on the Semantic Web. IEEE Intelligent Systems 19(1), (2004), Jan/Feb 2004: pp. 82 - 85. https://doi.org/10.1109/MIS.2004.1265890
Mizzaro, S. 1997. Relevance: The Whole History. JASIS, Vol.48, No.9, pp.810-832. https://doi.org/10.1023/A:1016323201283
Nau, J., Filho, A., & Passero, G. (2017). “Evaluating Semantic Analysis Methods for Short Answer Grading Using Linear Regression.” PEOPLE: International Journal of Social Sciences, 3(2), 437–450. https://doi.org/10.20319/pijss.2017.32.437450
Piper, K. (2022, December 15). "ChatGPT has given everyone a glimpse at AI's astounding progress". Vox. https://www.vox.com/future-perfect/2022/12/15/23509014/chatgpt-artificial-intelligence-openai-language-models-ai-risk-google
Razzaq, T. (2018). “Spirituality in The Perspective of Sacred Scriptures of The World Religion”. PEOPLE: International Journal of Social Sciences, 4(3), 700–710. https://doi.org/10.20319/pijss.2018.43.700710
Roose, Kevin (2022, December 5). "The Brilliance and Weirdness of ChatGPT". The New York Times. https://www.nytimes.com/2022/12/05/technology/chatgpt-ai-twitter.html
Searle, John R. (1980), Minds, Brains, and programs, The Behavioral and Brain Sciences 3, 417-457. https://doi.org/10.1017/S0140525X00005756
Sembok, T. M., Zaman, H. B., & Kadir, R. A. (2008). IRQAS: Information Retrieval and Question Answering System Based on a Unified Logical-Linguistic Model. In Proceedings of the 7th WSEAS International Conference on Artificial intelligence, knowledge engineering and data bases, Cambridge, UK. https://www.researchgate.net/publication/234778531_IRQAS_information_retrieval_and_question_answering_system_based_on_a_unified_logical-linguistic_model
Sembok, T. T., & Kadir, R. A. (2013). A unified logical-linguistic indexing for search engines and question answering. International Journal of Mathematical Models and Methods in Applied Sciences, 7, 22-29. https://www.naun.org/main/NAUN/ijmmas/16-553.pdf
TheMindProject. (2023 April 8). Retrieved from https://mind.ilstu.edu/curriculum/turing_test/turing_test_curric_long.html
Thompson, D. (2022, December 8). "Breakthroughs of the Year". The Atlantic. https://www.theatlantic.com/newsletters/archive/2022/12/technology-medicine-law-ai-10-breakthroughs-2022/672390/
Turing, A.M. (1950), Computing Machinery and Intelligence, Mind, vol.LIX, No. 236. https://doi.org/10.1093/mind/LIX.236.433
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L. & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing. https://doi.org/10.48550/arXiv.1706.03762
Wani, S., Sembok, T.M.T. (2018). Constructing a knowledge base for Al-Qur’an utilising principles of human communication. CAMP’18. 26-28 March 2018. Kota Kinabalu, Malaysia. https://doi.org/10.1109/INFRKM.2018.8464823
