At the moment the corpus fed into ChatGPT includes one article. We want to expand that and include at least 3-4 articles
Description
Description
Details
Details
Related Changes in GitLab:
| Title | Reference | Author | Source Branch | Dest Branch | |
|---|---|---|---|---|---|
| Improve search by adding infobox | toolforge-repos/wiki-gpt!12 | isaranto | T329016-improve-search | main | |
| add hyperlinks in results | toolforge-repos/wiki-gpt!5 | isaranto | add-hyperlinks | main | |
| remove irrelevant links from answer | toolforge-repos/wiki-gpt!4 | isaranto | remove-irrelevant-links | main |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | None | T328494 WikiGPT Experiment | |||
| Resolved | isarantopoulos | T329016 [WikiGPT] Improve search results of WikiGPT |
Event Timeline
Comment Actions
Because Elon Musk stated that he will step down as CEO (some time in the future) the model Jack Dorsey is the CEO of twitter as the article about him was returned in the search.
We also added the following instruction to our prompt in order to tackle this:
I fed into our prompt the first 3 articles returned from a search on wikipedia. However this seems to bring some confusion as some articles may be irrelevant
In order to deal with this we changed the prompt by adding this
Treat each paragraph as a separate piece of information and use it for your response only if it is relevant to the question.
Adding this seemed to solve this problem as we also got some responses related to Call of Duty (video game that takes place at WWII)
There was also this mishit as chatGPT assumes some stuff like the following:
Because Elon Musk stated that he will step down as CEO (some time in the future) the model Jack Dorsey is the CEO of twitter as the article about him was returned in the search.
We also added the following instruction to our prompt in order to tackle this:
If the question is not explicitly answered in the text, don't assume an answer and say that you don't know.
However this only was solved when we combined it with more information (more articles - e.g. 10).
Below we paste some other examples that yield interesting/nice results:
Comment Actions
isaranto opened https://gitlab.wikimedia.org/toolforge-repos/wiki-gpt/-/merge_requests/2
[T329016] Add more articles to prompt
Comment Actions
isaranto merged https://gitlab.wikimedia.org/toolforge-repos/wiki-gpt/-/merge_requests/2
[T329016] Add more articles to prompt
Comment Actions
after tweaking the prompt with this Answer the following question and add these links in brackets **only if they are relevant to the question** {links}:
I figured out how to not have irrelevant links and text in the answer.
Initially I got this when asking "Where can I buy ski goggles in Jordan?"
after tweaking the prompt with this Answer the following question and add these links in brackets **only if they are relevant to the question** {links}:
and this
If the question is not explicitly answered in the text, don't assume an answer and respond only with the following message "I am sorry, but I am unable to answer this question. I can only answer questions that are answered inside the content of Wikipedia" without providing additional information and links.
we got back these results
Comment Actions
isaranto opened https://gitlab.wikimedia.org/toolforge-repos/wiki-gpt/-/merge_requests/4
remove irrelevant links from answer
Comment Actions
isaranto merged https://gitlab.wikimedia.org/toolforge-repos/wiki-gpt/-/merge_requests/4
remove irrelevant links from answer
Comment Actions
isaranto opened https://gitlab.wikimedia.org/toolforge-repos/wiki-gpt/-/merge_requests/5
add hyperlinks in results
Comment Actions
isaranto merged https://gitlab.wikimedia.org/toolforge-repos/wiki-gpt/-/merge_requests/5
add hyperlinks in results
Comment Actions
isaranto opened https://gitlab.wikimedia.org/toolforge-repos/wiki-gpt/-/merge_requests/12
Improve search by adding infobox and more paragraphs
Comment Actions
isaranto merged https://gitlab.wikimedia.org/toolforge-repos/wiki-gpt/-/merge_requests/12
Improve search by adding infobox