Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable results to be grounded in Bing Search Snippets #2296

Draft
wants to merge 15 commits into
base: main
Choose a base branch
from

Conversation

tonybaloney
Copy link
Contributor

@tonybaloney tonybaloney commented Jan 23, 2025

Purpose

This extends the Chat Read Retrieve Read approach to optionally prepare a web search, search on Bing using the V7 API then include the snippets from the results in the combined prompt.

The AI is told that the actual sources from AI Search take precedence, so it should only use the web snippets where the information from the AI Search did not answer the question.

Here is a simple example:

CleanShot 2025-01-23 at 20 04 33

The thought process has been extended to include the web search. Once provisioned, the web search grounding can be turned on or off per request.

TODO :

  • Create test cases
  • Link the sources back to the original URLs
  • Test mixed scenarios (where the data on the web is more relevant and vice versa)
  • Change the UI to match the web result to a citation and link to the page

Implements #1496 #1632 and #1931

@cforce
Copy link
Contributor

cforce commented Jan 23, 2025

This is great but even better would be if this could be activated per Chat cmd understanding for a Single user Chat Message instead statically via global settings for all messages. User shall ask to search or pull information from web (eg Bing)

@tonybaloney
Copy link
Contributor Author

This is great but even better would be if this could be activated per Chat cmd understanding for a Single user Chat Message instead statically via global settings for all messages. User shall ask to search or pull information from web (eg Bing)

Maybe it's not obvious from the PR but it's a per-chat toggle.
There's an extension to the UI to turn this on or off. But that toggle is only enabled if the backend has a Bing API key.

@zedhaque
Copy link
Contributor

This is cool :)

How about citation? (using the bing title/url - and citation opens in a new window)

Many thanks for this PR!!

@cforce
Copy link
Contributor

cforce commented Jan 23, 2025

backend

want to ensure I've understood correctly. If I were to ask:

"Is the use of open-source software allowed in production systems?"

In Bing:
The response might reflect public knowledge, for example:
"Yes, many large enterprises use open-source software in production systems, as it is often cost-effective and flexible. However, its use is typically governed by strict compliance and security guidelines."

In an enterprise RAG system:
The system could retrieve an internal policy, such as:
"No, open-source software is prohibited in production systems unless explicitly approved by the legal and compliance team, as per internal IT governance policies."

How can I explicitly request responses from either Bing, the enterprise system, or even a comparison between the two using only a chat message, without the system defaulting to web searches when no internal answers are found?

@tonybaloney
Copy link
Contributor Author

How about citation? (using the bing title/url - and citation opens in a new window)

The PR will include citation links in the same manner as the AI search ones.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants