How Semantic Ranking Works ?

By Ashwin Venugopal -

 




Introduction

The top 50 results from the BM25 ranking are used for semantic ranking. A semantic setup divides the findings into several fields. The fields are cut to 256 distinct tokens after being transformed into text strings. In the document, a token is basically equal to a word.

After the strings are ready, machine reading comprehension models are used to identify the words and sentences that best fit the query. This summarization sentence produces a semantic caption and, if desired, a semantic response. The semantic relevance of the caption is now used to rate the semantic captions. After that, the results are given back in decreasing relevancy order.

This secondary ranking uses multi-lingual, deep learning models adapted from Microsoft Bing to promote the most semantically relevant results.

Semantic Ranking Advantages

Semantic ranking has two key advantages over traditional search results:

  • Semantic ranking can rank results to more closely match the semantics of the original query. This can make it more likely hat the most useful documents appear at the top of the search results.

  • Semantic ranking can find strings within the results to render as a caption on the search results page and to provide an answer to a question.

Semantic Ranking Limitations

The outcomes of the BM25 ranking function are subjected to semantic ranking. Semantic ranking can reorder the BM25 ranking function's findings, but it won't offer any new documents that the BM25 ranking function didn't return.

The top 50 outcomes from the BM25 ranking function are used in semantic ranking. Only the top 50 results are taken into consideration if more than 50 results are returned.

The summarizing model accepts up to 2,000 tokens, each of which is around ten characters, for each document in the search result. To guaranty that the total length satisfies the input requirements of the summarizing stage, excessively long strings are cut. It is crucial to add fields to your semantic configuration in priority order because of this reduction operation. Anything beyond the maximum limit is disregarded if your documents are really huge and contain a lot of content.

Inputs are assembled from the "title", "keyword", and "content" fields listed in the Semantic Configuration.

Semantic Ranking Pricing

Semantic ranker is a premium feature, billed by usage. Up to 1000 semantic ranking queries a month are available free of charge. For more than 1000 queries a month, you should choose standard pricing. The cost of standard pricing is based on the volume of searches, the type of searches, and the region of the search.

Conclusion

We have successfully learnt about how Semantic Ranking works.


















Comments

Post a Comment

Popular posts from this blog

Connect Data to Azure Sentinel Using Data Connectors

By Ashwin Venugopal -
Image
  Ingest Log Data with Data Connectors You should connect your data sources with Azure Sentinel Connectors to collect the log data whose page displays a growing list of the connectors provided by Azure Sentinel, after selecting the Open connector page (the detailed connector page has a left and right blade).  The information about the connector, the connector's status, and the last time a log was received if connected is provided by the left blade. Whereas the right tab has two tabs- Instructions and Next Steps. The instructions tab can be different based on the connector having Prerequisites and Configuration which can be followed to connect to the data source. The Next Steps tab offers a quick reference to workbooks, query samples, and analytical templates. Data connectors can only be disconnected/deactivated, not deleted. Note-  The connector does not install Workbooks and Analytical Templates as they are already available in the Sentinel environment for out of the box...
Read more

Information Protection Scanner: Resolve Issues with Information Protection Scanner Deployment

By Ashwin Venugopal -
Image
  About If you are experiencing problems with the Microsoft Purview Information Protection scanner, check the health of your deployment by utilizing the Start-ScannerDiagnosticsPowerShell cmdlet to start the scanner diagnostic tool. The diagnostics tool checks the following details and then creates a log files with the results: Whether the database is up to date. Whether network URLs are accessible. Whether there's a valid authentication token and policy can be acquired. Whether the profile is defined in the Azure portal. Whether offline/online configuration exists and can be acquired. Whether the rules configured are valid.  The Start-ScannerDiagnostics command does not perform a comprehensive check of prerequisites. If you encounter problems with the scanner, you need to verify that your system meets the scanner's requirements, and that your scanner's configuration and installation are finished.  Verify Scanning Details Per Scanner Node and Repository Run the Get-ScanSt...
Read more

Azure AI Search plugin in Microsoft Security Copilot (Preview)

By Ashwin Venugopal -
Image
  Introduction Azure AI Search is a service that allows to reliably extract content search, extract, and understand at scale. It is typically used to search for documents, data surveys, and chat-style Copilot apps over proprietary data. Indexing and querying are Azure AI Search's two main workloads. While querying allows to search the content from index, indexing loads the content into the search engine and makes it searchable. By connecting to one of the Azure AI Search indexes from within Copilot, the Microsoft Security Copilot integration for Azure enables to use the content in Copilot to produce contextualized, pertinent, and targeted responses.  Requirement Before using the Azure AI Search plugin in Copilot, the desired Azure AI Search index to connect to Copilot is configured as follows: The text field must be searchable.  The title field must be filterable. The vector-field must use text-embedding-ada-002. Integrated vectorization can be used to setup an index in t...
Read more