Blogs by Ashwin

  Deployment Options Each project can produce numerous models and deployments, each with a distinct name, thanks to Azure AI Language. Benefits include ability to: Test two models side by side Compare how the split of datasets impact performance Deploy multiple versions of your model During deployment you can choose the name for the deployed model, which can then be selected when submitting a classification task. Using REST API CLI development of Azure AI is made possible by the REST API for the Azure AI Language service. Language projects in the same manner as Language Studio offers a project-building user interface. The lab for this module delves deeper into Language Studio. Pattern of Using API For the majority of calls, the Azure AI Language service's API runs asynchronously. In each stage, we first send a request to the service and then follow up with a call to find out the status or outcome. With each request, a header is required to authenticate your request. Submit Initial ...

  Introduction Your workspace for developing, honing, refining, and implementing your classification model is custom text classification projects. Language Studio and the REST API are the two methods you can work on your project. The lab will use Language Studio as the GUI, but the REST API offers the same features. The processes for creating your model are the same regardless of your preferred approach. Azure AI Language Project Life Cycle Define Labels: Understanding the data you want to classify, identify the possible labels you want to categorize into. Tag Data : Tag, or label, your existing data, specifying the label or labels each file falls under. Labeling data is important since it's how your model will learn how to classify future files. Best practice is to have clear differences between labels to avoid ambiguity, and provide good examples of each label for the model to learn from. Train Model : Train your model with the labeled data. View Model : After your model is...

  Introduction You may process natural language for your own application by using the Azure AI Language service. One of the most prevalent AI issues is Natural Language Processing (NLP), which requires software to perceive voice or text in the same way that people do. Text classification is a component of Natural Language Processing (NLP), and Azure offers methods for text classification that include sentiment, language, and user-defined custom categories. Understand Types of Classification Projects Text files are given labels by custom text classification, which in the Azure AI Language service is a class that the developer defines. A video game synopsis, for instance, could be categorized as "Adventure," "Strategy," "Action," or "Sports." Custom text classification falls into two types of projects: Single Label Classification - you can assign only one class to each file. Following the above example, a video game summary could only be classifie...

  Use Patterns To Differentiate Similar Utterances A model may occasionally have several intents for which utterances are expected to be similar. While reducing the quantity of sample utterances, you can leverage the pattern of utterances to clarify the intents. Additionally, the intents could apply to a wide range of entity values. To correctly train your model, provide a handful of examples of each intent that specify the different formats of utterances. TurnOnDevice: "Turn on the {DeviceName}" "Switch on the {DeviceName}" "Turn the {DeviceName} on" GetDeviceStatus: "Is the {DeviceName} on[?]" TurnOffDevice: "Turn the {DeviceName} off" "Switch off the {DeviceName}" "Turn off the {DeviceName}" When you teach your model with each different type of utterance, the Azure AI Language service can learn how to categorize intents correctly based off format and punctuation. Use Pre-Built Entity Components To recognize common...

  Define Intents, Utterances, and Entities When a user interacts with an application that utilizes your language model, they may enter utterances. An intent, or more simply the meaning of an utterance, is a task or activity that the user want to carry out. By defining intents and linking them to one or more utterances, you can build a model. For example, consider the following list of intents and associated utterances: GetTime: "What time is it?" "What is the time?" "Tell me the time" GetWeather: "What is the weather forecast?" "Do I need an umbrella?" "Will it snow?" TurnOnDevice "Turn the light on." "Switch on the light." "Turn on the fan" None: "Hello" "Goodbye" Spend some time thinking about the domain your model must cover and the kinds of activities or information that users might request. This will help you establish the intentions that you want your model to comprehend....

  About You must construct a Language resource in Azure before you can utilize the Language Understanding service to create an NLP solution. This resource will be utilized for both creating your model and handling client application prediction queries. Build Your Model   Before employing a model to generate a prediction, you must develop, train, and implement it for features that need one. The Azure AI Language service will learn what to search for from this construction and training. In the Azure portal, you must first build your Azure AI Language resource. Then: Search for Azure AI services. Find and select Language Service. Select Create under the Language Service. Fill out the necessary details, choosing the region closest to you geographically (for best performance) and giving it a unique name. Once that resource has been created, you will need a key and the endpoint. You can find that on the left side under Keys and Endpoint of the resource overview page. Use Language St...

  Introduction One of Azure AI Language's primary custom features is CLU. In order to anticipate general intent and extract crucial information from incoming utterances, CLU assists users in creating unique natural language understanding models. To educate CLU how to reliably predict entities and intentions, the user must tag the data. Custom Named Entity Recognition Custom entity recognition takes custom labeled data and extracts specified entities from unstructured text. For example, if you have various contract documents that you want to extract involved parties from, you can train a model to recognize how to predict them. Custom Text Classification Custom text classification enables users to classify text or documents as custom defined groups. For example, you can train a model to look at news articles and identify the category they should fall into, such as News or Entertainment. Question Answering Question answering is a largely pre-configured function that responds to inputt...

  Pre-Configured Features The Azure AI Language service offers specific functionalities without requiring any model labelling or training. After you set up your resource, you can transmit your data and utilize the results returned in your application. The following features are all pre-configured: Summarization Summarization is available for both documents and conversations, and will summarize the text into key sentences that are predicted to encapsulate the input's meaning. Named Entity Recognition Entity recognition can identify and extract various entities like individuals, locations, or organizations, enhancing your application's ability to understand different entity types for better natural language interaction. For instance, in the sentence "The waterfront pier is my favorite Seattle attraction," Seattle would be recognized and classified as a location. Personally Identifiable Information (PII) Detection PII detection allows you to identify, categorize, and red...

  Introduction You may develop a model that apps can use to extract meaning from natural language using the Azure AI Language Conversational Language Understanding service (CLU). Software must be able to handle text or speech in the natural language format that a human user would write or speak. This is known as Natural Language Processing, or NLP. Natural Language Understanding (NLU), a subset of Natural Language Processing (NLP), addresses the challenge of deriving semantic meaning from natural language, typically through the use of a trained language model. Azure AI Language enables developers to build apps based on language models that can be trained with a relatively small number of samples to discern a user's intended meaning. Understand Prebuilt Capabilities of the Azure AI Language Service The Azure AI Language service offers a number of tools for comprehending human language. You can use each feature to better communicate with users, better understand incoming communicatio...

  Improve Question Answering Performance You can enhance a knowledge base's performance by defining synonyms and using active learning after it has been created and tested. Use Active Learning Over time, active learning can assist you in improving your ability to accurately respond to consumer inquiries. People frequently pose questions with similar meanings but different wording. Because it allows you to think of other questions for each question and answer pair, active learning can be useful in circumstances such as these. By default, active learning is enabled. To use active learning, you can do the following: Create Your Question and Answer Pairs For your project, you use Language Studio to build pairs of questions and answers. To upload questions and answers in bulk, you may alternatively import a file. Review Suggestions After then, active learning starts to provide different questions for every question in your pairs of questions and answers. From the Review recommendations ...

  Create a Knowledge Base You can write code that defines, trains, and publishes the knowledge base using the REST API or SDK to create a question-answering solution. However, defining and managing a knowledge base is most frequently done through the Language Studio web interface. To create a knowledge base you: Sign in to Azure portal. Search for Azure AI services using the search field at the top of the portal. Select Create under the Language Service resource. Create a resource in your Azure subscription- Enable the question answering feature. Create or select an Azure AI Search resource to host the knowledge base index. In Create or select an Azure AI Search resource to host the knowledge base index. Language Studio, select your Azure AI Language resource and create a Custom question answering project. Add one or more data sources to populate the knowledge base- URLs for web pages containing FAQs. Files containing structured text from which questions and answers can b...