Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

IntroductionAnalyzing The MSPbots OpenAI Ticket Sentiment Analysis Bot is designed to analyze the sentiment or overall tone of a ticket summary allows for the added layer of priority, especially if an MSP has multiple tickets from customers . This analysis is useful when your MSP receives multiple tickets in a day. By returning negative sentiments and alerting techs sending alerts directly or via messages in chat channels persons can be aware that a ticket has come in with a negative sentiment so they can choose to prioritize and work on the ticket immediately., the bot helps service managers and technicians to be aware of any negative sentiment in a ticket. They can then prioritize and work on such tickets immediately, ensuring prompt and efficient resolution.

What's on this page

Table of Contents

What are the benefits of using OpenAI Ticket Sentiment Analysis? 

...

Sentiment analysis is valuable in gauging customer satisfaction, improving service delivery, and maintaining a positive brand image. Using the OpenAI Ticket Sentiment Analysis Bot is beneficial in the following areas and more: 

  • Proactive identification and resolution of issues before they escalate
  • Service improvement opportunities from recurring issues or pain points
  • Programs for refining customer retention and loyalty programs
  • Customer satisfaction measurement and monitoring 

The sentiment from the MSPbots OpenAI Sentiment Analysis Bot Sentiment is generated through the OpenAI integration using specific prompts and returns if a ticket's summary is 1. Slightly Negative; 2. Negative; and 3. Very Negative.

To Start Using OpenAI Sentiment Bot

...

categorized as any of the following: 

  • Slightly Negative
  • Negative 
  • Very Negative

Required applications and permissions 

...

Ensure that you have the following before you start using this bot:

How to use the OpenAI Sentiment Analysis Bot 

...

Before using the OpenAI Sentiment Analysis Bot  

  1. Set your billing limit with OpenAI.
  2. Set up and complete the API setup for the OpenAI Integration with MSPbots

    image connect OpenAI to MSPbotsImage Added

Accessing the OpenAI Sentiment Analysis Bot

Once the OpenAI integration is completed and verified, open the bot with the following steps:

  1. Navigate navigate to the Bots section in the MSPbots app.
  2. In the Bots screen, go to the Template Bots tab and search for OpenAI Ticket Sentiment Bot for ConnectWise Manage
    image OpenAI Sentiment Analysis BotImage Added

    If you want to view the bot and its details only, click No, view only on the Tips pop-up window.
    If you want to clone it and create your own copy of it, click Yes on the Tips pop-up window.
    Image Removed
    Clone the template bot which will automatically add it to your custom ('My Bots') profile.
    Image Removed
    Go into the 'My Bots' tab and click on the OpenAI Ticket Sentiment bot to open. Click on the Design Tab:
    Image Removed

Bot Settings and Filters

You can customize filters for Specific Ticket Types, Boards, or Status, and others on the Data Filter (2nd) bot block,

The default filters for tickets that would qualify to be analyzed for sentiment are as follows:

     6. 

     Image Removed

...

  1.  

Cloning the OpenAI Sentiment Analysis Bot template 

After accessing the bot, click the ellipsis icon and click Clone to automatically add the cloned copy of the bot to the My Bots tab. For more information on cloning a template bot, refer to How to Clone a Bot Template.

image clone the OpenAI Sentiment Analysis botImage Added

Viewing the bot blocks and settings 

To see the bot design:  

  1. Go to the My Bots tab and click the OpenAI Ticket Sentiment Bot to open it.
  2. Once the OpenAI Ticket Sentiment Bot is open, click Design to view the bot blocks containing the bot configurations similar to the example shown below. 
    image OpenAI Sentiment Analysis Bot blocksImage Added

What are the bot settings and filters? 

...

You can tweak the OpenAI Sentiment Analysis Bot until it returns the correct result for your requirements. Do this by creating filters for specific Ticket Types, Boards, Statuses, and others on the bot blocks. 

Warning

Please note that currently, the OpenAI Sentiment Analysis Bot is the only bot that is supported by the OpenAI bot block. We advise against using the bot block for any other purposes at this time. We are continuously working on developing new features and assets that will be available for the OpenAI bot block in the near future. If you have any questions or requests regarding the use of the OpenAI bot block, contact the MSPbots Product Team at product@mspbots.ai.

Below are the bot settings and filters for the OpenAI Sentiment Analysis Bot. 

  • DataFilter bot block - This block has specific filters that qualify sentiments for analysis. The default filters for tickets for sentiment analysis are the following: 

No Format
ticketNoteResolutionFlag
ticketStatusName 
ticketBoardName
ticketAction

The DataFilter bot block window below shows how each filter works. 

     image data filter block for sentiment analysisImage Added
You can add and remove custom filters

...

using theimage add filter buttonImage Modified and image remove filter buttonImage Modifiedbuttons.

...

The other available filters are below. 

No Format
ticketCwUid, ticketCompanyName, ticketOwner, minutesTicketInProgress, priorityName, and ticketTypeName


...

  • OpenAI bot block - This block contains the settings and

...

  • prompts for OpenAI to return sentiment on the ticket summary

...

  • . Use the settings below

...

  • to fine-tune the AI model

...

  • . 

SettingDefaultDescription
Model-

The Model setting is to select the OpenAI model you want to use. The options for the Model from the available models in your OpenAI integration, including GPT-4. If you haven't connected OpenAI integration to MSPbots yet or if MSPbots is unable to fetch the available GPT models from your OpenAI integration, the option will be empty.

If you want to know how to connect OpenAI integration, please refer to OpenAI Integration Setup.

If you have previously configured the Open AI bot block's model as GPT-3.5-turbo, then the model will still be GPT-3.5-turbo.

Temperature0.2

The Temperature Common setting is common to All all ChatGPT functions , it and is used to fine-tune the sampling temperature by a number between 0 and 1. Use 1 for creative applications and 0 for well-defined answers.

Example:

If if you would like to return factual or straight forward straightforward answers such as a country's capital, then use 0. For tasks that are not as straight forward straightforward such as generating text or content, a higher temperature is required to enable the capture of idiomatic expressions and text nuances.

Max Length120

Represents Max Length represents the maximum number of tokens used to generate prompt results. Tokens can be thought of as likened to pieces of words that the model uses to classify text.
Example
Examples:

1 token ~= 4 characters
1 token ~= 3/4 words
100 tokens ~= 75 words
Check this link for more information.
For more information, refer to What are tokens and how to count them? 

Top P0.2

Top_-p sampling, also known as nucleus sampling, is an alternative to temperature ( sampling). Instead of considering all possible tokens, GPT-3 considers only a subset , or a nucleus whose cumulative probability mass adds up to a threshold , which is set as the top_-p.

Example:

If the Top P is set to 0.2, GPtGPT-3 will only consider the tokens that make up the top 20% of the probability mass for the next token, allowing for dynamic vocabulary selection based on context.

Frequency Penalty0

Mostly Frequency Penalty is mostly applicable to text generation, this settings . This setting tells the model to limit repeating tokens . Like like a friendly reminder to not overuse certain words or phrases. Since this is mostly not applicable to sentiment analysis, it is set to 0.

Presence Penalty0

This The Presence Penalty parameter tells the model to include a wider variety of tokens in generated text and, and like the frequency penalty, is applicable to text generation as compared to sentiment.

                                      

              Image Removed               View The screenshot of the OpenAI bot block window below shows these settings.
Image Added

You are ready to activate the OpenAI Sentiment Analysis Bot after               8.  Once the additional filters and settings have been applied, the bot may now be activated. Click on this link for information on how to verify if the bot is activated.
Additional Information
Pricing
are applied.

To activate the bot, refer to Activating a Bot on the MSPbots App.
To verify activation, How to Check if a Bot Is Activated.
To modify or set new alert and/or escalation messages, refer to section "4. Define the alert script" in the article How to Create a Bot

Pricing for MSPbots OpenAI Sentiment Analysis Bot 

...

The pricing for OpenAI ChatGPT 3.5 Turbo

...

is based on a per 1,000 token

...

model. You may need to confirm the context through your OpenAI billing.


GPT 3.5 Turbo

ModelInputOutput
4K Context$0.0015 per 1,000 tokens$0.002 per 1,000 tokens
16K Context$0.003 per 1,000 tokens$0.004 per 1,00 tokens

         Link to For more information, refer to the OpenAI ChatGPT pricing page.

Related Topics 

...