Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

IntroductionAnalyzing The MSPbots OpenAI Ticket Sentiment Analysis Bot is designed to analyze the sentiment or overall tone of a ticket summary allows for the added layer of priority, especially if an MSP has multiple tickets from customers . This analysis is useful when your MSP receives multiple tickets in a day. By returning negative sentiments and alerting techs sending alerts directly or via messages in chat channels persons can be aware that a ticket has come in with a negative sentiment so they can choose to prioritize and work on the ticket immediately., the bot helps service managers and technicians to be aware of any negative sentiment in a ticket. They can then prioritize and work on such tickets immediately, ensuring prompt and efficient resolution.

What's on this page

Table of Contents

What are the benefits of using OpenAI Ticket Sentiment Analysis? 

...

Sentiment analysis is valuable in gauging customer satisfaction, improving service delivery, and maintaining a positive brand image. Using the OpenAI Ticket Sentiment Analysis Bot is beneficial in the following areas and more: 

  • Proactive identification and resolution of issues before they escalate
  • Service improvement opportunities from recurring issues or pain points
  • Programs for refining customer retention and loyalty programs
  • Customer satisfaction measurement and monitoring 

The sentiment from the MSPbots OpenAI Sentiment Analysis Bot Sentiment is generated through the OpenAI integration using specific prompts and returns if a ticket's summary is 1. Slightly Negative; 2. Negative; and 3. Very Negative.

To Start Using OpenAI Sentiment Bot

...

categorized as any of the following: 

  • Slightly Negative
  • Negative 
  • Very Negative

Required applications and permissions 

...

Ensure that you have the following before you start using this bot:

How to use the OpenAI Sentiment Analysis Bot 

...

Before using the OpenAI Sentiment Analysis Bot  

  1. Set your billing limit with OpenAI.
  2. Set up and complete the API setup for the OpenAI Integration with MSPbots

    image connect OpenAI to MSPbotsImage Added

Accessing the OpenAI Sentiment Analysis Bot

Once the OpenAI integration is completed and verified, open the bot with the following steps:

  1. Navigate navigate to the Bots section in the MSPbots app.
  2. In the Bots screen, go to the Template Bots tab and search for OpenAI Ticket Sentiment Bot for ConnectWise Manage.
    Image Removed
    Clone the template bot which will automatically add it to your custom ('My Bots') profile.
    Image Removed
    Go into the 'My Bots' tab and click on the OpenAI Ticket Sentiment bot to open. Click on the Design Tab:
    Image Removed

Bot Settings and Filters

You can customize filters for Specific Ticket Types, Boards, or Status, and others on the Data Filter (2nd) bot block,

The default filters for tickets that would qualify to be analyzed for sentiment are as follows:

     6. 

     Image Removed

...

  1.  
    image OpenAI Sentiment Analysis BotImage Added

    If you want to view the bot and its details only, click No, view only on the Tips pop-up window.
    If you want to clone it and create your own copy of it, click Yes on the Tips pop-up window. 

Cloning the OpenAI Sentiment Analysis Bot template 

After accessing the bot, click the ellipsis icon and click Clone to automatically add the cloned copy of the bot to the My Bots tab. For more information on cloning a template bot, refer to How to Clone a Bot Template.

image clone the OpenAI Sentiment Analysis botImage Added

Viewing the bot blocks and settings 

To see the bot design:  

  1. Go to the My Bots tab and click the OpenAI Ticket Sentiment Bot to open it.
  2. Once the OpenAI Ticket Sentiment Bot is open, click Design to view the bot blocks containing the bot configurations similar to the example shown below. 
    image OpenAI Sentiment Analysis Bot blocksImage Added

What are the bot settings and filters? 

...

You can tweak the OpenAI Sentiment Analysis Bot until it returns the correct result for your requirements. Do this by creating filters for specific Ticket Types, Boards, Statuses, and others on the bot blocks. 

Warning

Please note that currently, the OpenAI Sentiment Analysis Bot is the only bot that is supported by the OpenAI bot block. We advise against using the bot block for any other purposes at this time. We are continuously working on developing new features and assets that will be available for the OpenAI bot block in the near future. If you have any questions or requests regarding the use of the OpenAI bot block, contact the MSPbots Product Team at product@mspbots.ai.

Below are the bot settings and filters for the OpenAI Sentiment Analysis Bot. 

  • DataFilter bot block - This block has specific filters that qualify sentiments for analysis. The default filters for tickets for sentiment analysis are the following: 

No Format
ticketNoteResolutionFlag
ticketStatusName 
ticketBoardName
ticketAction

The DataFilter bot block window below shows how each filter works. 

     image data filter block for sentiment analysisImage Added
You can add and remove custom filters

...

using theimage add filter buttonImage Modified and image remove filter buttonImage Modifiedbuttons.

...

The other available filters are below. 

No Format
ticketCwUid, ticketCompanyName, ticketOwner, minutesTicketInProgress, priorityName, and ticketTypeName


...

  • OpenAI bot block - This block contains the settings and

...

  • prompts for OpenAI to return sentiment on the ticket summary.

...

  • Use the settings below

...

  • to

...

  • fine-

...

  • tune the AI model. 

SettingDefaultDescription
Model-

The Model setting is to select the OpenAI model you want to use. The options for the Model from the available models in your OpenAI integration, including GPT-4. If you haven't connected OpenAI integration to MSPbots yet or if MSPbots is unable to fetch the available GPT models from your OpenAI integration, the option will be empty.

If you want to know how to connect OpenAI integration, please refer to OpenAI Integration Setup.

If you have previously configured the Open AI bot block's model as GPT-3.5-turbo, then the model will still be GPT-3.5-turbo.

Temperature0.2

The Temperature

Common

setting is common to

All

all ChatGPT functions

, it

and is used to fine-tune the sampling temperature by a number between 0 and 1. Use 1 for creative applications and 0 for well-defined answers.

Example:

if

If you would like to return factual or

straight forward

straightforward answers such as a country's capital, then use 0. For tasks that are not as

straight forward

straightforward such as generating text or content, a higher temperature is required to enable the capture of idiomatic expressions and text nuances.

Max Length120
Represents

Max Length represents the maximum number of tokens used to generate prompt results. Tokens can be

thought of as

likened to pieces of words that the model uses to classify text.

Example


Examples:

1 token ~= 4 characters
1 token ~= 3/4 words
100 tokens ~= 75 words

Check this link for more information.


For more information, refer to What are tokens and how to count them? 

Top P0.2

Top

_

-p sampling, also known as nucleus sampling, is an alternative to temperature

(

sampling

)

. Instead of considering all possible tokens, GPT-3 considers only a subset

,

or a nucleus whose cumulative probability mass adds up to a threshold

,

which is set as the top

_

-p.

Example:

If the Top P is set to 0.2,

GPt

GPT-3 will only consider the tokens that make up the top 20% of the probability mass for the next token, allowing for dynamic vocabulary selection based on context.

Frequency Penalty0
Mostly

Frequency Penalty is mostly applicable to text generation

, this settings

. This setting tells the model to limit repeating tokens

. Like

like a friendly reminder to not overuse certain words or phrases. Since this is mostly not applicable to sentiment analysis, it is set to 0.

Presence Penalty0
This

The Presence Penalty parameter tells the model to include a wider variety of tokens in generated text and,

and

like the frequency penalty, is applicable to text generation as compared to sentiment.


The screenshot of the OpenAI bot block window below shows these settings.
Image Added

You are ready to activate the OpenAI Sentiment Analysis Bot after the additional filters and settings are applied.

To activate the bot, refer to Activating a Bot on the MSPbots App.
To verify activation, How to Check if a Bot Is Activated.
To modify or set new alert and/or escalation messages, refer to section "4. Define the alert script" in the article How to Create a Bot

Pricing for MSPbots OpenAI Sentiment Analysis Bot 

...

The pricing for OpenAI ChatGPT 3.5 Turbo is based on a per 1,000 token model. You may need to confirm the context through your OpenAI billing.


GPT 3.5 Turbo

ModelInputOutput
4K Context$0.0015 per 1,000 tokens$0.002 per 1,000 tokens
16K Context$0.003 per 1,000 tokens$0.004 per 1,00 tokens

For more information, refer to the OpenAI ChatGPT pricing page.

Related Topics 

...