“Understanding Severity Levels: Categorizing Platform Issues Based on Impact”
This article offers clarification and descriptions of severity levels for issues reported on the platform, categorizing them based on their impact.
NOTE - Severity should not be mistaken for priority. For instance, a customer may consider a question urgent, resulting in a Sev4 severity, while the customer priority remains high.
Severity Definitions:
Severity-1 - Critical
A “Critical” or “Severity 1” Error renders the Platform/Bot Support completely unusable or nearly unusable or
introduces a high degree of operational risk. No Workaround is available. Until this Error is resolved, the Platform’s/Bot’s use is essentially halted. A large number of users and/or Kore Platform/Bot functionality is
severely impacted. Any Error that is faced in the course of the usage of any functionality reserved or restricted for
Administrator/Bot Developer shall be excluded from the aforementioned definition.
Examples -
- XO Platform
- Unable to log into the Platform from any network
- Unable to get a response from a published VA more than 80% of the time.
- Key component failures (applicable for on-premise installations predominantly) like Redis, MongoDB, or RabbitMQ down.
- XO Contact Center AI (SmartAssist)
- Agents / Supervisors unable to login
- No Agent transfer scenario is working.
- Agent Console / Desktop becomes unresponsive
- Supervisor Console becomes unresponsive
- Over 10% of the calls are dropping
- AgentAssist
- AgentAssist not responding to any utterances
- Library tasks not displayed or not responding
- SearchAssist
- Unable to log into the Platform from any network
- Unable to get a response from a SearchAssist application more than 80% of the time
- SearchAssist responses not coming in.
Severity-2 - High
A “High” or “Severity 2” Error renders one or more critical functionalities of the Platform/Bot are unavailable;
however, the overall performance of the Platform/Bot is not impacted. Workarounds may be available but use of the
The platform/Bot is degraded and causes continuing operational risk. A moderate number of users are significantly impacted, but overall the Platform/Bot Support continues to function.
Examples -
- XO Platform
- Agent transfer not being initiated.
- The end user is unable to get a response from a published VA between 20-80% of the time.
- VA is unable to recognize most of the intents apart from small talk.
- ML/FAQ training fails for all the bots on the Platform.
- Delayed responses from the bot that take more than 8 seconds.
- All (or over 80%) of the API calls (Service nodes) are failing but on tools like Postman, no failures are observed.
- Login MFA OTPs or email verification emails not going out on a region or server level (Not specific to a workspace or user - User specific issues are mostly due to their organization policies and email server rule specific)
- XO Contact Center AI (SmartAssist)
- Agent transfer is working but agents on Kore.ai agent desktop are not able to accept more than 60% of the chats.
- Over 5-10% of the calls are dropping
- Delay in response to the customer
- Incidents related to Skills / Queues / Routing of requests not working
- The supervisor Console not refreshing the page frequently
- Analytics or dashboards are not loading even for a 24-hour date range
- AgentAssist
- Send / Copy buttons not working
- AssistAssist search is not working
- AgentAssist metrics/dashboards not loading for even 24 hours range
- SearchAssist
- User is unable to get response from searchassist 50-80% time
- Search query without generative AI enabled taking more than 8 sec.
Severity-3 - Medium
A “Medium” or “Severity 3” Error is an inconvenience or causes inconsistent behaviour, which does not impede
the normal functioning of the Platform/Bot. It could be an Error that occurs inconsistently and affects
nonessential functions or is an inconvenience that impacts a small number of users. It may also contain
visual errors where the graphical display of the Platform/Bot is not ideal, but still functioning correctly.
Examples -
- XO Platform
- Unable to publish a VA (VA specific) and no apparent reason is displayed on the product.
- Unable to import a VA onto a target VA (from an environment running on a supported version lesser than or equal to the target environment version).
- VA specific export issues.
- The end user is unable to get a response from a published VA between 5-20% of the time.
- The platform is unable to initiate Agent transfer intermittently for off-the-shelf integrations offered by the Platform.
- The platform is unable to send out emails (non-login related)
- Analytics and dashboards are not loading for a certain date range.
- Delay in VA response for over 3 seconds up to 8 seconds without the involvement of any third-party API calls/intervention in between.
- Builder tool becomes unresponsive
- Unable to switch workspaces
- XO Contact Center AI (SmartAssist)
- A particular flow component is not working as expected but the business of end-users is not severely impacted.
- Sporadically calls are dropping.
- Unable to publish the flow.
- Analytics/dashboards are not loading for some specific date range over 24 hours.
- Transcripts are not working in specific scenarios
- Some of the pages are not accessible or are becoming unresponsive to the Supervisor
- Configuration changes/settings are not reflecting as intended
- Batch test inaccuracies or discrepancies.
- AgentAssist
- AgentAssist widget settings not working
- Switching of Layouts not working
- SearchAssist
- Web-crawler or scheduled ingestion service taking for than 1 hour per 100 documents
- App training is failing sporadically
- Search calls are failing 30-50 % time.
Severity-4 - Low
A “Low” or “Severity 4” Error has a small degree of significance, is a minor cosmetic issue, or is a “one-off”
case. A “one-off” case occurs when the Error occurs infrequently and cannot be reproduced easily. These are
Errors that do not impact the daily use of the Platform/Bot. A Low Error is something that does not affect normal use, and can be accepted for a period of time, but the user would eventually want to be changed.
Examples -
- XO Platform
- Intermittent issues or incidents with any Kore product that replicate less than 5% of the time for the end-users of the Kore.ai product.
- A cosmetic UI issue.
- A one-off issue.
- An issue for which no known steps to replicate exists.
- XO Contact Center AI (SmartAssist)
- Language-specific responses not coming intermittently.
- Minor UI-specific issues with no functional impact
- AgentAssist
- Minor UI-specific issues with no functional impact
- Language-specific responses not coming intermittently.
- SearchAssist
- Builder UI issues.
- Rarely some search calls fail.
- Generative AI results are intermittently failing.
- Common
- Cosmetic defects.
- One-off cases or cases that can be rarely replicated
- Feature/ Enhancement Requests
- Specific Documentation related queries or bugs.
- How to ?- Questions
- Adhoc requests like a particular script/access to support portal/bot-kit deployment requests.
- Provisioning related requests - provisioning a new server/environment for load testing, etc.
- Root Cause Analysis
- Issue not currently occurring/happened in the past - request is to know the root cause
- Follow up ticket after resolution of an issue to know the root cause.