Eliminate pages in a different language

AI for Service
1

Is there a way you can eliminate pages from a webcrawl that are in a different language? i.e. Chinese

2

Hello Barb Hellmann,
Welcome to the Kore.ai Community !

You can try excluding the Chinese content directly in the Web Crawl configuration. In the XO Platform → Search AI → Sources → Website Crawl → Advanced Settings, there’s an option to add Include/Exclude Rules.

Thanks,
Ram Sumanth Karnati
Kore.ai Community Team

3

Is this something that needs to be turned on? I don’t see this option anywhere.

4

Hello Barb Hellmann,

In the Advanced Crawl Configurations, open the Crawl Options menu and set it to Crawl Everything Except Specific URLs.