Single Page Application Support for Conversation AI Web Crawler Live

Single Page Application Support for Conversation AI Web Crawler Live!

June 09, 20242 min read

Enhancing AI Bot Training with Gold Star Pro's Web Crawler

Gold Star Pro is excited to announce a significant enhancement to our conversation AI bot training capabilities. We’ve made it simpler and more efficient to train your AI by upgrading our web crawler to support Single-Page Applications (SPAs). Here’s a step-by-step guide to understanding and utilizing this new feature.

Enhancing AI Training with Web Crawlers

The Basics

Our AI training tool allows users to train bots by crawling their website content. This process involves:

  • Inputting your website URL.

  • Letting the web crawler analyze and extract content.

  • Using this content to train the AI bot.

What’s New?

Previously, our crawler had limitations with SPAs, which are websites that load content dynamically using JavaScript. Traditional crawlers struggled with these sites because the content isn’t readily available in the page source. However, our latest update includes dynamic crawling capabilities, making it easier to work with SPAs.

Step-by-Step Instructions

  1. Input Your SPA URL:

    • Enter the URL of your Single-Page Application into the AI training interface.

  2. Automatic Recognition:

    • The upgraded web crawler will automatically recognize that the site is an SPA and begin to process the dynamic content.

      Automatic Recognition

  3. Crawling Options:

    • Choose to crawl the entire site or select specific pages just like with traditional multi-page websites.

      Crawling Options

  4. Training Your Bot:

    • Use the extracted content to train your AI bot, ensuring it has access to the most relevant and comprehensive information from your site.

Benefits of Dynamic Crawling

  • Comprehensive Content Extraction:

    • Ensures all relevant data is captured, even from dynamically loaded pages.

  • Improved AI Training:

    • Provides your bot with a more robust dataset, enhancing its performance and accuracy.

  • User-Friendly:

    • The process is automated and seamless, requiring no additional steps from the user.

Conclusion

We are thrilled to offer this new capability to our users. Dynamic crawling support for SPAs ensures that our conversation AI remains at the forefront of technology, providing you with the best tools for training your bots.

We hope you find this enhancement as exciting as we do. Stay tuned for more updates and improvements.

Back to Blog