Skip to main content

Web Crawl - Agentic Web Searching with Trusted Domains

Owners can now provision specific websites so BrokerBot can search, gather, and apply real-time information from trusted sources.

Maximo Gomez VI avatar
Written by Maximo Gomez VI
Updated this week

🔎 What is Agentic Web Searching?

Unlike basic web scraping, Agentic Web Searching allows BrokerBot to:

  • Navigate provisioned websites in real time.

  • Pull up-to-date information (e.g., tax records, comps, policies).

  • Use that information directly in answers and workflows.

This ensures your team is receiving reliable, leadership-approved data—not random results from across the internet.


⚙️ How to Enable Trusted Domains

  1. Navigate to Settings → Open your BrokerBot dashboard.

  2. Select “Web Crawler” in the left-hand menu.

  3. Add Your Trusted Domains → Enter the full website URL (e.g., https://yourassociation.org) and click + Add.

  4. Save Settings → BrokerBot will now have secure, real-time access to that site.

💡 Only Account "Owners" or "Team Leaders" can add or remove domains. This ensures full control over which sources your agents ("members") are using.


🏡 Examples of Trusted Domains You Might Add

  • Local Association of REALTORS® → Compliance forms, policies, and member resources.

  • County Tax Assessor Website → Property tax records and ownership details.

  • Listing/MLS Site → Generate up-to-date comparable sales (comps).

  • Your Brokerage Website → Provide instant answers about company policies and resources.


🎥 Video Walkthroughs

Adding a Domain:

(Navigating to the Web Crawler page and adding a domain)

Removing a Domain:

(Removing an allowed domain on the Web Crawler page)

Default Accessible Domains:

(These domains are accessible by default without being added to your allowed domains list)


✅ Key Benefits

  • Leadership Control → Only approved sites can be accessed.

  • Agent Confidence → Agents know their answers come from verified sources.

  • Real-Time Accuracy → Always up to date with the latest data available online.


📌 Summary

Agentic Web Searching is a game-changing feature for brokerages. By whitelisting only the websites you trust, you can empower your agents with instant, accurate, and relevant answers — all within BrokerBot.

Did this answer your question?