docs(context): add notes for developer documentation (#4254)

* docs(context): add notes for developer documentation

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>

Author: liangfung

ee/tabby-ui/app/(dashboard)/settings/(integrations)/providers/doc/page.tsx

@@ -8,7 +8,7 @@ export default function DocumentProviderPage() {
   return (
     <>
       <CardContent className="pl-0">
-        <SubHeader>
+        <SubHeader externalLink="https://tabby.tabbyml.com/docs/administration/context/#adding-a-developer-doc-through-admin-ui">
           <p>
             Documents are a critical source for engineering knowledge. Tabby
             provides an easy way to include these documents when interacting

website/docs/administration/context/index.mdx

@@ -79,6 +79,13 @@ git_url = "file:///home/users/repository_a"
 
 ## Adding a Developer Doc through Admin UI
 
+:::info[Note]
+
+1. By default, Tabby uses the **[Katana](https://github.com/projectdiscovery/katana)** to crawl developer documentation. For **Docker deployments**, Katana is pre-installed in the container image. **Non-Docker deployments** require manual Katana installation.
+2. If a developer documentation site implements the **[llms.txt](https://llmstxt.org/)** standard, Tabby directly retrieves and indexes the specified documents, instead of using Katana for automated crawling.
+
+:::
+
 1. Navigate to the **Integrations > Context Providers** page, and then select the `Developer Docs(Beta)`.
 
 <img src={ContextProvidersUrl} alt="Context Providers" />
@@ -96,4 +103,9 @@ Additionally, you can also visit the **Code Browser** page to view the connected
 
 <img src={CodeBrowserEntryUrl} alt="code browser entry" width="300" />
 
-<img src={CodeBrowserUrl} alt="code browser" width="800" />
+<img src={CodeBrowserUrl} alt="code browser" width="800" />
+
+
+
+
+