change the webpage size limit to 5,000,000

yym68686 · Sep 27, 2023 · c930669 · c930669
1 parent 695c4fb
commit c930669
Show file tree

Hide file tree

Showing 2 changed files with 2 additions and 2 deletions.
diff --git a/README.md b/README.md
@@ -2,7 +2,7 @@
 
 Join the [Telegram Group](https://t.me/+_01cz9tAkUc1YzZl) chat to share your user experience or report Bugs.
 
-[English](./README.md)|[Simplified Chinese](./README.zh-CN.md)|[Traditional Chinese](./README.zh-TW.md)
+[English](./README.md) | [Simplified Chinese](./README.zh-CN.md) | [Traditional Chinese](./README.zh-TW.md)
 
 ## ✨ Features
 

diff --git a/agent.py b/agent.py
@@ -218,7 +218,7 @@ def Web_crawler(url: str) -> str:
         requests.packages.urllib3.disable_warnings()
         response = requests.get(url, headers=headers, verify=False, timeout=5, stream=True)
         content_length = int(response.headers.get('Content-Length', 0))
-        if content_length > 500000:
+        if content_length > 5000000:
             print("Skipping large file:", url)
             return result
         soup = BeautifulSoup(response.text.encode(response.encoding), 'lxml', from_encoding='utf-8')