ada/CourseWork_IRFM
1
0
Fork 0
mirror of https://github.com/ada-dmitry/CourseWork_IRFM.git synced 2026-09-24 01:10:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

Refactor loader and processor documentation; enhance index module with README

Browse Source
This commit is contained in:
Dmitry
2026-04-28 21:04:24 +03:00
parent 29e1ee26fb
commit 045fc41660
7 changed files with 104 additions and 55 deletions
Download Patch File Download Diff File Expand all files Collapse all files
modules/loader.py
+2 -1
View File
@@ -54,7 +54,8 @@ def download_with_urllib(url: str, timeout: float) -> str:
def download_html(url: str, retries: int = 3, timeout: float = 30.0) -> str:
"""Загружает HTML-страницу с retry-логикой.
"""
Загружает HTML-страницу с retry-логикой.
Порядок загрузчиков: curl → urllib (curl обходит часть защит consultant.ru).
На каждой итерации retry пробует оба; пауза 0.5 с между попытками.