mcp_server_webcrawl.utils package

Submodules

class ThumbnailManager[source]

Manages thumbnail generation and caching for image files and URLs.

get_thumbnails(paths)[source]

Convert URLs or file paths to base64 encoded strings.

Parameters:: paths (list[str]) – List of URLs or file paths to convert
Returns:: Dictionary mapping paths to their base64 representation or None if failed
Return type:: dict[str, str | None]

get_help_short_message(version)[source]

get_help_long_message(version)[source]

get_logger_configuration()[source]

Get log name, path, and level (in that order)

get_logger()[source]

Get logger, usually in order to write to it

initialize_logger()[source]

Validate and set up logger for writing

initialize_mcp_server()[source]

MCP stdio streams require utf-8 explicitly set for Windows (default cp1252) or internationalized content will fail.

get_crawler_tools(sites=None)[source]

Generate crawler tools based on available sites.

Parameters:: sites (list[SiteResult] | None) – optional list of site results to include in tool descriptions
Returns:: List of Tool objects for sites and resources

to_isoformat_zulu(dt)[source]

Convert datetime to iso Z.

python<=3.10 struggles with Z and fractions of seconds, will throw. smooth out the iso string, second precision isn’t key here

from_isoformat_zulu(dt_string)[source]

Convert ISO string to datetime.

python<=3.10 struggles with Z and fractions of seconds, will throw. smooth out the iso string, second precision isn’t key here