Utilities

Model Analysis Utilities

Tools for analyzing model architectures and detecting LoRA-compatible modules.

class ual_adapter.utils.model_utils.ModelAnalyzer(model: Module)

Bases: object

Analyzes model architectures to extract useful information for UAL.

__init__(model: Module)

Initialize model analyzer.

Parameters:

model – The model to analyze

analyze() → Dict[str, Any]

Perform comprehensive model analysis.

Returns:

Dictionary with model information

get_lora_target_modules() → List[str]

Auto-detect the best modules for LoRA application.

Returns:

List of module names/patterns for LoRA targets

get_module_dimensions(module_name: str) → Tuple[int, int] | None

Get input and output dimensions for a specific module.

Parameters:

module_name – Name of the module

Returns:

Tuple of (in_features, out_features) or None

validate_lora_compatibility(target_modules: List[str]) → Dict[str, bool]

Validate if target modules are compatible with LoRA.

Parameters:

target_modules – List of module names/patterns to check

Returns:

Dictionary mapping module patterns to compatibility status

Model Analysis

Functions for analyzing model structure and parameters.