【AIGC】深入理解 LORA模型

深入理解 LORA模型

LORA模型是一种神经网络模型,它通过学习可以自动调整神经网络中各层之间的权重,以提高模型的性能。本文将深入探讨LORA模型的原理、应用场景、优缺点等方面。

1. LORA模型的原理

LORA模型的全称为Learnable Re-Weighting,即可学习的重加权模型。它主要是通过对神经网络中各层之间的权重进行学习,来提高模型的性能。具体来说,LORA模型通过学习到前一层和后一层之间的相关性,来自动调整当前层的权重,从而提高模型的性能。

LORA模型的基本思想是,将神经网络中的每一层看做是一个可加权的特征提取器,每一层的权重决定了它对模型输出的影响。LORA模型通过对权重的调整,可以让不同的层在不同的任务上发挥更好的作用。

在LORA模型中,每一层的权重由两个部分组成:上一层和下一层的权重。具体来说,假设当前层为第 i i i层,上一层为第 i − 1 i-1 i1层,下一层为第 i + 1 i+1 i+1层,则当前层的权重可以表示为:

w i = α i ⋅ W i − 1 ⋅ W i + 1 w_i = \alpha_i \cdot W_{i-1} \cdot W_{i+1} wi=αiWi1Wi+1

其中, α i \alpha_i αi为学习到的可学习参数, W i − 1 W_{i-1} Wi1 W i + 1 W_{i+1} Wi+1分别为上一层和下一层的权重。通过对 α i \alpha_i αi的学习,LORA模型可以自动调整当前层的权重,从而提高模型的性能。

2. LORA模型的应用场景

LORA模型的应用场景比较广泛,主要应用在需要处理复杂数据的场景中,例如自然语言处理、计算机视觉等。在自然语言处理领域,LORA模型可以通过学习上下文语境来提高文本分类、情感分析等任务的性能。在计算机视觉领域,LORA模型可以通过学习不同层之间的相关性来提高图像分类、物体检测等任务的性能。

3. LORA模型的优缺点

LORA模型的主要优点是可以自动学习各层之间的相关性,从而提高模型的性能。与传统的手动调整权重不同,LORA模型可以通过学习数据来自动调整权重,避免了人为调整权重带来的局限性。

然而,LORA模型也存在一些缺点。首先,LORA模型的假设每一层只受到前一层和后一层的影响,这在某些情况下可能会导致一些问题,但是在某些应用中,这种假设可以简化模型的设计和实现。

在LORA模型中,每一层都有一个与之对应的上层权重和下层权重,这些权重可以通过学习来得到。在训练过程中,LORA模型会自动地调整这些权重,从而使得模型更加准确地学习到数据中的特征。

LORA模型的实现过程相对简单,只需要对模型中的每一层进行重加权操作,即对上层权重和下层权重进行加权相乘,得到新的权重,然后用这些新的权重来更新模型。这种重加权操作可以用PyTorch框架中的torch.mm()函数来实现。

总的来说,LORA模型是一种简单而有效的可学习重加权模型,能够在某些应用中显著提高模型的表现。但是,由于其假设的局限性,LORA模型可能不适用于某些数据集和应用场景。

4. LORA 模型组成

一个 LORA 模型,它由三部分组成:lora_down.weightlora_up.weightalpha
其中 lora_down.weightlora_up.weight 是 LORA 模型中的上下层权重,而 alpha 是权重更新时的缩放系数。

5. 命名方式

这些是PyTorch模型中各个层的权重和偏置的命名。在PyTorch中,每个层的权重和偏置都存储在一个名为state_dict的字典中。这些命名规则通常是由层的类型和层在模型中的位置决定的。例如,lora_te_text_model_encoder_layers_9_self_attn_k_proj.lora_up.weight表示LORA模型中第9个自注意力层的K投影层的上行权重。

6. LORA模型key实例

这些key用于在PyTorch中加载和保存LORA模型的权重参数。每个key都与LORA模型中的一个权重张量相关联。

# LORA模型中的权重参数的key

- lora_te_text_model_encoder_layers_0_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_0_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_0_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_0_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_0_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_0_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_0_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_0_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_0_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_0_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_0_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_0_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_0_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_0_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_0_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_0_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_0_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_0_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_10_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_10_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_10_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_10_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_10_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_10_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_10_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_10_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_10_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_10_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_10_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_10_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_10_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_10_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_10_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_10_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_10_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_10_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_11_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_11_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_11_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_11_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_11_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_11_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_11_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_11_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_11_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_11_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_11_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_11_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_11_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_11_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_11_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_11_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_11_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_11_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_1_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_1_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_1_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_1_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_1_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_1_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_1_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_1_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_1_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_1_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_1_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_1_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_1_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_1_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_1_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_1_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_1_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_1_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_2_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_2_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_2_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_2_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_2_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_2_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_2_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_2_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_2_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_2_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_2_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_2_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_2_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_2_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_2_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_2_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_2_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_2_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_3_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_3_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_3_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_3_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_3_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_3_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_3_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_3_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_3_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_3_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_3_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_3_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_3_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_3_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_3_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_3_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_3_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_3_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_4_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_4_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_4_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_4_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_4_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_4_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_4_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_4_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_4_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_4_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_4_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_4_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_4_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_4_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_4_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_4_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_4_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_4_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_5_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_5_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_5_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_5_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_5_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_5_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_5_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_5_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_5_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_5_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_5_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_5_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_5_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_5_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_5_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_5_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_5_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_5_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_6_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_6_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_6_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_6_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_6_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_6_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_6_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_6_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_6_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_6_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_6_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_6_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_6_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_6_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_6_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_6_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_6_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_6_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_7_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_7_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_7_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_7_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_7_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_7_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_7_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_7_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_7_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_7_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_7_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_7_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_7_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_7_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_7_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_7_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_7_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_7_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_8_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_8_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_8_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_8_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_8_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_8_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_8_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_8_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_8_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_8_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_8_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_8_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_8_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_8_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_8_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_8_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_8_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_8_self_attn_v_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_9_mlp_fc1.alpha.
- lora_te_text_model_encoder_layers_9_mlp_fc1.lora_down.weight.
- lora_te_text_model_encoder_layers_9_mlp_fc1.lora_up.weight.
- lora_te_text_model_encoder_layers_9_mlp_fc2.alpha.
- lora_te_text_model_encoder_layers_9_mlp_fc2.lora_down.weight.
- lora_te_text_model_encoder_layers_9_mlp_fc2.lora_up.weight.
- lora_te_text_model_encoder_layers_9_self_attn_k_proj.alpha.
- lora_te_text_model_encoder_layers_9_self_attn_k_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_9_self_attn_k_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_9_self_attn_out_proj.alpha.
- lora_te_text_model_encoder_layers_9_self_attn_out_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_9_self_attn_out_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_9_self_attn_q_proj.alpha.
- lora_te_text_model_encoder_layers_9_self_attn_q_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_9_self_attn_q_proj.lora_up.weight.
- lora_te_text_model_encoder_layers_9_self_attn_v_proj.alpha.
- lora_te_text_model_encoder_layers_9_self_attn_v_proj.lora_down.weight.
- lora_te_text_model_encoder_layers_9_self_attn_v_proj.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_proj_in.alpha.
- lora_unet_down_blocks_0_attentions_0_proj_in.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_proj_in.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_proj_out.alpha.
- lora_unet_down_blocks_0_attentions_0_proj_out.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_proj_out.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_down_blocks_0_attentions_0_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_proj_in.alpha.
- lora_unet_down_blocks_0_attentions_1_proj_in.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_proj_in.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_proj_out.alpha.
- lora_unet_down_blocks_0_attentions_1_proj_out.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_proj_out.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_down_blocks_0_attentions_1_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_proj_in.alpha.
- lora_unet_down_blocks_1_attentions_0_proj_in.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_proj_in.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_proj_out.alpha.
- lora_unet_down_blocks_1_attentions_0_proj_out.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_proj_out.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_down_blocks_1_attentions_0_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_proj_in.alpha.
- lora_unet_down_blocks_1_attentions_1_proj_in.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_proj_in.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_proj_out.alpha.
- lora_unet_down_blocks_1_attentions_1_proj_out.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_proj_out.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_down_blocks_1_attentions_1_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_proj_in.alpha.
- lora_unet_down_blocks_2_attentions_0_proj_in.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_proj_in.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_proj_out.alpha.
- lora_unet_down_blocks_2_attentions_0_proj_out.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_proj_out.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_down_blocks_2_attentions_0_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_proj_in.alpha.
- lora_unet_down_blocks_2_attentions_1_proj_in.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_proj_in.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_proj_out.alpha.
- lora_unet_down_blocks_2_attentions_1_proj_out.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_proj_out.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_down_blocks_2_attentions_1_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_mid_block_attentions_0_proj_in.alpha.
- lora_unet_mid_block_attentions_0_proj_in.lora_down.weight.
- lora_unet_mid_block_attentions_0_proj_in.lora_up.weight.
- lora_unet_mid_block_attentions_0_proj_out.alpha.
- lora_unet_mid_block_attentions_0_proj_out.lora_down.weight.
- lora_unet_mid_block_attentions_0_proj_out.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_mid_block_attentions_0_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_proj_in.alpha.
- lora_unet_up_blocks_1_attentions_0_proj_in.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_proj_in.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_proj_out.alpha.
- lora_unet_up_blocks_1_attentions_0_proj_out.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_proj_out.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_up_blocks_1_attentions_0_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_proj_in.alpha.
- lora_unet_up_blocks_1_attentions_1_proj_in.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_proj_in.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_proj_out.alpha.
- lora_unet_up_blocks_1_attentions_1_proj_out.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_proj_out.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_up_blocks_1_attentions_1_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_proj_in.alpha.
- lora_unet_up_blocks_1_attentions_2_proj_in.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_proj_in.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_proj_out.alpha.
- lora_unet_up_blocks_1_attentions_2_proj_out.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_proj_out.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_up_blocks_1_attentions_2_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_proj_in.alpha.
- lora_unet_up_blocks_2_attentions_0_proj_in.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_proj_in.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_proj_out.alpha.
- lora_unet_up_blocks_2_attentions_0_proj_out.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_proj_out.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_up_blocks_2_attentions_0_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_proj_in.alpha.
- lora_unet_up_blocks_2_attentions_1_proj_in.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_proj_in.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_proj_out.alpha.
- lora_unet_up_blocks_2_attentions_1_proj_out.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_proj_out.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_up_blocks_2_attentions_1_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_proj_in.alpha.
- lora_unet_up_blocks_2_attentions_2_proj_in.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_proj_in.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_proj_out.alpha.
- lora_unet_up_blocks_2_attentions_2_proj_out.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_proj_out.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_up_blocks_2_attentions_2_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_proj_in.alpha.
- lora_unet_up_blocks_3_attentions_0_proj_in.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_proj_in.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_proj_out.alpha.
- lora_unet_up_blocks_3_attentions_0_proj_out.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_proj_out.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_up_blocks_3_attentions_0_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_proj_in.alpha.
- lora_unet_up_blocks_3_attentions_1_proj_in.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_proj_in.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_proj_out.alpha.
- lora_unet_up_blocks_3_attentions_1_proj_out.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_proj_out.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_up_blocks_3_attentions_1_transformer_blocks_0_ff_net_2.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_proj_in.alpha.
- lora_unet_up_blocks_3_attentions_2_proj_in.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_proj_in.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_proj_out.alpha.
- lora_unet_up_blocks_3_attentions_2_proj_out.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_proj_out.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_k.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_k.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_k.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_out_0.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_out_0.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_out_0.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_q.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_q.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_q.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_v.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_v.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn1_to_v.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_k.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_k.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_k.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_out_0.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_out_0.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_out_0.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_q.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_q.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_q.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_v.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_v.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_attn2_to_v.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_ff_net_0_proj.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_ff_net_0_proj.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_ff_net_0_proj.lora_up.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_ff_net_2.alpha.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_ff_net_2.lora_down.weight.
- lora_unet_up_blocks_3_attentions_2_transformer_blocks_0_ff_net_2.lora_up.weight.

  • 8
    点赞
  • 69
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 3
    评论
基座模型LoRa模型是两种不同的技术模型,它们在应用场景和功能上有所不同,因此可以选择分开部署。 基座模型是指在软件架构中,将核心业务逻辑和基础设施分离的模式。它通过将基础设施和核心业务逻辑解耦,使得系统更加灵活和可扩展。基座模型可以将一些通用的功能,例如用户认证、权限管理、日志记录等模块集中在基础设施中,其他具体的业务功能则可以在不同的模块中进行开发。这种模式可以提高代码的复用性,简化系统的维护和扩展。 LoRa模型是指采用LoRa技术进行通信的模型LoRa是一种低功耗广域网技术,适用于物联网等远距离无线通信场景。LoRa模型通常使用LoRa网关与终端设备进行通信,通过LoRaWAN协议实现设备之间的连接和数据传输。LoRa模型适用于需要远程监控、数据采集、传感器网络等场景,可以实现低成本、低功耗的无线通信。 将基座模型LoRa模型分开部署可以实现代码的解耦和模块化。基座模型可以作为系统的基础设施,提供一些通用的功能。而LoRa模型则可以作为一个独立的模块,用于处理LoRa通信的相关业务。这样的分开部署可以使系统更加灵活和可扩展,降低不同模块之间的耦合度,提高系统的可维护性和可扩展性。 另外,分开部署还可以使得不同模型的开发团队专注于自己的领域,提高开发效率。基座模型的开发团队可以专注于基础设施的建设和维护,LoRa模型的开发团队则可以专注于LoRa通信相关的业务逻辑。这样的分工可以使开发过程更加高效和有序。 综上所述,基座模型LoRa模型分开部署可以实现代码解耦、模块化开发,提高系统的灵活性和可扩展性,同时也提升了团队的开发效率。

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 3
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

莫余

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值