LLM-项目详解（一）：Chinese-LLaMA-Alpaca【transformers/models/llama/modeling_llama.py文件】

u013250861

已于 2023-08-14 23:22:13 修改

阅读量568

点赞数

CC 4.0 BY-SA版权

分类专栏： # LLM/经典模型文章标签： llama

于 2023-08-14 19:54:20 首次发布

本文链接：https://blog.csdn.net/u013250861/article/details/132283013

LLM/经典模型专栏收录该内容

44 篇文章 ¥19.90 ¥99.00

订阅专栏

超级会员免费看

本文深入探讨了transformers库中的LLaMA-Alpaca模型，主要分析了modeling_llama.py文件，揭示了模型的内部工作机制。

site-packages/transformers/models/llama/modeling_llama.py

# coding=utf-8
# Copyright 2022 EleutherAI and the HuggingFace Inc. team. All rights reserved.
#
# This code is based on EleutherAI's GPT-NeoX library and the GPT-NeoX
# and OPT implementations in this library. It has been modified from its
# original forms to accommodate minor architectural differences compared
# to GPT-NeoX and OPT used by the Meta AI team that trained the model.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed

了解本专栏