我可以在变压器库中动态添加或删除 LoRA 重量吗? 像扩散器一样-allqahome-开发者的问答家园

English 中文(简体)

我可以在变压器库中动态添加或删除 LoRA 重量吗? 像扩散器一样

原标题：Can I dynamically add or remove LoRA weights in the transformer library like diffusers

我看到,在扩散库中,根据这一条,动态地增减LORA重量有这样的特征, /GitHub, 并使用载荷_lora_ weights和导体_lora_rights。我想知道我是否能为变压器做类似LORA的事情?

在PEFT中,当您创建或装入一个适配器时,您给它取个名字。

然后您就可以以 https://huggingface.co/docs/peft/package_regage/lora_peft.LoraModel.set_adpter

See the example of how to do this here: https://huggingface.co/docs/peft/en/developer_guides/lora#load-adapters

上一篇：确保以基本等级安全平行执行与共同目的初始化的试验

下一篇：如何匹配从输入到列表的元素?

相关问题

婚礼

• 如何改变在休克疗法中放置病媒的层面?

How to load a huggingface dataset from local path?

Take a simple example in this website, https://huggingface.co/datasets/Dahoas/rm-static: if I want to load this dataset online, I just directly use, from datasets import load_dataset dataset = ...

Weighted Loss in Huggingface Generator module

I am using Huggginface s Seq2SeqTrainer module and Generator modules for my encoder-decoder models. I have to use weighted sample loss calculation in each mini-batches. Does anyone know how to achieve ...

AttributeError: AcceleratorState object has no attribute distributed_type

import transformers from datasets import load_dataset import tensorflow as tf tokenizer = transformers.AutoTokenizer.from_pretrained( roberta-base ) df = load_dataset( csv , data_files={ train : ...

Sentence embeddings from LLAMA 2 Huggingface opensource

Could anyone let me know if there is any way of getting sentence embeddings from meta-llama/Llama-2-13b-chat-hf from huggingface? Model link: https://huggingface.co/meta-llama/Llama-2-13b-chat-hf I ...

Using huggingface tools under windows in a Jupiter Notebook

I m trying to use the following code in a jupyter notebook import os #os.environ[ HF_HOME ] = D:\Users\username\huggingface\hub\ os.environ[ TRANSFORMERS_CACHE ] = "D:/Users/username/....

Unable to Create Instances for multiple Users in my FastAPI HF spaces Application with Docker

I am deploying a FastAPI application in the Hugging Face Spaces environment, and I m encountering an issue where it only allows one instance for all users sharing the same space. Despite attempts to ...

Is there a way to save a pre-compiled AutoTokenizer?

Sometimes, we ll have to do something like this to extend a pre-trained tokenizer: from transformers import AutoTokenizer from datasets import load_dataset ds_de = load_dataset("mc4", de )...

热门标签

友情链接

Allggapp Alljchome-教程家园 mvfinale.com-影视剧情大结局大全