Hi,

Great work! I was wondering whether it is possible to change the English task into a Chinese task. Do you think it is possible to make the strategy come true through the Chinese data and the Chinese model?

Thanks for your reply!

在进行交互的 前有限轮对话中，当所有对话内容tokenize之后的总长度小于max_input_length时，AI回复的strategy一直保持不变，直到tokenize之后的总长度大于max_input_length后，因为这时候开始做max_input_length的截断了，strat_dialogpt.py中predict_strategy函数中切片的logits才会变化，AI回复的strategy才会变，想问一下，是就这么设计的，还是其他原因啊？

错误如下： 用户无论输入什么，机器都提示策略错误。是找不到策略吗？求作者解答 谢谢 A new conversation starts! Human: hi Traceback (most recent call last): File "/root/Emotional-Support-Conversation-main/codes_zcj/interact.py", line 168, in inputs = inputter.convert_data_to_inputs(history, toker, **dataloader_kwargs) File "/root/Emotional-Support-Conversation-main/codes_zcj/inputters/strat.py", line 87, in convert_data_to_inputs strat_id = process('[' + dialog[i]['strategy'] + ']') KeyError: 'strategy'

size mismatch for final_logits_bias: copying a param with shape torch.Size([1, 54953]) from checkpoint, the shape in current model is torch.Size([1, 54944]). size mismatch for model.shared.weight: copying a param with shape torch.Size([54953, 512]) from checkpoint, the shape in current model is torch.Size([54944, 512]). size mismatch for model.encoder.embed_tokens.weight: copying a param with shape torch.Size([54953, 512]) from checkpoint, the shape in current model is torch.Size([54944, 512]). size mismatch for model.decoder.embed_tokens.weight: copying a param with shape torch.Size([54953, 512]) from checkpoint, the shape in current model is torch.Size([54944, 512]). size mismatch for lm_head.weight: copying a param with shape torch.Size([54953, 512]) from checkpoint, the shape in current model is torch.Size([54944, 512]).

我把从 https://huggingface.co/lsy641/ESC_Blender_noStrategy/tree/main 的模型放到blend-small文件夹下面之后，运行Python BlenderEmotionalSupport.py 文件， 遇到了这个维度不匹配的错误，请问这是怎么回事呢？

I see "next_strategy_id" is not used in the Emotional-Support-Conversation/codes/src/transformers/models/blenderbot_small/modeling_blenderbot_small.py.

Except for useless code for role and turn id, I can't tell more code differences between codes/src/transformers and huggingface transformers.

That is to say, I can successfully reproduce your result only by data preprocess adding strategy. Right?

Hi,

I use the code in codes to train model. But I find a strange phenomenon that the loss suddenly decreases at the beginning of every epoch.

So, my question is that is this the same as your training curve? and why does it suddenly decrease at the beginning of every epoch? I thought about it for a long time, but I still can't figure it out. Thanks a lot!

Hi! Great work! I wanted to interact with the bot with strategy, so I trained the model following train_strat.sh. then I wanted to interact with the trained model and run interact_strat.sh. However, I get errors in inputters/strat.py How could I solve the problem?

/workspace/Dialogue/Emotional-Support-Conversation/codes_zcj# bash RUN/interact_strat.sh 06/07/2022 00:58:18 - INFO - utils.building_utils - loading finetuned model from /workspace/Dialogue/Emotional-Support-Conversation/codes_zcj/DATA/strat.strat/2022-06-07004140.3e-05.16.1gpu/epoch-1.bin 06/07/2022 00:58:19 - INFO - utils.building_utils - deploying model...

A new conversation starts! Human: Hi! Traceback (most recent call last): File "interact.py", line 168, in inputs = inputter.convert_data_to_inputs(history, toker, **dataloader_kwargs) File "/workspace/Dialogue/Emotional-Support-Conversation/codes_zcj/inputters/strat.py", line 87, in convert_data_to_inputs strat_id = process('[' + dialog[i]['strategy'] + ']') KeyError: 'strategy'

Hello, I recently encountered a problem in replicating your code. I tried to train the model _strat with strategies, but there was some problem in the final interact process. Do you ever encounter it? Looking forward to your reply!

在数据prepare的时候： labels = ([strat_id] + response + [eos])[:max_decoder_input_length + 1] decoder_input_ids = [bos] + labels[:-1] label的第一个值是strat_id对应的token_id，decoder_input_ids 的第一个值是bos对应的token_id. 训练过程中计算loss的时候：loss = F.cross_entropy(lm_logits.view(-1, lm_logits.size(-1)), labels.view(-1), reduction='none')，lm_logits计算的原始输入是decoder_input_ids ，与label进行cross_entropy，每个response的第一个token_id是不是对应错了？？求大佬指导

when I ran the code python BlenderEmotionalSupport.py, I got an error:

OSError: Error no file named ['pytorch_model.bin', 'tf_model.h5', 'model.ckpt.index'] found in directory ./blender-small or from_tf set to False

After downloading model file in this link, then changing the self.output_dir in class Args() , I got following error

Traceback (most recent call last): File "/data00/home/zhushaojin/work_dir/20210701_ESC/Emotional-Support-Conversation/codes/src/transformers/modeling_utils.py", line 1038, in from_pretrained state_dict = torch.load(resolved_archive_file, map_location="cpu") File "/home/zhushaojin/anaconda3/lib/python3.7/site-packages/torch/serialization.py", line 595, in load return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args) File "/home/zhushaojin/anaconda3/lib/python3.7/site-packages/torch/serialization.py", line 764, in _legacy_load magic_number = pickle_module.load(f, **pickle_load_args) _pickle.UnpicklingError: invalid load key, 'v'.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "BlenderEmotionalSupport.py", line 1020, in generate() File "BlenderEmotionalSupport.py", line 920, in generate from_tf=False, File "/data00/home/zhushaojin/work_dir/20210701_ESC/Emotional-Support-Conversation/codes/src/transformers/modeling_utils.py", line 1041, in from_pretrained f"Unable to load weights from pytorch checkpoint file for '{pretrained_model_name_or_path}' " OSError: Unable to load weights from pytorch checkpoint file for '/home/zhushaojin/work_dir/20210701_ESC/blenderbot_small-90M' at '/home/zhushaojin/work_dir/20210701_ESC/blenderbot_small-90M/pytorch_model.bin'If you tried to load a PyTorch model from a TF 2.0 checkpoint, please set from_tf=True.

How can I get the correct model for running BlenderEmotionalSupport.py in codes?

您好，我运行infer_strat.sh时会出现下面的问题，想咨询下作者解决的方法，谢谢 Traceback (most recent call last): File "/root/Emotional-Support-Conversation-main/codes_zcj/prepare.py", line 36, in toker = build_model(only_toker=True, **names) File "/root/Emotional-Support-Conversation-main/codes_zcj/utils/building_utils.py", line 27, in build_model raise ValueError ValueError