Look at lines 574-581 of neural_memory.py:
seq = self.store_norm(seq)
# handle keys and values coming from different sequences from hyper connection
values_seq = seq
if self.qkv_receives_diff_views:
seq, values_seq = seq
self.store_norm(seq) always returns a tensor. So in the vent one enters the conditional statement if self.qkv_receives_diff_views, how could seq be decomposed into a tuple?
thanks.
Look at lines 574-581 of
neural_memory.py:self.store_norm(seq)always returns a tensor. So in the vent one enters the conditional statementif self.qkv_receives_diff_views, how couldseqbe decomposed into atuple?thanks.