Skip to content

Incorrect statement seq, values_seq = seq #42

@erlebach

Description

@erlebach

Look at lines 574-581 of neural_memory.py:

        seq = self.store_norm(seq)

        # handle keys and values coming from different sequences from hyper connection

        values_seq = seq

        if self.qkv_receives_diff_views:
            seq, values_seq = seq

self.store_norm(seq) always returns a tensor. So in the vent one enters the conditional statement if self.qkv_receives_diff_views, how could seq be decomposed into a tuple?

thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions