position embedding 1026 while sequence length allowed 1024?
#34
by wahaha1987 - opened
I am confused with the discrepancy among the following three numbers:
- the max sequence length is 1024
- the token id max length of a pair of query and document is 1026
- the position embedding is 1026
How come?