GraphCodeBERT 메모

 

sequence input X = {[CLS], W, [SEP], C, [SEP], V }

source code C = {c1, c2, ..., cn}

comment W = {w1, w2, ..., wm}

where V = {v1, v2, ..., vk} is a set of variables

 

E = {ε1, ε2, ..., εl} is a set of direct edges that represent where the value of each variable comes from.

 

We use a special position embedding for all variables to indicate that they are nodes of data flow.