CODEWITHSUNDEEP
neural-networkresnetdeep-residual-networks
C. R.
C. R.

Reputation: 77

Residual Neural Network: Concatenation or Element Addition?

With the residual block in residual neural networks, is the addition at the end of the block true element addition or is it concatenation?

For example, would addition([1, 2], [3, 4]) produce [1, 2, 3, 4] or [4, 6] ?

Upvotes: 7

Views: 4919

Answers (2)

Aditya Saurabh
Aditya Saurabh

Reputation: 31

The operation F + x is performed by a shortcut connection and element-wise addition

It is from the popular ResNet paper by Microsoft Research. Therefore it is element-wise addition, hence [4, 6]

Upvotes: 2

TajyMany
TajyMany

Reputation: 537

It would result in [4, 6], and you can find out more in this paper

Upvotes: 5

Related Questions