Transformer Encoder Output

[UmarSpa]

Hey, thanks for sharing the code.

I am a bit confused regarding the following:

trans-inr/models/trans_inr.py

Line 65 in f4bdc01

w = F.normalize(w * x.repeat(1, 1, w.shape[2] // x.shape[2]), dim=1)

So in essence, you are using Transformer Encoder output (after being passed through a FC layer) to modulate randomly initialized weights of INR, right?