General representation of FarNet-II. Original dimensions are batch (B), sequence (S), height (H), and width (W). Channel dimension (C) is additionally used in the following steps. Batch and sequence dimensions are joined together for every operation in the network, except for the application of the ConvLSTM modules. The red arrows symbolize simple convolutions, the light blue arrows symbolize the downward operation that reduces the spacial size of the images while increasing the number of channels, the violet arrows symbolize the bidirectional convolutional LSTM modules, and the dark blue arrows symbolize attention mechanisms. ⊗ symbolizes a dropout of 0.5.