The sequencer drift was larger than the sequencing window. This can cause reorgs. To fix I reduced the drift to 10s, which is lower than the 45 second sequencing window specified via the L1 block time and the window size.