No, haven’t updated it, but thanks, will definitely try it now.
That’s right, I described in more detail here on the byte_fallback option:
Very interesting! I look forward to seeing your results.
Interesting, thanks for sharing. Yes, I noticed that the speed of RPE is worse than PE.
In my experience RoPE is about the same speed as PE.