Sorry, @argosopentech, this is my bad.
I’ve had issues with get_installed_packages segfaulting locally when loading and added tokenize_pretokenized=True to stanza pipeline init (I misunderstood what the flag does). The tests passed, but the split was broken as a result.
It might be an issue with pytorch+cpu on Intel Mac (won’t be the first issue I encounter something there), I’ll attempt to get to the bottom of it and submit a PR for resetting tokenize_pretokenized