How to get all possible tokenization for an input sentence?

[anshumitts]

Hi, I am trying to understand tokenmonster, for my analysis, I need to get all possible tokenization that tokenmonster can generate given a sentence.
for eg. hello world!!, can tokenmonster give all possible tokenization like, "hello" + "world" + "!"+"!" as well as "hello world" + "!" + "!"

[alasdairforsythe]

TokenMonster does not do this. There would be hundreds of them even for "Hello world!" (e.g. every letter, one with 2 letters, etc.)