Skip to content

Remove ellipsis when tokenizing special tokens such as :m: and :si:  #3

@vicchuayh

Description

@vicchuayh

BELA v2.0.0a21.post6 tokenize() function does not process ellipsis when they are embedded in singing or mimicking segments.

E.g., applying tokenize() function on :si:walking+in+the+jungle+walking+in+the+jung... yields: ['walking', 'in', 'the', 'jungle', 'walking', 'in', 'the', 'jung...']

Proposing to remove ellipsis if ellipsis parameter is set True. Expected result would look like this: ['walking', 'in', 'the', 'jungle', 'walking', 'in', 'the', 'jung'].

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is needed

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions