MCQ SINGLE|ADVANCED
What are the benefits of using byte-pair encoding compared to traditional word-level tokenization?
Your Answer
A) Better handling of rare words and morphemes
B) Simplifies the tokenization process
C) Simplifies the tokenization process
D) Requires less computational power
Notes
to get a helpful tip
