What are the three approaches to tokenization?

Answer

• word-based
• subword-based
• character-based

Relevant part of lecture