| Hangul | 토큰화 |
| Romanization | tokeunhwa |
| Meaning | tokenization |
| Part of Speech | noun |
| TOPIK Level | TOPIK Level 5 |
자연어 처리에서 토큰화는 텍스트를 작은 단위로 나누는 작업이에요.
jayeoneo cheorieseo tokeunhwaneun tekseuteureul jageun danwiro nanuneun jageobieyo.
In natural language processing, tokenization is the task of splitting text into smaller units.
Add 토큰화 to your study queue and master it with spaced repetition flashcards.
토큰화 (tokeunhwa) means "tokenization" in Korean. It is a TOPIK Level 5 vocabulary word.
토큰화 is pronounced "tokeunhwa" in Revised Romanization.
토큰화 is a TOPIK Level 5 word. TOPIK Level 5 is the advanced level with ~8,000 words.