Unigram Posted on 2025-02-17 Edited on 2026-08-24 In AI Word count in article: 1.9k Reading time ≈ 7 mins. Unigram tokenization 算法 Read more »
WordPiece Posted on 2025-02-16 Edited on 2026-08-24 In AI Word count in article: 1.3k Reading time ≈ 5 mins. WordPiece 算法 Read more »
BPE(Byte-Pair Encoding) Posted on 2025-02-15 Edited on 2026-08-24 In AI Word count in article: 1.4k Reading time ≈ 5 mins. BPE tokenization 算法 Read more »