3 Commits

Author	SHA1	Message	Date
qianlong	0c35247b58	change icu4c compile way	2020-07-07 14:54:49 +08:00
qianlong	c737098017	fix icu complie error	2020-06-18 21:59:18 +08:00
qianlong	4f16f036be	Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp ... add CaseFold, NormalizeUTF8 add RegexReplace add RegexTokenizer add BasicTokenizer add WordpieceTokenizer add BertTokenizer	2020-06-17 15:47:04 +08:00