You are here: C++ Support Classes > dtSearch Namespace > Classes > DStringSetProperty Class > DStringSetProperty::tokenizeU8 Method
Close
dtSearch Text Retrieval Engine Programmer's Reference
DStringSetProperty::tokenizeU8 Method
Syntax
C++
void tokenizeU8(const char * utf8String, const char * delim = 0);

Tokenize a UTF-8 string to make a string set, using whitespace, comma, and semicolon as delimiters