dtSearch::Engine::UnicodeFilterFlags Enumeration

Values for Options.UnicodeFilterFlags (.NET) or dtsOptions.unicodeFilterFlags (C++) or Options.setUnicodeFilterFlags(java).

[System::Flags]
public enum UnicodeFilterFlags {
  dtsoUfExtractAsHtml = 0x0001,
  dtsoUfOverlapBlocks = 0x0002,
  dtsoUfAutoWordBreakByLength = 0x0004,
  dtsoUfAutoWordBreakByCase = 0x0008,
  dtsoUfAutoWordBreakOnDigit = 0x0010,
  dtsoUfAutoWordBreakOverlapWords = 0x0020,
  dtsoUfFilterFailedDocs = 0x0040,
  dtsoUfFilterAllDocs = 0x0080
}

Visual Basic

<System::Flags>
Public Enum UnicodeFilterFlags
  dtsoUfExtractAsHtml = &H0001
  dtsoUfOverlapBlocks = &H0002
  dtsoUfAutoWordBreakByLength = &H0004
  dtsoUfAutoWordBreakByCase = &H0008
  dtsoUfAutoWordBreakOnDigit = &H0010
  dtsoUfAutoWordBreakOverlapWords = &H0020
  dtsoUfFilterFailedDocs = &H0040
  dtsoUfFilterAllDocs = &H0080
End Enum

Members

Members	Description
dtsoUfExtractAsHtml	Extracting blocks as HTML has no effect on the text that is extracted, but it adds additional information in HTML comments to each extracted block. The HTML comments identify the starting byte offset and encoding of each piece of text extracted from a file.
dtsoUfOverlapBlocks	Overlapping blocks prevents text that crosses a block boundary from being missed in the filtering process. With overlapping enabled, each block extends 256 characters past the start of the previous block.
dtsoUfAutoWordBreakByLength	Automatically insert a word break in long sequences of letters. A word break will be inserted when the word length reaches Options.MaxWordLength.
dtsoUfAutoWordBreakByCase	Automatically insert a word break when a capital letter appears following lower-case letters.
dtsoUfAutoWordBreakOnDigit	Automatically insert a word break when a digit follows letters.
dtsoUfAutoWordBreakOverlapWords	When a word break is automatically inserted due to dtsoUfAutoWordBreakByLength, overlap the two words generated by the word break.
dtsoUfFilterFailedDocs	When a document cannot be indexed due to file corruption or encryption, apply the filtering algorithm to extract text from the file.
dtsoUfFilterAllDocs	Ignore file format information and apply Unicode Filtering to all documents.

Remarks

UnicodeFilterFlags control the behavior of the Unicode Filtering algorithm when it is used to filter text from binary data. See Filtering Options.