sanitize

sanitize, function

def pure sanitize(source: text): text

Removes supported invisible characters from source.

Example

t = "A\u00A0B\tC"
rawLen = strlen(t)
clean = sanitize(t)
cleanLen = strlen(clean)

show summary "Sanitize" with
  escape(t) as "Raw"
  rawLen as "RawLen"
  escape(clean) as "Clean"
  cleanLen as "CleanLen"

This outputs the following list:

Remarks

Use escape to reveal invisible characters before cleaning. You can also combine sanitize with replace when you need to substitute characters instead of removing them.

Supported invisible characters

The sanitize function removes the following characters:

Valid source text

The function accepts text from the following Unicode ranges:

Errors

Characters outside the accepted ranges raise an error like:

sanitize(): "<source>" has invalid character \u2702.

See also

• escape
• replace