Skip to main content

Table.tokenize_to_columns

tokenize_to_columnscolumnspatterncase_sensitivitycolumn_counton_problemserror_on_missing_columns

Group: Conversions
Aliases: parse, regex, split

Documentation​

Creates a new Table with the chosen column of Text split by the pattern regular expression into a set of new columns. If the pattern contains marked groups, the values are concatenated together; otherwise the whole match is returned. The values of other columns are repeated for the new rows. For details on Enso's Regex syntax, see the Help Documentation.

Returns

  • Returns a Table with the newly split columns.

Arguments​

  • columns: The name or index of the column(s) to tokenize the text of.
  • pattern: The pattern used to find within the text.
  • case_sensitivity: Specifies if the text values should be compared case sensitively.
  • column_count: The number of columns to split to. If Nothing then columns will be added to fit all data.
  • on_problems: Specifies the behavior when a problem occurs.
  • error_on_missing_columns: If True, an error is raised if a specified column is not found. If False, the missing column is ignored.

Errors​

  • If the data exceeds the column_count, a Column_Count_Exceeded will be reported according to the on_problems behavior.