Help center Get started Knowledge center Product documentation API documentation
Product
Lens Weave Maskbits
Overview
Data
Data Import Output Result
Data Preparation
Cleansing Imputation Duplicates Filter Fuzzy Filter Outlier Treatment Binning Trimming Validation Sorting
Transformation
Data Transformation Bulk Data Transformation Merge Union Fuzzy Merge Encoding Normalization Scaling Standardization Aggregate Unpivot Functional Transformation SQL Executor
Statistical Plots
Box Plot Correlation Histogram Pair Wise Line Plot Scatter Plot Bar Plot Stem Plot Step Plot Fill Between Stack Plot Descriptive Statistics
Workflow Agent
Workflow Agent
Scheduler
Scheduler
Library
My Workflows Shared Workflows Audit
Datasource
Datasource
Datasource Management
Data Model
Connectors Management
Admin
Admin
User Management Roles Management Group Management Organization Management

Overview

The Functional Transformation node is a transformation node in a Weave Workflow used to clean, transform, and filter data as required. It applies functions drawn from two categories: Cleansing and Data Transformation to selected fields, and provides a separate Filter Dataset action.

It sits in the middle of a Workflow’s processing path between source nodes (Data Import) and terminal nodes (Result, Output) and emits the transformed data downstream.

Configuration is built as rows in the Configure dialog. Each row selects a Category, a Function, the Fields it applies to, and (for some functions) a value. Multiple rows can be added so several functions apply in one node.

Note: “Workflow” is the in-UI term for what some Weave documentation calls a pipeline. This reference uses “Workflow.”

When to use it

  • Applying a mix of cleansing and data-transformation operations to selected fields in one node.
  • Renaming fields or creating new columns from existing ones.
  • Cleaning field values (whitespace, letters, numbers, special characters, case) inline with other transforms.
  • Filtering the dataset alongside the transformations via Filter Dataset.

Configuration components

ComponentDescription
Functional TransformationOpens the Configure dialog where transformation rows are built.
Filter DatasetFilters data from the dataset.
CategoryChoose Cleansing or Data Transformation for a row.
FunctionThe operation applied, drawn from the selected category.
FieldsThe column(s) the function applies to, chosen via Select.
ActionAdd (+) another transformation row.

Cleansing functions

FunctionDescription
Null ValuesDrops the row which has null values.
Duplicate ValuesDrops duplicate values in the columns on the basis of null value count in the row.
White SpaceRemoves all the whitespaces from the values of the columns.
LetterRemoves the letters from the selected columns.
NumberRemoves the numeric entity from the selected columns.
Special CharacterRemoves the special character from the selected columns.
Selective White SpaceRemoves the left and right white spaces, including any unnecessary whitespace, from the values of the selected columns.
Left White SpaceRemoves space from the beginning of the data of the selected column.
Right White SpaceRemoves space from the end of the data of the selected column.
UppercaseConverts lower case letters to upper case.
LowercaseConverts upper case to lower case.

Data Transformation functions

FunctionDescription
RenameRenames the selected field to the given column name.
Create newCreates a new column with the given name and selected column.
Rename (Pattern Based)Renames the specified pattern of the column with the given value.

Key behaviors

Functional Transformation is a transformation node. Unlike Data Import (source) and Result / Output (terminal), it sits in the middle of the Workflow, applying functions to selected fields and passing the result downstream.

Category-then-function. Each transformation row first selects a category (Cleansing or Data Transformation), then a function within it, then the fields. Some functions require an additional value input.

Multiple rows. Several functions can be configured in one node by adding rows with the add (+) action.