RemoveNilTokens

RemoveNilTokens is available as:

This model tests handling nil tokens. The RemoveNilTokens actor removes tokens that have no value.

Null or missing tokens are common in analytical systems like R and SAS where they are used to handle sparsely populated data sources. In database parlance, missing tokens are sometimes called null tokens. Since null is a Java keyword, we use the term "nil".

We can generate these nil tokens by using the "nil" Constant in the expression language.