Glossary
What is Spark UDF de-identification? Definition and meaning
Applies user-defined functions in Spark to mask, tokenize or encrypt fields as part of a pipeline.
Definition
Spark UDF de-identification: Applies user-defined functions in Spark to mask, tokenize or encrypt fields as part of a pipeline.
In short: De-identifying data inside Spark jobs.
When it is used
Scalable de-identification during ingestion into the lake.
Learn more
The full guide to Spark UDF de-identification explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Spark Streaming · Next term: Speculative decoding