# What is Spark UDF de-identification? Definition and meaning

Applies user-defined functions in Spark to mask, tokenize or encrypt fields as part of a pipeline.

## Definition

**Spark UDF de-identification**: Applies user-defined functions in Spark to mask, tokenize or encrypt fields as part of a pipeline.

In short: De-identifying data inside Spark jobs.

## When it is used

Scalable de-identification during ingestion into the lake.

## Learn more

The full guide to **[Spark UDF de-identification](/tools/spark-udf-de-identification)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [Spark Streaming](/glossary/spark-streaming) · Next term: [Speculative decoding](/glossary/speculative-decoding)
