Context aware, pluggable and customizable data protection and de-identification SDK for text and images
Перейти к файлу
Sharon Hart ce63783fcc
Unlock numpy after dropping 3.8 (#1480)
2024-11-06 15:21:45 +02:00
.devcontainer Dev containers for: analyzer, analyzer+transformers, anonymizer and image redaction (#1450) 2024-09-19 13:01:02 -07:00
.github Update defender-for-devops.yml (#1437) 2024-09-03 20:28:07 +03:00
.pipelines/templates Removed python 3.8 support (EOL) and added 3.12 (#1479) 2024-11-04 11:47:02 +02:00
docs Unlock numpy after dropping 3.8 (#1480) 2024-11-06 15:21:45 +02:00
e2e-tests Removed python 3.8 support (EOL) and added 3.12 (#1479) 2024-11-04 11:47:02 +02:00
overrides NLP engine sample + refresh on samples (#1388) 2024-07-10 16:04:47 +03:00
presidio-analyzer Removed python 3.8 support (EOL) and added 3.12 (#1479) 2024-11-04 11:47:02 +02:00
presidio-anonymizer Removed python 3.8 support (EOL) and added 3.12 (#1479) 2024-11-04 11:47:02 +02:00
presidio-cli Removed python 3.8 support (EOL) and added 3.12 (#1479) 2024-11-04 11:47:02 +02:00
presidio-image-redactor Unlock numpy after dropping 3.8 (#1480) 2024-11-06 15:21:45 +02:00
presidio-structured Unlock numpy after dropping 3.8 (#1480) 2024-11-06 15:21:45 +02:00
.env Add local build script (#511) 2021-02-14 17:33:31 +02:00
.gitignore minor notebook changes (#1420) 2024-07-22 11:58:46 +03:00
.pre-commit-config.yaml Add Ruff linter + Apply Ruff fix (#1379) 2024-05-12 10:16:47 +03:00
CHANGELOG.md version 2.2.355 (#1410) 2024-07-18 08:28:38 +03:00
CODE_OF_CONDUCT Create CODE_OF_CONDUCT (#667) 2021-04-13 14:36:20 +03:00
CONTRIBUTING.md Add Ruff linter + Apply Ruff fix (#1379) 2024-05-12 10:16:47 +03:00
LICENSE Initial presidio version 2018-10-10 23:51:43 +03:00
NOTICE Add missing dependencies for image-redactor (#1257) 2024-01-22 09:24:25 +02:00
README.MD Added presidio structured downloads to readme (#1392) 2024-05-30 19:37:38 +03:00
SECURITY.md added allow list functionality to analyzer engine (#865) 2022-06-19 16:16:57 +03:00
azure-pipelines-ci.yml Update CI due to DockerCompose project name issue (#1428) 2024-08-04 22:37:42 +03:00
azure-pipelines.yml Update CI due to DockerCompose project name issue (#1428) 2024-08-04 22:37:42 +03:00
docker-compose-image.yml Removed python 3.8 support (EOL) and added 3.12 (#1479) 2024-11-04 11:47:02 +02:00
docker-compose-text.yml Removed python 3.8 support (EOL) and added 3.12 (#1479) 2024-11-04 11:47:02 +02:00
docker-compose-transformers.yml Removed python 3.8 support (EOL) and added 3.12 (#1479) 2024-11-04 11:47:02 +02:00
docker-compose.yml Removed python 3.8 support (EOL) and added 3.12 (#1479) 2024-11-04 11:47:02 +02:00
mkdocs.yml NLP engine sample + refresh on samples (#1388) 2024-07-10 16:04:47 +03:00
pyproject.toml Fix N818, E721 (#1382) 2024-05-12 15:05:41 +03:00
run.bat Add testing documentation (#514) 2021-02-15 13:13:17 +02:00

README.MD

Presidio - Data Protection and De-identification SDK

Context aware, pluggable and customizable PII de-identification service for text and images.


Build Status MIT license Release CII Best Practices PyPI pyversions

  • Presidio Analyzer Pypi Downloads
  • Presidio Anonymizer Pypi Downloads
  • Presidio Image-Redactor Pypi Downloads
  • Presidio Structured Pypi Downloads

What is Presidio

Presidio (Origin from Latin praesidium protection, garrison) helps to ensure sensitive data is properly managed and governed. It provides fast identification and anonymization modules for private entities in text such as credit card numbers, names, locations, social security numbers, bitcoin wallets, US phone numbers, financial data and more.

Presidio demo gif


📘 Full documentation

Frequently Asked Questions

💭 Demo

🛫 Examples


Are you using Presidio? We'd love to know how

Please help us improve by taking this short anonymous survey.


Goals

  • Allow organizations to preserve privacy in a simpler way by democratizing de-identification technologies and introducing transparency in decisions.
  • Embrace extensibility and customizability to a specific business need.
  • Facilitate both fully automated and semi-automated PII de-identification flows on multiple platforms.

Main features

  1. Predefined or custom PII recognizers leveraging Named Entity Recognition, regular expressions, rule based logic and checksum with relevant context in multiple languages.
  2. Options for connecting to external PII detection models.
  3. Multiple usage options, from Python or PySpark workloads through Docker to Kubernetes.
  4. Customizability in PII identification and de-identification.
  5. Module for redacting PII text in images (standard image types and DICOM medical images).

⚠️ Presidio can help identify sensitive/PII data in un/structured text. However, because it is using automated detection mechanisms, there is no guarantee that Presidio will find all sensitive information. Consequently, additional systems and protections should be employed.

Installing Presidio

  1. Using pip
  2. Using Docker
  3. From source
  4. Migrating from V1 to V2

Running Presidio

  1. Getting started
  2. Setting up a development environment
  3. PII de-identification in text
  4. PII de-identification in images
  5. Usage samples and example deployments

Support

Contributing

For details on contributing to this repository, see the contributing guide.

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Contributors