Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
loubnabnl authored Jul 27, 2023
1 parent 3984fef commit e430b4a
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions pii/ner_model/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,8 @@ Here we provide the code used for training [StarPII](https://huggingface.co/bigc
accelerate config
accelerate launch ner_inference.py --process_batch_size=100000 --out_path=processed_dataset
```
To replace secrets in StarCoderData we used teh following tokens:
To replace secrets with this [code] in StarCoderData we used the following tokens:
```
<NAME>, <EMAIL>, <KEY>, <PASSWORD>
To mask IP addresses, we randomly selected an IP address from 5~synthetic, private, non-internet-facing IP addresses of the same type.
```
To mask IP addresses, we randomly selected an IP address from 5~synthetic, private, non-internet-facing IP addresses of the same type.

0 comments on commit e430b4a

Please sign in to comment.