You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+17-15Lines changed: 17 additions & 15 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,9 +10,11 @@ This repository hosts the source code for PoliGraph, including:
10
10
- Dataset preparation scripts under `datasets/`.
11
11
- Model training scripts under `models/`.
12
12
13
+
PoliGraph is part of [the Policy-Technology project](https://athinagroup.eng.uci.edu/projects/auditing-and-policy-analysis/) of the UCI Networking Group.
14
+
13
15
## Citation
14
16
15
-
If you create a publication based on PoliGraph, please cite the paper as follows:
17
+
If you create a publication based on PoliGraph and/or its dataset, please cite the paper as follows:
16
18
17
19
```bibtex
18
20
@inproceedings{cui2023poligraph,
@@ -31,11 +33,11 @@ We have tested all the code in this repository on a server with the following co
31
33
- GPU: NVIDIA RTX A5000 (24 GiB of video memory)
32
34
- OS: Debian GNU/Linux 11 (bullseye)
33
35
34
-
A Linux server with 32 GiB of memory, 20 GiB of free disk space (after installing conda), and a similar NVIDIA GPU should suffice to run everything. Note that PoliGraph-er can run without a GPU, but the performance would be significantly lower.
36
+
A Linux server with 32 GiB of memory, 20 GiB of free disk space (after installing conda), and a similar NVIDIA GPU should suffice to run everything. A GPU is required to enable hardware acceleration for [transformer-based NLP models](https://spacy.io/usage/embeddings-transformers). Note that PoliGraph-er can run without a GPU, but the performance would be significantly lower.
35
37
36
38
## PoliGraph-er
37
39
38
-
PoliGraph-er is the software used to generate PoliGraphs from the text of a privacy policy.
40
+
PoliGraph-er is the NLP software used to generate PoliGraphs from the text of a privacy policy.
39
41
40
42
### Installation
41
43
@@ -102,7 +104,15 @@ Lastly, execute the `build_graph` script to generate the PoliGraph:
The generated graph is stored at `example/graph-original.yml`.
107
+
The generated graph is stored at `example/graph-original.yml`. You may use a text editor to view it. The format is human-readable and fairly straightforward.
108
+
109
+
Alternatively, if you run `build_graph` with the `--pretty` parameter, it will generate a PoliGraph in the GraphML format (`example/graph-original.graphml`), which can be imported to some graph editor software:
This generates a PoliGraph in the GraphML format (`example/graph-original.graphml`), which can be imported to [yEd](https://www.yworks.com/products/yed), a GUI graph editor. For more instructions, refer to the document [Viewing a PoliGraph](./docs/view-poligraph.md).
131
+
We released the privacy policy dataset used in our paper for reproducibility and other research usages. Please visit [the dataset page](https://athinagroup.eng.uci.edu/projects/auditing-and-policy-analysis/poligraph-dataset/) to request access to the dataset.
130
132
131
-
## Documentation
133
+
## Artifact Evaluation
132
134
133
135
We will update the documentation under the `docs/` directory to explain the usage of other scripts.
In this experiment, we compare each app's data flows (i.e., the actual data collection practices observed in the network traffic) to the data collection statements inferred from its PoliGraph.
68
68
69
+
Change to the `~/dataset` directory before proceeding:
70
+
71
+
```
72
+
$ cd ~/dataset
73
+
```
74
+
69
75
Step 1. Run PoliGraph-er with the historical (2019) version of privacy policies from the PoliCheck dataset to create PoliGraphs for them:
Copy file name to clipboardExpand all lines: docs/usenix-artifact-evaluation.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,11 +2,11 @@
2
2
3
3
This document provides instructions on how to reproduce the main results in our paper in support of the USENIX Security 2023 Artifact Evaluation.
4
4
5
-
Please note that these instructions are intended for artifact reviewers, who have been given access to our test server.
5
+
Please note the exact commands shown in this document are intended for artifact reviewers, who have been given access to a preconfigured environment. For other users, please check [README.md](../README.md) at the top level of this repository for general information about the use of our code.
6
6
7
7
## Overall Instruction
8
8
9
-
For artifact reviewers, we provide access to our test server which has the recommended hardware configuration. Please check HotCRP comments for instructions on how to access the server via SSH.
9
+
For artifact reviewers, we provide access to our test server which has the recommended hardware configuration. Please check the "Artifact access" information on HotCRP for instructions on how to access the server via SSH.
10
10
11
11
We have prepared the following directories in the home directory:
12
12
@@ -334,4 +334,4 @@ The row indicates that the data type "technical information" is defined in 126 a
334
334
335
335
## Additional Experiments
336
336
337
-
This document only covers the four experiments mentioned in our USENIX'23 Artifact Appendix. We provide another document [Artifact Evaluation (Additional Experiments)](./usenix-artifact-evaluation-additional.md) to show how to reproduce results in Sections 5.3 and 5.4 of our main paper.
337
+
Corresponding to our USENIX '23 Artifact Appendix, this document covers experiments in Sections 4.2 (Evaluation), 5.1 (Policies Summarization), and 5.2 (Correct Definitions of Terms), which we believe showcase the main merits of PoliGraph. For those interested in Sections 5.3 (Contradiction Analysis) and 5.4 (Data Flow-to-Policy Consistency Analysis), we provide another document [Artifact Evaluation (Additional Experiments)](./usenix-artifact-evaluation-additional.md) to show how to reproduce the main results there.
0 commit comments