From 6d66f92aee7275bb21170f0055384e680d8f8224 Mon Sep 17 00:00:00 2001 From: Victor SANH Date: Tue, 22 Mar 2022 15:35:48 -0400 Subject: [PATCH] update image link --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 1c83e12..999ef57 100644 --- a/README.md +++ b/README.md @@ -26,6 +26,6 @@ Based on a few experimentations, we observed that this model could produce biase For instance, for sentences like `This film was filmed in COUNTRY`, this binary classification model will give radically different probabilities for the positive label depending on the country (0.89 if the country is France, but 0.08 if the country is Afghanistan) when nothing in the input indicates such a strong semantic shift. In this [colab](https://colab.research.google.com/gist/ageron/fb2f64fb145b4bc7c49efc97e5f114d3/biasmap.ipynb), [Aurélien Géron](https://twitter.com/aureliengeron) made an interesting map plotting these probabilities for each country. -Map of positive probabilities per country. +Map of positive probabilities per country. We strongly advise users to thoroughly probe these aspects on their use-cases in order to evaluate the risks of this model. We recommend looking at the following bias evaluation datasets as a place to start: [WinoBias](https://huggingface.co/datasets/wino_bias), WinoGender, [Stereoset](https://huggingface.co/datasets/stereoset).