From 99ee4e52d25f8a2857bf6df6a64dada1d1569e81 Mon Sep 17 00:00:00 2001 From: Junyang Lin Date: Wed, 9 Nov 2022 09:16:03 +0000 Subject: [PATCH] Update README.md --- README.md | 125 ++++++++++++++++++++++++++++++++---------------------- 1 file changed, 74 insertions(+), 51 deletions(-) diff --git a/README.md b/README.md index 70733a6..6acb695 100644 --- a/README.md +++ b/README.md @@ -51,7 +51,7 @@ However, if you are not satisfied with only using the API, feel free to check ou

## Results -### MUGE Text-to-Image Retrieval +**MUGE Text-to-Image Retrieval**: @@ -59,64 +59,87 @@ However, if you are not satisfied with only using the API, feel free to check ou - - - - - - - - -
SetupZero-shotFinetune
MetricR@1R@5R@10MRR@1R@5R@10MR
WukongViT-B33.459.369.754.139.266.977.461.2
R2D2ViT-B----47.475.183.568.7
CN-CLIPViT-B52.176.784.471.158.483.690.077.4
- - -### Flickr30K-CN Retrieval - - - + - - - - - - - - - - - - - - -
TaskText-to-ImageImage-to-TextWukong42.769.078.063.252.777.985.672.1
SetupZero-shotFinetuneZero-shotFinetune
MetricR@1R@5R@10R@1R@5R@10R@1R@5R@10R@1R@5R@10
WukongViT-B45.773.882.267.689.694.266.288.794.383.997.699.0
R2D2ViT-B---78.394.697.0---92.699.199.8
CN-CLIPViT-B62.786.992.879.194.897.474.693.597.193.599.099.5
- - -### COCO-CN Retrieval - - - + - - - - - - - - - - - - - - + +
TaskText-to-ImageImage-to-TextR2D249.575.783.269.560.182.989.477.5
SetupZero-shotFinetuneZero-shotFinetune
MetricR@1R@5R@10R@1R@5R@10R@1R@5R@10R@1R@5R@10
WukongViT-B49.279.487.967.091.496.748.377.888.865.890.396.6
R2D2ViT-B---75.194.298.1---76.195.398.5
CN-CLIPViT-B62.286.694.977.097.199.057.084.193.677.496.298.9
CN-CLIP63.084.189.278.868.988.793.183.6

+**Flickr30K-CN Retrieval**: + + + + + + + + + + + + + + + + + + + +
TaskText-to-ImageImage-to-Text
SetupZero-shotFinetuneZero-shotFinetune
MetricR@1R@5R@10R@1R@5R@10R@1R@5R@10R@1R@5R@10
Wukong51.778.986.377.494.597.076.194.897.592.799.199.6
R2D260.986.892.784.496.798.477.696.798.995.699.8100.0
CN-CLIP71.291.495.583.896.998.681.697.598.895.399.7100.0
+
+ +**COCO-CN Retrieval**: + + + + + + + + + + + + + + + + + + + +
TaskText-to-ImageImage-to-Text
SetupZero-shotFinetuneZero-shotFinetune
MetricR@1R@5R@10R@1R@5R@10R@1R@5R@10R@1R@5R@10
Wukong53.480.290.174.094.498.155.281.090.673.394.098.0
R2D256.485.093.179.196.598.963.389.395.779.397.198.7
CN-CLIP69.289.996.181.596.999.163.086.692.983.597.399.2
+
+ +**Zero-shot Image Classification**: + + + + + + + + + + + + + + + + + + + +
TaskCIFAR10CIFAR100DTDEuroSATFERFGVCKITTIMNISTPCVOC
GIT88.561.142.943.441.46.722.168.950.080.2
ALIGN94.976.866.152.150.825.041.274.055.283.0
CLIP94.977.056.063.048.333.311.579.062.384.0
Wukong95.477.140.950.3------
CN-CLIP96.079.751.252.055.126.249.979.463.584.9
+

+ ## Citation If you find Chinese CLIP helpful, feel free to cite our paper. Thanks for your support!