impira/layoutlm-invoices is a forked repo from huggingface. License: cc-by-nc-sa-4-0

cc-by-nc-sa-4-0 document-question-answering model

Go to file

Ankur Goyal 9d33a03f04 Improve titles		2022-09-06 11:04:13 -07:00
.gitattributes	initial commit	2022-09-06 17:49:13 +00:00
README.md	Improve titles	2022-09-06 11:04:13 -07:00
after.png	Improve README	2022-09-06 11:01:39 -07:00
before.png	Fix "before" image	2022-09-06 11:02:52 -07:00
config.json	Initial commit	2022-09-06 10:50:42 -07:00
merges.txt	Initial commit	2022-09-06 10:50:42 -07:00
pyproject.toml	Initial commit	2022-09-06 10:50:42 -07:00
pytorch_model.bin	Initial commit	2022-09-06 10:50:42 -07:00
setup.cfg	Initial commit	2022-09-06 10:50:42 -07:00
special_tokens_map.json	Initial commit	2022-09-06 10:50:42 -07:00
tokenizer.json	Initial commit	2022-09-06 10:50:42 -07:00
tokenizer_config.json	Initial commit	2022-09-06 10:50:42 -07:00
vocab.json	Initial commit	2022-09-06 10:50:42 -07:00

README.md

language

license

LayoutLM for Invoices

This is a fine-tuned version of the multi-modal LayoutLM model for the task of question answering on invoices and other documents. It has been fine-tuned on a proprietary dataset of invoices as well as both SQuAD2.0 and DocVQA for general comprehension.

Non-consecutive tokens

Unlike other QA models, which can only extract consecutive tokens (because they predict the start and end of a sequence), this model can predict longer-range, non-consecutive sequences with an additional classifier head. For example, QA models often encounter this failure mode:

Before

After

However this model is able to predict non-consecutive tokens and therefore the address correctly:

Getting started with the model

The best way to use this model is via DocQuery.

About us

This model was created by the team at Impira.