`vqa_benchmarking_backend.tokenizers.vqatokenizer`¶

This code is based on OpenVQA (https://github.com/MILVLG/openvqa)

Module Contents¶

Functions¶

`process_punctuation`(inText)
`process_digit_article`(inText)

Attributes¶

`contractions`
`manual_map`
`articles`
`period_strip`
`comma_strip`
`punct`

vqa_benchmarking_backend.tokenizers.vqatokenizer.contractions¶

vqa_benchmarking_backend.tokenizers.vqatokenizer.manual_map¶

vqa_benchmarking_backend.tokenizers.vqatokenizer.articles = ['a', 'an', 'the']¶

vqa_benchmarking_backend.tokenizers.vqatokenizer.period_strip¶

vqa_benchmarking_backend.tokenizers.vqatokenizer.comma_strip¶

vqa_benchmarking_backend.tokenizers.vqatokenizer.punct = [';', '/', '[', ']', '"', '{', '}', '(', ')', '=', '+', '\\', '_', '-', '>', '<', '@', '`', ',',...¶

vqa_benchmarking_backend.tokenizers.vqatokenizer.process_punctuation(inText)¶

vqa_benchmarking_backend.tokenizers.vqatokenizer.process_digit_article(inText)¶