Fine-tuned SQuAD v1.1 weights for lucid.models.bert_base_qa.
BERT-Base encoder + 2-way span head; F1 88.1 / EM 80.9.
Attributes
SQUAD_V1WeightEntrySQuAD v1.1 fine-tuned checkpoint (F1 88.1 / EM 80.9), sourced
from
transformers/csarron/bert-base-uncased-squad-v1.DEFAULTWeightEntryAlias for
SQUAD_V1.Notes
Reference: Devlin, Chang, Lee, Toutanova, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding", NAACL 2019 (arXiv:1810.04805). Fine-tuned on SQuAD v1.1.
Examples
>>> from lucid.models import bert_base_qa
>>> model = bert_base_qa(pretrained=True).eval()