Note dumb bug: The names dataset should not include names: Carol, Karen, Julie and Judy. These are all tokenized as 2 tokens (unlike others that are 1). Leaving this error in the notebook so results match report but watch out for these token errors :').
I believe prepend_bos should also be False across notebook to match ACDC implementation. Again leaving in notebook to match report. This work was produced as part of a weekend hackathon, beware of bugs :D
← Return to tool
Comments
Log in with itch.io to leave a comment.
Note dumb bug: The names dataset should not include names: Carol, Karen, Julie and Judy. These are all tokenized as 2 tokens (unlike others that are 1). Leaving this error in the notebook so results match report but watch out for these token errors :').
I believe prepend_bos should also be False across notebook to match ACDC implementation. Again leaving in notebook to match report. This work was produced as part of a weekend hackathon, beware of bugs :D
The two token name fact doesn't seem true? https://colab.research.google.com/drive/17pU4A_DHH6GczbCwoVQcuQAIspjGhkRV?usp=sh...
Impressive work!