BPE Encoding files

[fr4nc3sc4]

Hello,
During the BPE encoding, subword-nmt is generating the file {codes_file}. Can you please share this file? If it is not possible, can you share the training set for obtaining the {codes_file}?
I would like to use OpenVocabNLM with a certain dataset and compare my results with the ones obtained in your research.

Furthermore, I have another question. Do you run create_subtoken_data.py and non-ascii_sequences_to_unk.py before BPE encoding?

Thank you.

[lapplislazuli]

@fr4nc3sc4

Not an author, but this might be what you are looking for:
https://github.com/giganticode/icse-2020
There are zenodo artifacts for the separate datasets:
https://zenodo.org/record/3628636