Data-Parallel Training with KerasNLP and tf.distribute example dataset problem

[sitamgithub-MSIT]

Data-Parallel Training with KerasNLP and tf.distribute example dataset problem

[SuryanarayanaY]

Hi @sitamgithub-MSIT ,

I think the link https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-2-v1.zip not working right ? Please feel free to fix the issue if you want to contribute. Thanks!

[sitamgithub-MSIT]

Hi @sitamgithub-MSIT ,

I think the link https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-2-v1.zip not working right ? Please feel free to fix the issue if you want to contribute. Thanks!

Yeah, the link is not working, saying "Access Denied." Now that this is a dataset link issue, I don't think I can do much. Better will be tagging the author; surely we can get a solution then.

[sitamgithub-MSIT]

@shivance Can you please help with this?

[SamanehSaadat]

Hi @sitamgithub-MSIT

Thanks for reporting this issue. As discussed here it seems that the dataset link doesn't work anymore. I think this dataset is available on Hugging Face too: https://huggingface.co/datasets/wikitext
I'll update the colab with the Hugging Face dataset. The Hugging Face wikitext-2-v1 dataset seems to be a different format though so I should spend some time to figure this out.