I tried GPT2 on conell 5 shot,batchsize =2 ,and got: {'LOC_precision': 0.00749063670411985, 'LOC_recall': 0.002408187838651415, 'LOC_f1': 0.003644646924829157, 'LOC_number': 1661, 'MISC_precision': 0.2647058823529412, 'MISC_recall': 0.012987012987012988, 'MISC_f1': 0.02475928473177442, 'MISC_number': 693, 'ORG_precision': 0.22037914691943128, 'ORG_recall': 0.05615942028985507, 'ORG_f1': 0.08950914340712222, 'ORG_number': 1656, 'PER_precision': 0.08044554455445545, 'PER_recall': 0.12066831683168316, 'PER_f1': 0.09653465346534652, 'PER_number': 1616, 'overall_precision': 0.08816637375512595, 'overall_recall': 0.05350159971560611, 'overall_f1': 0.0665929203539823, 'overall_accuracy': 0.7978459881529348}

Any suggestions? what may be wrong?

Traceback (most recent call last): File "", line 1, in File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/load.py", line 711, in load_dataset module_path, hash, resolved_file_path = prepare_module( File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/load.py", line 354, in prepare_module raise FileNotFoundError( FileNotFoundError: Couldn't find file locally at lhoestq/demo1/demo1.py, or remotely at https://huggingface.co/datasets/lhoestq/demo1/resolve/main/demo1.py. Please provide a valid dataset name

raw_datasets = load_dataset('json', data_files='/usr/local/notebook_dir/EntLM/dataset/conll/5shot/1.json') Using custom data configuration default-eaef8de8e7268fcc Downloading and preparing dataset json/default (download: Unknown size, generated: Unknown size, post-processed: Unknown size, total: Unknown size) to /root/.cache/huggingface/datasets/json/default-eaef8de8e7268fcc/0.0.0/83d5b3a2f62630efc6b5315f00f20209b4ad91a00ac586597caee3a4da0bef02... Traceback (most recent call last): File "", line 1, in File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/load.py", line 745, in load_dataset builder_instance.download_and_prepare( File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/builder.py", line 574, in download_and_prepare self._download_and_prepare( File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/builder.py", line 630, in _download_and_prepare split_generators = self._split_generators(dl_manager, **split_generators_kwargs) File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/packaged_modules/json/json.py", line 47, in _split_generators data_files = dl_manager.download_and_extract(self.config.data_files) File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/utils/download_manager.py", line 287, in download_and_extract return self.extract(self.download(url_or_urls)) File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/utils/download_manager.py", line 261, in extract extracted_paths = map_nested( File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/utils/py_utils.py", line 195, in map_nested return function(data_struct) File "/root/.jupyter/Pytorch-1.8.1/lib/python3.8/site-packages/datasets/utils/file_utils.py", line 307, in cached_path and not tarfile.is_tarfile(output_path) File "/usr/local/python3/lib/python3.8/tarfile.py", line 2466, in is_tarfile t = open(name) File "/usr/local/python3/lib/python3.8/tarfile.py", line 1599, in open return func(name, "r", fileobj, **kwargs) File "/usr/local/python3/lib/python3.8/tarfile.py", line 1728, in xzopen t = cls.taropen(name, mode, fileobj, **kwargs) File "/usr/local/python3/lib/python3.8/tarfile.py", line 1647, in taropen return cls(name, mode, fileobj, **kwargs) File "/usr/local/python3/lib/python3.8/tarfile.py", line 1510, in init self.firstmember = self.next() File "/usr/local/python3/lib/python3.8/tarfile.py", line 2313, in next tarinfo = self.tarinfo.fromtarfile(self) File "/usr/local/python3/lib/python3.8/tarfile.py", line 1102, in fromtarfile buf = tarfile.fileobj.read(BLOCKSIZE) File "/usr/local/python3/lib/python3.8/lzma.py", line 206, in read return self._buffer.read(size) File "/usr/local/python3/lib/python3.8/_compression.py", line 68, in readinto data = self.read(len(byte_view)) File "/usr/local/python3/lib/python3.8/_compression.py", line 96, in read if self._decompressor.needs_input: AttributeError: '_lzma.LZMADecompressor' object has no attribute 'needs_input'

I find that here still needs two files, "label.json" and "label_map_timesup_ratio0.6_multitoken_top6.json". Could you please tell me how can I get these two specific files for my own dataset? Best wish!