training_pipeline_italian_fine_tune_whisper_2epochs.ipynb

{"cells":[{"cell_type":"markdown","metadata":{"id":"75b58048-7d14-4fc6-8085-1fc08c81b4a6"},"source":["# Fine-Tune Whisper For Multilingual ASR with 🤗 Transformers"],"id":"75b58048-7d14-4fc6-8085-1fc08c81b4a6"},{"cell_type":"markdown","metadata":{"id":"fbfa8ad5-4cdc-4512-9058-836cbbf65e1a"},"source":["In this Colab, we present a step-by-step guide on how to fine-tune Whisper \n","for any multilingual ASR dataset using Hugging Face 🤗 Transformers. This is a \n","more \"hands-on\" version of the accompanying [blog post](https://huggingface.co/blog/fine-tune-whisper). \n","For a more in-depth explanation of Whisper, the Common Voice dataset and the theory behind fine-tuning, the reader is advised to refer to the blog post."],"id":"fbfa8ad5-4cdc-4512-9058-836cbbf65e1a"},{"cell_type":"markdown","metadata":{"id":"afe0d503-ae4e-4aa7-9af4-dbcba52db41e"},"source":["## Introduction"],"id":"afe0d503-ae4e-4aa7-9af4-dbcba52db41e"},{"cell_type":"markdown","metadata":{"id":"9ae91ed4-9c3e-4ade-938e-f4c2dcfbfdc0"},"source":["Whisper is a pre-trained model for automatic speech recognition (ASR) \n","published in [September 2022](https://openai.com/blog/whisper/) by the authors \n","Alec Radford et al. from OpenAI. Unlike many of its predecessors, such as \n","[Wav2Vec 2.0](https://arxiv.org/abs/2006.11477), which are pre-trained \n","on un-labelled audio data, Whisper is pre-trained on a vast quantity of \n","**labelled** audio-transcription data, 680,000 hours to be precise. \n","This is an order of magnitude more data than the un-labelled audio data used \n","to train Wav2Vec 2.0 (60,000 hours). What is more, 117,000 hours of this \n","pre-training data is multilingual ASR data. This results in checkpoints \n","that can be applied to over 96 languages, many of which are considered \n","_low-resource_.\n","\n","When scaled to 680,000 hours of labelled pre-training data, Whisper models \n","demonstrate a strong ability to generalise to many datasets and domains.\n","The pre-trained checkpoints achieve competitive results to state-of-the-art \n","ASR systems, with near 3% word error rate (WER) on the test-clean subset of \n","LibriSpeech ASR and a new state-of-the-art on TED-LIUM with 4.7% WER (_c.f._ \n","Table 8 of the [Whisper paper](https://cdn.openai.com/papers/whisper.pdf)).\n","The extensive multilingual ASR knowledge acquired by Whisper during pre-training \n","can be leveraged for other low-resource languages; through fine-tuning, the \n","pre-trained checkpoints can be adapted for specific datasets and languages \n","to further improve upon these results. We'll show just how Whisper can be fine-tuned \n","for low-resource languages in this Colab."],"id":"9ae91ed4-9c3e-4ade-938e-f4c2dcfbfdc0"},{"cell_type":"markdown","metadata":{"id":"e59b91d6-be24-4b5e-bb38-4977ea143a72"},"source":["<figure>\n","<img src=\"https://raw.githubusercontent.com/sanchit-gandhi/notebooks/main/whisper_architecture.svg\" alt=\"Trulli\" style=\"width:100%\">\n","<figcaption align = \"center\"><b>Figure 1:</b> Whisper model. The architecture \n","follows the standard Transformer-based encoder-decoder model. A \n","log-Mel spectrogram is input to the encoder. The last encoder \n","hidden states are input to the decoder via cross-attention mechanisms. The \n","decoder autoregressively predicts text tokens, jointly conditional on the \n","encoder hidden states and previously predicted tokens. Figure source: \n","<a href=\"https://openai.com/blog/whisper/\">OpenAI Whisper Blog</a>.</figcaption>\n","</figure>"],"id":"e59b91d6-be24-4b5e-bb38-4977ea143a72"},{"cell_type":"markdown","metadata":{"id":"21b6316e-8a55-4549-a154-66d3da2ab74a"},"source":["The Whisper checkpoints come in five configurations of varying model sizes.\n","The smallest four are trained on either English-only or multilingual data.\n","The largest checkpoint is multilingual only. All nine of the pre-trained checkpoints \n","are available on the [Hugging Face Hub](https://huggingface.co/models?search=openai/whisper). The \n","checkpoints are summarised in the following table with links to the models on the Hub:\n","\n","| Size   | Layers | Width | Heads | Parameters | English-only                                         | Multilingual                                      |\n","|--------|--------|-------|-------|------------|------------------------------------------------------|---------------------------------------------------|\n","| tiny   | 4      | 384   | 6     | 39 M       | [✓](https://huggingface.co/openai/whisper-tiny.en)   | [✓](https://huggingface.co/openai/whisper-tiny.)  |\n","| base   | 6      | 512   | 8     | 74 M       | [✓](https://huggingface.co/openai/whisper-base.en)   | [✓](https://huggingface.co/openai/whisper-base)   |\n","| small  | 12     | 768   | 12    | 244 M      | [✓](https://huggingface.co/openai/whisper-small.en)  | [✓](https://huggingface.co/openai/whisper-small)  |\n","| medium | 24     | 1024  | 16    | 769 M      | [✓](https://huggingface.co/openai/whisper-medium.en) | [✓](https://huggingface.co/openai/whisper-medium) |\n","| large  | 32     | 1280  | 20    | 1550 M     | x                                                    | [✓](https://huggingface.co/openai/whisper-large)  |\n","\n","For demonstration purposes, we'll fine-tune the multilingual version of the \n","[`\"small\"`](https://huggingface.co/openai/whisper-small) checkpoint with 244M params (~= 1GB). \n","As for our data, we'll train and evaluate our system on a low-resource language \n","taken from the [Common Voice](https://huggingface.co/datasets/mozilla-foundation/common_voice_11_0)\n","dataset. We'll show that with as little as 8 hours of fine-tuning data, we can achieve \n","strong performance in this language."],"id":"21b6316e-8a55-4549-a154-66d3da2ab74a"},{"cell_type":"markdown","metadata":{"id":"3a680dfc-cbba-4f6c-8a1f-e1a5ff3f123a"},"source":["------------------------------------------------------------------------\n","\n","\\\\({}^1\\\\) The name Whisper follows from the acronym “WSPSR”, which stands for “Web-scale Supervised Pre-training for Speech Recognition”."],"id":"3a680dfc-cbba-4f6c-8a1f-e1a5ff3f123a"},{"cell_type":"markdown","metadata":{"id":"55fb8d21-df06-472a-99dd-b59567be6dad"},"source":["## Prepare Environment"],"id":"55fb8d21-df06-472a-99dd-b59567be6dad"},{"cell_type":"markdown","metadata":{"id":"844a4861-929c-4762-b29b-80b1e95aba4b"},"source":["First of all, let's try to secure a decent GPU for our Colab! Unfortunately, it's becoming much harder to get access to a good GPU with the free version of Google Colab. However, with Google Colab Pro one should have no issues in being allocated a V100 or P100 GPU.\n","\n","To get a GPU, click _Runtime_ -> _Change runtime type_, then change _Hardware accelerator_ from _None_ to _GPU_."],"id":"844a4861-929c-4762-b29b-80b1e95aba4b"},{"cell_type":"markdown","metadata":{"id":"9abea5d7-9d54-434b-a6bd-399d1b3c6c1a"},"source":["We can verify that we've been assigned a GPU and view its specifications:"],"id":"9abea5d7-9d54-434b-a6bd-399d1b3c6c1a"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":408,"status":"ok","timestamp":1670483089753,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"95048026-a3b7-43f0-a274-1bad65e407b4","outputId":"13971f38-625a-4ac7-be82-a6c19dc8cde0"},"outputs":[{"name":"stdout","output_type":"stream","text":["Thu Dec  8 07:04:49 2022       \n","+-----------------------------------------------------------------------------+\n","| NVIDIA-SMI 460.32.03    Driver Version: 460.32.03    CUDA Version: 11.2     |\n","|-------------------------------+----------------------+----------------------+\n","| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |\n","| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |\n","|                               |                      |               MIG M. |\n","|===============================+======================+======================|\n","|   0  Tesla T4            Off  | 00000000:00:04.0 Off |                    0 |\n","| N/A   61C    P0    27W /  70W |      0MiB / 15109MiB |      0%      Default |\n","|                               |                      |                  N/A |\n","+-------------------------------+----------------------+----------------------+\n","                                                                               \n","+-----------------------------------------------------------------------------+\n","| Processes:                                                                  |\n","|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |\n","|        ID   ID                                                   Usage      |\n","|=============================================================================|\n","|  No running processes found                                                 |\n","+-----------------------------------------------------------------------------+\n"]}],"source":["gpu_info = !nvidia-smi\n","gpu_info = '\\n'.join(gpu_info)\n","if gpu_info.find('failed') >= 0:\n","  print('Not connected to a GPU')\n","else:\n","  print(gpu_info)"],"id":"95048026-a3b7-43f0-a274-1bad65e407b4"},{"cell_type":"markdown","metadata":{"id":"9cd52dc1-ade1-44bb-a2d7-2ed98f110fed"},"source":["Next, we need to update the Unix package `ffmpeg` to version 4:"],"id":"9cd52dc1-ade1-44bb-a2d7-2ed98f110fed"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":43632,"status":"ok","timestamp":1670483136804,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"69ee227d-60c5-44bf-b04d-c2092f997454","outputId":"20c4d473-5a8e-432c-e7c6-f028ea62c1b7"},"outputs":[{"name":"stdout","output_type":"stream","text":["Get:1 https://cloud.r-project.org/bin/linux/ubuntu bionic-cran40/ InRelease [3,626 B]\n","Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]\n","Hit:3 http://ppa.launchpad.net/c2d4u.team/c2d4u4.0+/ubuntu bionic InRelease\n","Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease\n","Ign:5 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  InRelease\n","Hit:6 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  InRelease\n","Hit:7 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  Release\n","Get:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]\n","Hit:9 http://ppa.launchpad.net/cran/libgit2/ubuntu bionic InRelease\n","Get:11 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease [15.9 kB]\n","Get:12 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [3,095 kB]\n","Get:13 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [83.3 kB]\n","Hit:14 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic InRelease\n","Get:15 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic InRelease [15.9 kB]\n","Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2,342 kB]\n","Get:17 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic/main amd64 Packages [43.9 kB]\n","Get:18 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,567 kB]\n","Get:19 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 Packages [12.5 kB]\n","Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [3,519 kB]\n","Fetched 10.9 MB in 5s (2,282 kB/s)\n","Reading package lists... Done\n","Hit:1 https://cloud.r-project.org/bin/linux/ubuntu bionic-cran40/ InRelease\n","Hit:2 http://ppa.launchpad.net/c2d4u.team/c2d4u4.0+/ubuntu bionic InRelease\n","Ign:3 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  InRelease\n","Hit:4 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  InRelease\n","Hit:5 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  Release\n","Hit:6 http://archive.ubuntu.com/ubuntu bionic InRelease\n","Hit:7 http://security.ubuntu.com/ubuntu bionic-security InRelease\n","Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease\n","Hit:9 http://ppa.launchpad.net/cran/libgit2/ubuntu bionic InRelease\n","Hit:11 http://archive.ubuntu.com/ubuntu bionic-backports InRelease\n","Hit:12 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease\n","Hit:13 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic InRelease\n","Hit:14 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic InRelease\n","Reading package lists... Done\n","Building dependency tree       \n","Reading state information... Done\n","37 packages can be upgraded. Run 'apt list --upgradable' to see them.\n","Reading package lists... Done\n","Building dependency tree       \n","Reading state information... Done\n","The following package was automatically installed and is no longer required:\n","  libnvidia-common-460\n","Use 'apt autoremove' to remove it.\n","The following additional packages will be installed:\n","  libaom0 libavcodec58 libavdevice58 libavfilter7 libavformat58 libavresample4\n","  libavutil56 libcodec2-0.7 liblilv-0-0 libmysofa1 libpocketsphinx3\n","  libpostproc55 librabbitmq4 libserd-0-0 libsord-0-0 libsphinxbase3\n","  libsratom-0-0 libsrt1-gnutls libswresample3 libswscale5 libvidstab1.1\n","  libx264-155 libx265-192 libzimg2\n","Suggested packages:\n","  ffmpeg-doc serdi sordi\n","Recommended packages:\n","  pocketsphinx-hmm-en-hub4wsj | pocketsphinx-hmm-zh-tdt\n","  | pocketsphinx-hmm-en-tidigits pocketsphinx-lm-en-hub4\n","  | pocketsphinx-lm-zh-hans-gigatdt | pocketsphinx-lm-zh-hant-gigatdt\n","The following NEW packages will be installed:\n","  libaom0 libavcodec58 libavdevice58 libavfilter7 libavformat58 libavresample4\n","  libavutil56 libcodec2-0.7 liblilv-0-0 libmysofa1 libpocketsphinx3\n","  libpostproc55 librabbitmq4 libserd-0-0 libsord-0-0 libsphinxbase3\n","  libsratom-0-0 libsrt1-gnutls libswresample3 libswscale5 libvidstab1.1\n","  libx264-155 libx265-192 libzimg2\n","The following packages will be upgraded:\n","  ffmpeg\n","1 upgraded, 24 newly installed, 0 to remove and 36 not upgraded.\n","Need to get 13.4 MB of archives.\n","After this operation, 49.3 MB of additional disk space will be used.\n","Get:1 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libaom0 amd64 1.0.0.errata1-3~18.04.york0 [1,165 kB]\n","Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libcodec2-0.7 amd64 0.7-1 [202 kB]\n","Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB]\n","Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libserd-0-0 amd64 0.28.0~dfsg0-1 [37.0 kB]\n","Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libsord-0-0 amd64 0.16.0~dfsg0-1 [20.2 kB]\n","Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libsratom-0-0 amd64 0.6.0~dfsg0-1 [15.8 kB]\n","Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblilv-0-0 amd64 0.24.2~dfsg0-1 [38.0 kB]\n","Get:8 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libsphinxbase3 amd64 0.8+5prealpha+1-1 [118 kB]\n","Get:9 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libavutil56 amd64 7:4.3.2-0york0~18.04 [295 kB]\n","Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libpocketsphinx3 amd64 0.8.0+real5prealpha-1ubuntu2 [122 kB]\n","Get:11 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libswresample3 amd64 7:4.3.2-0york0~18.04 [70.0 kB]\n","Get:12 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libx264-155 amd64 2:0.155.2917+git0a84d98-2~18.04.york0 [529 kB]\n","Get:13 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libx265-192 amd64 3.4-0york0~18.04 [1,086 kB]\n","Get:14 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libavcodec58 amd64 7:4.3.2-0york0~18.04 [4,952 kB]\n","Get:15 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libsrt1-gnutls amd64 1.4.1-5~18.04.york0 [235 kB]\n","Get:16 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libavformat58 amd64 7:4.3.2-0york0~18.04 [1,043 kB]\n","Get:17 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libmysofa1 amd64 1.0~dfsg0-2~18.04.york0 [39.3 kB]\n","Get:18 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libpostproc55 amd64 7:4.3.2-0york0~18.04 [65.0 kB]\n","Get:19 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libswscale5 amd64 7:4.3.2-0york0~18.04 [171 kB]\n","Get:20 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libvidstab1.1 amd64 1.1.0-2~18.04.york1 [36.6 kB]\n","Get:21 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libzimg2 amd64 3.0.1-0york0~18.04 [183 kB]\n","Get:22 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libavfilter7 amd64 7:4.3.2-0york0~18.04 [1,254 kB]\n","Get:23 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libavdevice58 amd64 7:4.3.2-0york0~18.04 [90.0 kB]\n","Get:24 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 libavresample4 amd64 7:4.3.2-0york0~18.04 [67.3 kB]\n","Get:25 http://ppa.launchpad.net/jonathonf/ffmpeg-4/ubuntu bionic/main amd64 ffmpeg amd64 7:4.3.2-0york0~18.04 [1,556 kB]\n","Fetched 13.4 MB in 18s (751 kB/s)\n","Selecting previously unselected package libaom0:amd64.\n","(Reading database ... 124013 files and directories currently installed.)\n","Preparing to unpack .../00-libaom0_1.0.0.errata1-3~18.04.york0_amd64.deb ...\n","Unpacking libaom0:amd64 (1.0.0.errata1-3~18.04.york0) ...\n","Selecting previously unselected package libavutil56:amd64.\n","Preparing to unpack .../01-libavutil56_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking libavutil56:amd64 (7:4.3.2-0york0~18.04) ...\n","Selecting previously unselected package libcodec2-0.7:amd64.\n","Preparing to unpack .../02-libcodec2-0.7_0.7-1_amd64.deb ...\n","Unpacking libcodec2-0.7:amd64 (0.7-1) ...\n","Selecting previously unselected package libswresample3:amd64.\n","Preparing to unpack .../03-libswresample3_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking libswresample3:amd64 (7:4.3.2-0york0~18.04) ...\n","Selecting previously unselected package libx264-155:amd64.\n","Preparing to unpack .../04-libx264-155_2%3a0.155.2917+git0a84d98-2~18.04.york0_amd64.deb ...\n","Unpacking libx264-155:amd64 (2:0.155.2917+git0a84d98-2~18.04.york0) ...\n","Selecting previously unselected package libx265-192:amd64.\n","Preparing to unpack .../05-libx265-192_3.4-0york0~18.04_amd64.deb ...\n","Unpacking libx265-192:amd64 (3.4-0york0~18.04) ...\n","Selecting previously unselected package libavcodec58:amd64.\n","Preparing to unpack .../06-libavcodec58_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking libavcodec58:amd64 (7:4.3.2-0york0~18.04) ...\n","Selecting previously unselected package librabbitmq4:amd64.\n","Preparing to unpack .../07-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ...\n","Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ...\n","Selecting previously unselected package libsrt1-gnutls:amd64.\n","Preparing to unpack .../08-libsrt1-gnutls_1.4.1-5~18.04.york0_amd64.deb ...\n","Unpacking libsrt1-gnutls:amd64 (1.4.1-5~18.04.york0) ...\n","Selecting previously unselected package libavformat58:amd64.\n","Preparing to unpack .../09-libavformat58_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking libavformat58:amd64 (7:4.3.2-0york0~18.04) ...\n","Selecting previously unselected package libserd-0-0:amd64.\n","Preparing to unpack .../10-libserd-0-0_0.28.0~dfsg0-1_amd64.deb ...\n","Unpacking libserd-0-0:amd64 (0.28.0~dfsg0-1) ...\n","Selecting previously unselected package libsord-0-0:amd64.\n","Preparing to unpack .../11-libsord-0-0_0.16.0~dfsg0-1_amd64.deb ...\n","Unpacking libsord-0-0:amd64 (0.16.0~dfsg0-1) ...\n","Selecting previously unselected package libsratom-0-0:amd64.\n","Preparing to unpack .../12-libsratom-0-0_0.6.0~dfsg0-1_amd64.deb ...\n","Unpacking libsratom-0-0:amd64 (0.6.0~dfsg0-1) ...\n","Selecting previously unselected package liblilv-0-0.\n","Preparing to unpack .../13-liblilv-0-0_0.24.2~dfsg0-1_amd64.deb ...\n","Unpacking liblilv-0-0 (0.24.2~dfsg0-1) ...\n","Selecting previously unselected package libmysofa1:amd64.\n","Preparing to unpack .../14-libmysofa1_1.0~dfsg0-2~18.04.york0_amd64.deb ...\n","Unpacking libmysofa1:amd64 (1.0~dfsg0-2~18.04.york0) ...\n","Selecting previously unselected package libsphinxbase3:amd64.\n","Preparing to unpack .../15-libsphinxbase3_0.8+5prealpha+1-1_amd64.deb ...\n","Unpacking libsphinxbase3:amd64 (0.8+5prealpha+1-1) ...\n","Selecting previously unselected package libpocketsphinx3:amd64.\n","Preparing to unpack .../16-libpocketsphinx3_0.8.0+real5prealpha-1ubuntu2_amd64.deb ...\n","Unpacking libpocketsphinx3:amd64 (0.8.0+real5prealpha-1ubuntu2) ...\n","Selecting previously unselected package libpostproc55:amd64.\n","Preparing to unpack .../17-libpostproc55_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking libpostproc55:amd64 (7:4.3.2-0york0~18.04) ...\n","Selecting previously unselected package libswscale5:amd64.\n","Preparing to unpack .../18-libswscale5_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking libswscale5:amd64 (7:4.3.2-0york0~18.04) ...\n","Selecting previously unselected package libvidstab1.1:amd64.\n","Preparing to unpack .../19-libvidstab1.1_1.1.0-2~18.04.york1_amd64.deb ...\n","Unpacking libvidstab1.1:amd64 (1.1.0-2~18.04.york1) ...\n","Selecting previously unselected package libzimg2.\n","Preparing to unpack .../20-libzimg2_3.0.1-0york0~18.04_amd64.deb ...\n","Unpacking libzimg2 (3.0.1-0york0~18.04) ...\n","Selecting previously unselected package libavfilter7:amd64.\n","Preparing to unpack .../21-libavfilter7_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking libavfilter7:amd64 (7:4.3.2-0york0~18.04) ...\n","Selecting previously unselected package libavdevice58:amd64.\n","Preparing to unpack .../22-libavdevice58_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking libavdevice58:amd64 (7:4.3.2-0york0~18.04) ...\n","Selecting previously unselected package libavresample4:amd64.\n","Preparing to unpack .../23-libavresample4_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking libavresample4:amd64 (7:4.3.2-0york0~18.04) ...\n","Preparing to unpack .../24-ffmpeg_7%3a4.3.2-0york0~18.04_amd64.deb ...\n","Unpacking ffmpeg (7:4.3.2-0york0~18.04) over (7:3.4.11-0ubuntu0.1) ...\n","Setting up libx264-155:amd64 (2:0.155.2917+git0a84d98-2~18.04.york0) ...\n","Setting up libsphinxbase3:amd64 (0.8+5prealpha+1-1) ...\n","Setting up libavutil56:amd64 (7:4.3.2-0york0~18.04) ...\n","Setting up libzimg2 (3.0.1-0york0~18.04) ...\n","Setting up libpocketsphinx3:amd64 (0.8.0+real5prealpha-1ubuntu2) ...\n","Setting up libpostproc55:amd64 (7:4.3.2-0york0~18.04) ...\n","Setting up libavresample4:amd64 (7:4.3.2-0york0~18.04) ...\n","Setting up libsrt1-gnutls:amd64 (1.4.1-5~18.04.york0) ...\n","Setting up libmysofa1:amd64 (1.0~dfsg0-2~18.04.york0) ...\n","Setting up libvidstab1.1:amd64 (1.1.0-2~18.04.york1) ...\n","Setting up libcodec2-0.7:amd64 (0.7-1) ...\n","Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ...\n","Setting up libaom0:amd64 (1.0.0.errata1-3~18.04.york0) ...\n","Setting up libserd-0-0:amd64 (0.28.0~dfsg0-1) ...\n","Setting up libx265-192:amd64 (3.4-0york0~18.04) ...\n","Setting up libswscale5:amd64 (7:4.3.2-0york0~18.04) ...\n","Setting up libswresample3:amd64 (7:4.3.2-0york0~18.04) ...\n","Setting up libsord-0-0:amd64 (0.16.0~dfsg0-1) ...\n","Setting up libsratom-0-0:amd64 (0.6.0~dfsg0-1) ...\n","Setting up libavcodec58:amd64 (7:4.3.2-0york0~18.04) ...\n","Setting up liblilv-0-0 (0.24.2~dfsg0-1) ...\n","Setting up libavformat58:amd64 (7:4.3.2-0york0~18.04) ...\n","Setting up libavfilter7:amd64 (7:4.3.2-0york0~18.04) ...\n","Setting up libavdevice58:amd64 (7:4.3.2-0york0~18.04) ...\n","Setting up ffmpeg (7:4.3.2-0york0~18.04) ...\n","Removing obsolete conffile /etc/ffserver.conf ...\n","Processing triggers for libc-bin (2.27-3ubuntu1.6) ...\n","Processing triggers for man-db (2.8.3-2ubuntu0.1) ...\n"]}],"source":["!add-apt-repository -y ppa:jonathonf/ffmpeg-4\n","!apt update\n","!apt install -y ffmpeg"],"id":"69ee227d-60c5-44bf-b04d-c2092f997454"},{"cell_type":"markdown","metadata":{"id":"1d85d613-1c7e-46ac-9134-660bbe7ebc9d"},"source":["We'll employ several popular Python packages to fine-tune the Whisper model.\n","We'll use `datasets` to download and prepare our training data and \n","`transformers` to load and train our Whisper model. We'll also require\n","the `soundfile` package to pre-process audio files, `evaluate` and `jiwer` to\n","assess the performance of our model. Finally, we'll\n","use `gradio` to build a flashy demo of our fine-tuned model."],"id":"1d85d613-1c7e-46ac-9134-660bbe7ebc9d"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":67670,"status":"ok","timestamp":1670483204460,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"e68ea9f8-9b61-414e-8885-3033b67c2850","outputId":"9a40febd-415a-422f-b745-dc92a8bf4d26"},"outputs":[{"name":"stdout","output_type":"stream","text":["Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n","Collecting git+https://github.com/huggingface/transformers\n","  Cloning https://github.com/huggingface/transformers to /tmp/pip-req-build-ct2p0cjy\n","  Running command git clone -q https://github.com/huggingface/transformers /tmp/pip-req-build-ct2p0cjy\n","  Installing build dependencies ... \u001b[?25l\u001b[?25hdone\n","  Getting requirements to build wheel ... \u001b[?25l\u001b[?25hdone\n","    Preparing wheel metadata ... \u001b[?25l\u001b[?25hdone\n","Collecting tokenizers!=0.11.3,<0.14,>=0.11.1\n","  Downloading tokenizers-0.13.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.6 MB)\n","\u001b[K     |████████████████████████████████| 7.6 MB 27.6 MB/s \n","\u001b[?25hRequirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.8/dist-packages (from transformers==4.26.0.dev0) (21.3)\n","Requirement already satisfied: filelock in /usr/local/lib/python3.8/dist-packages (from transformers==4.26.0.dev0) (3.8.0)\n","Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.8/dist-packages (from transformers==4.26.0.dev0) (2022.6.2)\n","Requirement already satisfied: huggingface-hub<1.0,>=0.10.0 in /usr/local/lib/python3.8/dist-packages (from transformers==4.26.0.dev0) (0.11.1)\n","Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.8/dist-packages (from transformers==4.26.0.dev0) (4.64.1)\n","Requirement already satisfied: requests in /usr/local/lib/python3.8/dist-packages (from transformers==4.26.0.dev0) (2.23.0)\n","Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.8/dist-packages (from transformers==4.26.0.dev0) (1.21.6)\n","Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.8/dist-packages (from transformers==4.26.0.dev0) (6.0)\n","Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.8/dist-packages (from huggingface-hub<1.0,>=0.10.0->transformers==4.26.0.dev0) (4.4.0)\n","Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging>=20.0->transformers==4.26.0.dev0) (3.0.9)\n","Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.8/dist-packages (from requests->transformers==4.26.0.dev0) (2.10)\n","Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.8/dist-packages (from requests->transformers==4.26.0.dev0) (3.0.4)\n","Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.8/dist-packages (from requests->transformers==4.26.0.dev0) (1.25.11)\n","Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.8/dist-packages (from requests->transformers==4.26.0.dev0) (2022.9.24)\n","Building wheels for collected packages: transformers\n","  Building wheel for transformers (PEP 517) ... \u001b[?25l\u001b[?25hdone\n","  Created wheel for transformers: filename=transformers-4.26.0.dev0-py3-none-any.whl size=5938672 sha256=e1a82d9f1d4fb89f3abd93915f978120029521dd8d43d00991700869d6a01cdc\n","  Stored in directory: /tmp/pip-ephem-wheel-cache-isv7r72e/wheels/42/68/45/c63edff61c292f2dfd4df4ef6522dcbecc603e7af82813c1d7\n","Successfully built transformers\n","Installing collected packages: tokenizers, transformers\n","Successfully installed tokenizers-0.13.2 transformers-4.26.0.dev0\n","Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n","Requirement already satisfied: librosa in /usr/local/lib/python3.8/dist-packages (0.8.1)\n","Requirement already satisfied: scikit-learn!=0.19.0,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from librosa) (1.0.2)\n","Requirement already satisfied: joblib>=0.14 in /usr/local/lib/python3.8/dist-packages (from librosa) (1.2.0)\n","Requirement already satisfied: numpy>=1.15.0 in /usr/local/lib/python3.8/dist-packages (from librosa) (1.21.6)\n","Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.8/dist-packages (from librosa) (21.3)\n","Requirement already satisfied: decorator>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from librosa) (4.4.2)\n","Requirement already satisfied: numba>=0.43.0 in /usr/local/lib/python3.8/dist-packages (from librosa) (0.56.4)\n","Requirement already satisfied: scipy>=1.0.0 in /usr/local/lib/python3.8/dist-packages (from librosa) (1.7.3)\n","Requirement already satisfied: audioread>=2.0.0 in /usr/local/lib/python3.8/dist-packages (from librosa) (3.0.0)\n","Requirement already satisfied: soundfile>=0.10.2 in /usr/local/lib/python3.8/dist-packages (from librosa) (0.11.0)\n","Requirement already satisfied: pooch>=1.0 in /usr/local/lib/python3.8/dist-packages (from librosa) (1.6.0)\n","Requirement already satisfied: resampy>=0.2.2 in /usr/local/lib/python3.8/dist-packages (from librosa) (0.4.2)\n","Requirement already satisfied: setuptools in /usr/local/lib/python3.8/dist-packages (from numba>=0.43.0->librosa) (57.4.0)\n","Requirement already satisfied: llvmlite<0.40,>=0.39.0dev0 in /usr/local/lib/python3.8/dist-packages (from numba>=0.43.0->librosa) (0.39.1)\n","Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.8/dist-packages (from numba>=0.43.0->librosa) (4.13.0)\n","Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging>=20.0->librosa) (3.0.9)\n","Requirement already satisfied: appdirs>=1.3.0 in /usr/local/lib/python3.8/dist-packages (from pooch>=1.0->librosa) (1.4.4)\n","Requirement already satisfied: requests>=2.19.0 in /usr/local/lib/python3.8/dist-packages (from pooch>=1.0->librosa) (2.23.0)\n","Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pooch>=1.0->librosa) (2.10)\n","Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pooch>=1.0->librosa) (1.25.11)\n","Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pooch>=1.0->librosa) (2022.9.24)\n","Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pooch>=1.0->librosa) (3.0.4)\n","Requirement already satisfied: threadpoolctl>=2.0.0 in /usr/local/lib/python3.8/dist-packages (from scikit-learn!=0.19.0,>=0.14.0->librosa) (3.1.0)\n","Requirement already satisfied: cffi>=1.0 in /usr/local/lib/python3.8/dist-packages (from soundfile>=0.10.2->librosa) (1.15.1)\n","Requirement already satisfied: pycparser in /usr/local/lib/python3.8/dist-packages (from cffi>=1.0->soundfile>=0.10.2->librosa) (2.21)\n","Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.8/dist-packages (from importlib-metadata->numba>=0.43.0->librosa) (3.11.0)\n","Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n","Collecting jiwer\n","  Downloading jiwer-2.5.1-py3-none-any.whl (15 kB)\n","Collecting levenshtein==0.20.2\n","  Downloading Levenshtein-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.4 MB)\n","\u001b[K     |████████████████████████████████| 1.4 MB 38.9 MB/s \n","\u001b[?25hCollecting rapidfuzz<3.0.0,>=2.3.0\n","  Downloading rapidfuzz-2.13.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB)\n","\u001b[K     |████████████████████████████████| 2.2 MB 43.2 MB/s \n","\u001b[?25hInstalling collected packages: rapidfuzz, levenshtein, jiwer\n","Successfully installed jiwer-2.5.1 levenshtein-0.20.2 rapidfuzz-2.13.3\n"]}],"source":["!pip install datasets>=2.6.1\n","!pip install git+https://github.com/huggingface/transformers\n","!pip install librosa\n","!pip install evaluate>=0.30\n","!pip install jiwer"],"id":"e68ea9f8-9b61-414e-8885-3033b67c2850"},{"cell_type":"markdown","metadata":{"id":"1f60d173-8de1-4ed7-bc9a-d281cf237203"},"source":["We strongly advise you to upload model checkpoints directly the [Hugging Face Hub](https://huggingface.co/) \n","whilst training. The Hub provides:\n","- Integrated version control: you can be sure that no model checkpoint is lost during training.\n","- Tensorboard logs: track important metrics over the course of training.\n","- Model cards: document what a model does and its intended use cases.\n","- Community: an easy way to share and collaborate with the community!\n","\n","Linking the notebook to the Hub is straightforward - it simply requires entering your \n","Hub authentication token when prompted. Find your Hub authentication token [here](https://huggingface.co/settings/tokens):"],"id":"1f60d173-8de1-4ed7-bc9a-d281cf237203"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":359},"executionInfo":{"elapsed":9,"status":"ok","timestamp":1670483204461,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"b045a39e-2a3e-4153-bdb5-281500bcd348","outputId":"26b6aabf-981c-4e04-a397-9a8f8e931529"},"outputs":[{"name":"stdout","output_type":"stream","text":["Token is valid.\n","Your token has been saved in your configured git credential helpers (store).\n","Your token has been saved to /root/.huggingface/token\n","Login successful\n"]}],"source":["from huggingface_hub import notebook_login\n","\n","notebook_login()"],"id":"b045a39e-2a3e-4153-bdb5-281500bcd348"},{"cell_type":"markdown","metadata":{"id":"560332eb-3558-41a1-b500-e83a9f695f84"},"source":["### Load WhisperFeatureExtractor"],"id":"560332eb-3558-41a1-b500-e83a9f695f84"},{"cell_type":"markdown","metadata":{"id":"32ec8068-0bd7-412d-b662-0edb9d1e7365"},"source":["The Whisper feature extractor performs two operations:\n","1. Pads / truncates the audio inputs to 30s: any audio inputs shorter than 30s are padded to 30s with silence (zeros), and those longer that 30s are truncated to 30s\n","2. Converts the audio inputs to _log-Mel spectrogram_ input features, a visual representation of the audio and the form of the input expected by the Whisper model"],"id":"32ec8068-0bd7-412d-b662-0edb9d1e7365"},{"cell_type":"markdown","metadata":{"id":"589d9ec1-d12b-4b64-93f7-04c63997da19"},"source":["<figure>\n","<img src=\"https://raw.githubusercontent.com/sanchit-gandhi/notebooks/main/spectrogram.jpg\" alt=\"Trulli\" style=\"width:100%\">\n","<figcaption align = \"center\"><b>Figure 2:</b> Conversion of sampled audio array to log-Mel spectrogram.\n","Left: sampled 1-dimensional audio signal. Right: corresponding log-Mel spectrogram. Figure source:\n","<a href=\"https://ai.googleblog.com/2019/04/specaugment-new-data-augmentation.html\">Google SpecAugment Blog</a>.\n","</figcaption>"],"id":"589d9ec1-d12b-4b64-93f7-04c63997da19"},{"cell_type":"markdown","metadata":{"id":"b2ef54d5-b946-4c1d-9fdc-adc5d01b46aa"},"source":["We'll load the feature extractor from the pre-trained checkpoint with the default values:"],"id":"b2ef54d5-b946-4c1d-9fdc-adc5d01b46aa"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/","referenced_widgets":["c8ae189458064ef6bcbc66f8b50c3fa0","d6f4b10125e447ab81c5e4b537e92da6","6f01165e885a436e88735af84f3a9937","155e018a929c417ba76461e99ce36d76","37a25154c3144eb3ba3fa7d4eac1f6c7","a825b0b5778044b28973a6e214d3c33e","2a2a87a4c78b4851992bee0c9d664459","c7d18883e0574a359965714206f72c3e","46706a4f12234781ab8b0578de842602","ac6a42c2fb0a4cf6adc2eed4e62d2f48","afdc831e6dd6444f9093d5fbfe4f878d"]},"executionInfo":{"elapsed":6398,"status":"ok","timestamp":1670483218234,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"bc77d7bb-f9e2-47f5-b663-30f7a4321ce5","outputId":"afc62925-a288-4417-abe2-65eb475e77e6"},"outputs":[{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"c8ae189458064ef6bcbc66f8b50c3fa0","version_major":2,"version_minor":0},"text/plain":["Downloading:   0%|          | 0.00/185k [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"}],"source":["from transformers import WhisperFeatureExtractor\n","\n","feature_extractor = WhisperFeatureExtractor.from_pretrained(\"openai/whisper-small\")"],"id":"bc77d7bb-f9e2-47f5-b663-30f7a4321ce5"},{"cell_type":"markdown","metadata":{"id":"93748af7-b917-4ecf-a0c8-7d89077ff9cb"},"source":["### Load WhisperTokenizer"],"id":"93748af7-b917-4ecf-a0c8-7d89077ff9cb"},{"cell_type":"markdown","metadata":{"id":"2bc82609-a9fb-447a-a2af-99597c864029"},"source":["The Whisper model outputs a sequence of _token ids_. The tokenizer maps each of these token ids to their corresponding text string. For Hindi, we can load the pre-trained tokenizer and use it for fine-tuning without any further modifications. We simply have to \n","specify the target language and the task. These arguments inform the \n","tokenizer to prefix the language and task tokens to the start of encoded \n","label sequences:"],"id":"2bc82609-a9fb-447a-a2af-99597c864029"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/","referenced_widgets":["5e1ef85190b344eb893e739782b5161a","83b037975d3d47d8bfef2ac26e43c62d","0713f929148d4e36915825e4ecc63d9a","2446b535103f496b918b71430493922d","cedb734eb66a41fe89566c537c8fe8af","1f152ad895c944e3956bb0de19e994de","c5d555dab9c5477d8568cb0cc296c3a3","a5d95c5957dc456898aee68b169545b8","c79df9040e1f4ec6bfadfa4f31c71901","cd9992aa7a844e5a9b008a6dd0e88ea9","3fe51e9d5ff4405b8d30a9a51f6e9bb0","6dc8a5f7ee3c40ee9a706567df0fd49b","670dee1015044da0ba816fcf98a46b88","c3bc8c29e168410ebd118230610df290","cde404d1c30f4e0187d570e83562e97a","efdd0260986346ee8478e0bc717109b1","7db0487572a24eab86f451c80566a71b","063ef8e4621b4d35b23897c55ee1577d","5f72b58a6d0748c39e85951d152a13d2","c62fd52f13f247aca9558caac063d52f","ea14d1775c0d47dc87855a2d9aa4927c","97d5fa052b264958845d4abdd6bb170c","b308ea76ea5e4fc8bf23c915e0bcd3c8","beb5d681b9084eaf964c4b8bb880c138","0f123428ba844a3fa632fcff5ce21bdc","02c3874e6bc3460283a76811e0752959","e78c99367e36487ba36cf5d2e0dee246","88ccd521de7e47748bfb4dd19155105f","dd515248ef0f4a7692d22b5342a6c01a","0fe13f12176d422c9ffbbda948f556ff","e4bd42a517c842228db369d452078236","83b3d040e5c243ccbd96ad31fd823b5d","21f8c09534674ba7ab2909d3f19fc8b8","cd790e60a5e9466db209abe06d745623","3f0432f225204d96b6041bb327ca1d54","4eb60c8e03bd4d0598cfa16ca4478679","92744e4ecc7545948d25e2267ce543ae","357635536f0b4a399110198698f0ede3","64c6659ef231455380f880b618e409d7","c583dc3062f1489cbaae9331ce2177a3","a753d8675ad34c97abe76cfaa1cd060f","e7cb60f0fe544408861c4f967a38d250","64c7f45f0c3342b491b7be7aea4cb9f9","e632fba106be44ce9d0f348b9c2a6642","4a4bc16ccd8f427e9ecb2963b5f50dd6","365103571a0947dc95cff90c8ac5dfa9","60efdd5034af4a1d8a6fc455b0082391","951ff7b9b354460d94d4027ecafae8cb","bdea2290d0854741b69fcce3ab0ff68b","fa1f9546c1314aefbde34c2d85034166","382a10a4cf484f11af6fbd90a8a094d9","feca744e4ec147f29ec62bfeeafcaa7c","c1f788534bda49238a93f90416a481a4","92e3c43102ff4910877b1fffa39897e1","3d6e2ee8184c434cbdc65b884d6b5fb5","1b84f540e77645b394ad11e80a982e69","f0ab68a9bab8483191f4379d6edc2f1a","ac0fdf9cd93342c8b29815b9a698a207","bf1ba3028c4e4d81a1df5619ebe28427","1abcff86d9224149a0c2005f721f9289","2248de092340492090f3effc93942afe","42ae1aa22c0547cdbb5f6ab63b46652d","1d77aa7c8e774c03b94f9d041a9f726b","b7e5d192936f4deaa4ac899fd0500e8d","b688d6c5bc014555b571e245b42790cd","c85fdf789e2e4766a8cdf25feabb9f47"]},"executionInfo":{"elapsed":15842,"status":"ok","timestamp":1670483234073,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"c7b07f9b-ae0e-4f89-98f0-0c50d432eab6","outputId":"3f65ea12-ad42-4f42-ba19-18fb097dd4bd"},"outputs":[{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"5e1ef85190b344eb893e739782b5161a","version_major":2,"version_minor":0},"text/plain":["Downloading:   0%|          | 0.00/829 [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"},{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"6dc8a5f7ee3c40ee9a706567df0fd49b","version_major":2,"version_minor":0},"text/plain":["Downloading:   0%|          | 0.00/1.04M [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"},{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"b308ea76ea5e4fc8bf23c915e0bcd3c8","version_major":2,"version_minor":0},"text/plain":["Downloading:   0%|          | 0.00/494k [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"},{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"cd790e60a5e9466db209abe06d745623","version_major":2,"version_minor":0},"text/plain":["Downloading:   0%|          | 0.00/52.7k [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"},{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"4a4bc16ccd8f427e9ecb2963b5f50dd6","version_major":2,"version_minor":0},"text/plain":["Downloading:   0%|          | 0.00/2.11k [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"},{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"1b84f540e77645b394ad11e80a982e69","version_major":2,"version_minor":0},"text/plain":["Downloading:   0%|          | 0.00/2.06k [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"}],"source":["from transformers import WhisperTokenizer\n","\n","tokenizer = WhisperTokenizer.from_pretrained(\"openai/whisper-small\", language=\"Italian\", task=\"transcribe\")"],"id":"c7b07f9b-ae0e-4f89-98f0-0c50d432eab6"},{"cell_type":"markdown","metadata":{"id":"d2ef23f3-f4a8-483a-a2dc-080a7496cb1b"},"source":["### Combine To Create A WhisperProcessor"],"id":"d2ef23f3-f4a8-483a-a2dc-080a7496cb1b"},{"cell_type":"markdown","metadata":{"id":"5ff67654-5a29-4bb8-a69d-0228946c6f8d"},"source":["To simplify using the feature extractor and tokenizer, we can _wrap_ \n","both into a single `WhisperProcessor` class. This processor object \n","inherits from the `WhisperFeatureExtractor` and `WhisperProcessor`, \n","and can be used on the audio inputs and model predictions as required. \n","In doing so, we only need to keep track of two objects during training: \n","the `processor` and the `model`:"],"id":"5ff67654-5a29-4bb8-a69d-0228946c6f8d"},{"cell_type":"code","execution_count":null,"metadata":{"id":"77d9f0c5-8607-4642-a8ac-c3ab2e223ea6"},"outputs":[],"source":["from transformers import WhisperProcessor\n","\n","processor = WhisperProcessor.from_pretrained(\"openai/whisper-small\", language=\"Italian\", task=\"transcribe\")"],"id":"77d9f0c5-8607-4642-a8ac-c3ab2e223ea6"},{"cell_type":"markdown","metadata":{"id":"-ZEqjDz_N9tE"},"source":["### Upload the Common Voice Dataset from Google Drive\n"],"id":"-ZEqjDz_N9tE"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":26392,"status":"ok","timestamp":1670483264554,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"2XguxxgKI-hH","outputId":"90e16143-d512-41a0-b0a0-b12464c03ee9"},"outputs":[{"name":"stdout","output_type":"stream","text":["Mounted at /content/drive\n"]}],"source":["from google.colab import drive\n","drive.mount('/content/drive')"],"id":"2XguxxgKI-hH"},{"cell_type":"code","execution_count":null,"metadata":{"id":"lBzMxxDVKJRm"},"outputs":[],"source":["import os\n","os.mkdir(\"/content/common_voice\")"],"id":"lBzMxxDVKJRm"},{"cell_type":"code","execution_count":null,"metadata":{"id":"9PmMgjN6NKpz"},"outputs":[],"source":["import zipfile\n","zip = zipfile.ZipFile(\"/content/drive/MyDrive/common_voice.zip\")\n","zip.extractall(\"/content/common_voice\")"],"id":"9PmMgjN6NKpz"},{"cell_type":"code","execution_count":null,"metadata":{"id":"Rr1Diec9Yz0D"},"outputs":[],"source":["from datasets import load_dataset, DatasetDict\n","\n","common_voice = DatasetDict()\n","\n","common_voice = DatasetDict.load_from_disk(\"/content/common_voice/content/common_voice\")\n","\n"],"id":"Rr1Diec9Yz0D"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":3,"status":"ok","timestamp":1670483790618,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"NRZLG2kQApBa","outputId":"ab21f125-10c4-403b-f302-8fa03895c86a"},"outputs":[{"name":"stdout","output_type":"stream","text":["DatasetDict({\n","    train: Dataset({\n","        features: ['input_features', 'labels'],\n","        num_rows: 15261\n","    })\n","    test: Dataset({\n","        features: ['input_features', 'labels'],\n","        num_rows: 1500\n","    })\n","})\n"]}],"source":["print(common_voice)"],"id":"NRZLG2kQApBa"},{"cell_type":"markdown","metadata":{"id":"263a5a58-0239-4a25-b0df-c625fc9c5810"},"source":["## Training and Evaluation"],"id":"263a5a58-0239-4a25-b0df-c625fc9c5810"},{"cell_type":"markdown","metadata":{"id":"a693e768-c5a6-453f-89a1-b601dcf7daf7"},"source":["Now that we've prepared our data, we're ready to dive into the training pipeline. \n","The [🤗 Trainer](https://huggingface.co/transformers/master/main_classes/trainer.html?highlight=trainer)\n","will do much of the heavy lifting for us. All we have to do is:\n","\n","- Define a data collator: the data collator takes our pre-processed data and prepares PyTorch tensors ready for the model.\n","\n","- Evaluation metrics: during evaluation, we want to evaluate the model using the [word error rate (WER)](https://huggingface.co/metrics/wer) metric. We need to define a `compute_metrics` function that handles this computation.\n","\n","- Load a pre-trained checkpoint: we need to load a pre-trained checkpoint and configure it correctly for training.\n","\n","- Define the training configuration: this will be used by the 🤗 Trainer to define the training schedule.\n","\n","Once we've fine-tuned the model, we will evaluate it on the test data to verify that we have correctly trained it \n","to transcribe speech in Hindi."],"id":"a693e768-c5a6-453f-89a1-b601dcf7daf7"},{"cell_type":"markdown","metadata":{"id":"8d230e6d-624c-400a-bbf5-fa660881df25"},"source":["### Define a Data Collator"],"id":"8d230e6d-624c-400a-bbf5-fa660881df25"},{"cell_type":"markdown","metadata":{"id":"04def221-0637-4a69-b242-d3f0c1d0ee78"},"source":["The data collator for a sequence-to-sequence speech model is unique in the sense that it \n","treats the `input_features` and `labels` independently: the  `input_features` must be \n","handled by the feature extractor and the `labels` by the tokenizer.\n","\n","The `input_features` are already padded to 30s and converted to a log-Mel spectrogram \n","of fixed dimension by action of the feature extractor, so all we have to do is convert the `input_features`\n","to batched PyTorch tensors. We do this using the feature extractor's `.pad` method with `return_tensors=pt`.\n","\n","The `labels` on the other hand are un-padded. We first pad the sequences\n","to the maximum length in the batch using the tokenizer's `.pad` method. The padding tokens \n","are then replaced by `-100` so that these tokens are **not** taken into account when \n","computing the loss. We then cut the BOS token from the start of the label sequence as we \n","append it later during training.\n","\n","We can leverage the `WhisperProcessor` we defined earlier to perform both the \n","feature extractor and the tokenizer operations:"],"id":"04def221-0637-4a69-b242-d3f0c1d0ee78"},{"cell_type":"code","execution_count":null,"metadata":{"id":"8326221e-ec13-4731-bb4e-51e5fc1486c5"},"outputs":[],"source":["import torch\n","\n","from dataclasses import dataclass\n","from typing import Any, Dict, List, Union\n","\n","@dataclass\n","class DataCollatorSpeechSeq2SeqWithPadding:\n","    processor: Any\n","\n","    def __call__(self, features: List[Dict[str, Union[List[int], torch.Tensor]]]) -> Dict[str, torch.Tensor]:\n","        # split inputs and labels since they have to be of different lengths and need different padding methods\n","        # first treat the audio inputs by simply returning torch tensors\n","        input_features = [{\"input_features\": feature[\"input_features\"]} for feature in features]\n","        batch = self.processor.feature_extractor.pad(input_features, return_tensors=\"pt\")\n","\n","        # get the tokenized label sequences\n","        label_features = [{\"input_ids\": feature[\"labels\"]} for feature in features]\n","        # pad the labels to max length\n","        labels_batch = self.processor.tokenizer.pad(label_features, return_tensors=\"pt\")\n","\n","        # replace padding with -100 to ignore loss correctly\n","        labels = labels_batch[\"input_ids\"].masked_fill(labels_batch.attention_mask.ne(1), -100)\n","\n","        # if bos token is appended in previous tokenization step,\n","        # cut bos token here as it's append later anyways\n","        if (labels[:, 0] == self.processor.tokenizer.bos_token_id).all().cpu().item():\n","            labels = labels[:, 1:]\n","\n","        batch[\"labels\"] = labels\n","\n","        return batch"],"id":"8326221e-ec13-4731-bb4e-51e5fc1486c5"},{"cell_type":"markdown","metadata":{"id":"3cae7dbf-8a50-456e-a3a8-7fd005390f86"},"source":["Let's initialise the data collator we've just defined:"],"id":"3cae7dbf-8a50-456e-a3a8-7fd005390f86"},{"cell_type":"code","execution_count":null,"metadata":{"id":"fc834702-c0d3-4a96-b101-7b87be32bf42"},"outputs":[],"source":["data_collator = DataCollatorSpeechSeq2SeqWithPadding(processor=processor)"],"id":"fc834702-c0d3-4a96-b101-7b87be32bf42"},{"cell_type":"markdown","metadata":{"id":"d62bb2ab-750a-45e7-82e9-61d6f4805698"},"source":["### Evaluation Metrics"],"id":"d62bb2ab-750a-45e7-82e9-61d6f4805698"},{"cell_type":"markdown","metadata":{"id":"66fee1a7-a44c-461e-b047-c3917221572e"},"source":["We'll use the word error rate (WER) metric, the 'de-facto' metric for assessing \n","ASR systems. For more information, refer to the WER [docs](https://huggingface.co/metrics/wer). We'll load the WER metric from 🤗 Evaluate:"],"id":"66fee1a7-a44c-461e-b047-c3917221572e"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/","referenced_widgets":["a148e8c68c5e4285b24a9c6a27b3d470","e7d6166efe73473383c363d15e87419a","bf9536fc0ba448ef8031b30cb9f79eba","1dba384ffb4b41ed94a9392888ca22af","0674bb92deae44f8bd5b7d1b49b1a95b","e8af0512ce24409fb80df8251a9bb012","a00699fd95e94fb8a60cb6b4e186616f","bfed2b2b2e1e4bcdbddcaf2d7d3aff96","9a3c3b759e45413384e99e16b1c32160","1390c0c15d85484d9e9435baec75a719","a68bfd45fd2c4739a67e0e7b3c204658"]},"executionInfo":{"elapsed":5657,"status":"ok","timestamp":1670483802903,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"b22b4011-f31f-4b57-b684-c52332f92890","outputId":"31e88179-70d7-40ce-bc19-c78ca4b6e3ba"},"outputs":[{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"a148e8c68c5e4285b24a9c6a27b3d470","version_major":2,"version_minor":0},"text/plain":["Downloading builder script:   0%|          | 0.00/4.49k [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"}],"source":["import evaluate\n","\n","metric = evaluate.load(\"wer\")"],"id":"b22b4011-f31f-4b57-b684-c52332f92890"},{"cell_type":"markdown","metadata":{"id":"4f32cab6-31f0-4cb9-af4c-40ba0f5fc508"},"source":["We then simply have to define a function that takes our model \n","predictions and returns the WER metric. This function, called\n","`compute_metrics`, first replaces `-100` with the `pad_token_id`\n","in the `label_ids` (undoing the step we applied in the \n","data collator to ignore padded tokens correctly in the loss).\n","It then decodes the predicted and label ids to strings. Finally,\n","it computes the WER between the predictions and reference labels:"],"id":"4f32cab6-31f0-4cb9-af4c-40ba0f5fc508"},{"cell_type":"code","execution_count":null,"metadata":{"id":"23959a70-22d0-4ffe-9fa1-72b61e75bb52"},"outputs":[],"source":["def compute_metrics(pred):\n","    pred_ids = pred.predictions\n","    label_ids = pred.label_ids\n","\n","    # replace -100 with the pad_token_id\n","    label_ids[label_ids == -100] = tokenizer.pad_token_id\n","\n","    # we do not want to group tokens when computing the metrics\n","    pred_str = tokenizer.batch_decode(pred_ids, skip_special_tokens=True)\n","    label_str = tokenizer.batch_decode(label_ids, skip_special_tokens=True)\n","\n","    wer = 100 * metric.compute(predictions=pred_str, references=label_str)\n","\n","    return {\"wer\": wer}"],"id":"23959a70-22d0-4ffe-9fa1-72b61e75bb52"},{"cell_type":"markdown","metadata":{"id":"daf2a825-6d9f-4a23-b145-c37c0039075b"},"source":["### Load a Pre-Trained Checkpoint"],"id":"daf2a825-6d9f-4a23-b145-c37c0039075b"},{"cell_type":"markdown","metadata":{"id":"437a97fa-4864-476b-8abc-f28b8166cfa5"},"source":["Now let's load the pre-trained Whisper `small` checkpoint. Again, this \n","is trivial through use of 🤗 Transformers!"],"id":"437a97fa-4864-476b-8abc-f28b8166cfa5"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/","referenced_widgets":["1da2108d020f4a1caea77c14b728563e","2112377e0a0d40d38b754b3fdf0e73e6","ad53db4440f14624a29d7aae697f0f6f","313e0c881dda490480a0ae5ce9f68881","daad90ec2847417cba2c088b06a04e3b","26a16996dda64b23baa04d33c22a70f7","abefd869593a473d8375da57a1673a50","4de948681a2443a69eeba5332a1a98e5","8a69de99d9994ba796c85532046060e7","9f9d9cf3f5f04d33802f2afe8c86bb84","8c0338b9cfb34d1085251c808f64027a","e092beefae0a4a4f927b4a9fcc71453c","11d8863439724b2fbba1cc45a251793a","644915d9b6d442b39569d0bfb3b173ab","022b715638f14ad3b0a0bd902d04ee40","12df766e00d542f4b0f59d3fa0daee74","6716f8506a484f8d943acd1130c541e2","7dd77edb9dbc4d888f132bccae8e77ad","4a2d5b98c2984d05a98a0ecc16a6395b","1928776dc6aa457aa4e23565fcb45018","81f5eca0699f41cebb7dbd2f22462c6a","a4574156b5ea4208be9c1eea692cc45e"]},"executionInfo":{"elapsed":21581,"status":"ok","timestamp":1670483824479,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"5a10cc4b-07ec-4ebd-ac1d-7c601023594f","outputId":"c05c4ed4-6d63-42d9-dd31-235bcdea49cc"},"outputs":[{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"1da2108d020f4a1caea77c14b728563e","version_major":2,"version_minor":0},"text/plain":["Downloading:   0%|          | 0.00/1.97k [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"},{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"e092beefae0a4a4f927b4a9fcc71453c","version_major":2,"version_minor":0},"text/plain":["Downloading:   0%|          | 0.00/967M [00:00<?, ?B/s]"]},"metadata":{},"output_type":"display_data"}],"source":["from transformers import WhisperForConditionalGeneration\n","\n","model = WhisperForConditionalGeneration.from_pretrained(\"openai/whisper-small\")"],"id":"5a10cc4b-07ec-4ebd-ac1d-7c601023594f"},{"cell_type":"markdown","metadata":{"id":"a15ead5f-2277-4a39-937b-585c2497b2df"},"source":["Override generation arguments - no tokens are forced as decoder outputs (see [`forced_decoder_ids`](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.generation_utils.GenerationMixin.generate.forced_decoder_ids)), no tokens are suppressed during generation (see [`suppress_tokens`](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.generation_utils.GenerationMixin.generate.suppress_tokens)):"],"id":"a15ead5f-2277-4a39-937b-585c2497b2df"},{"cell_type":"code","execution_count":null,"metadata":{"id":"62038ba3-88ed-4fce-84db-338f50dcd04f"},"outputs":[],"source":["model.config.forced_decoder_ids = None\n","model.config.suppress_tokens = []"],"id":"62038ba3-88ed-4fce-84db-338f50dcd04f"},{"cell_type":"markdown","metadata":{"id":"2178dea4-80ca-47b6-b6ea-ba1915c90c06"},"source":["### Define the Training Configuration"],"id":"2178dea4-80ca-47b6-b6ea-ba1915c90c06"},{"cell_type":"markdown","metadata":{"id":"c21af1e9-0188-4134-ac82-defc7bdcc436"},"source":["In the final step, we define all the parameters related to training. For more detail on the training arguments, refer to the Seq2SeqTrainingArguments [docs](https://huggingface.co/docs/transformers/main_classes/trainer#transformers.Seq2SeqTrainingArguments)."],"id":"c21af1e9-0188-4134-ac82-defc7bdcc436"},{"cell_type":"code","execution_count":null,"metadata":{"id":"0ae3e9af-97b7-4aa0-ae85-20b23b5bcb3a"},"outputs":[],"source":["from transformers import Seq2SeqTrainingArguments\n","\n","training_args = Seq2SeqTrainingArguments(\n","    num_train_epochs=2, # Total number of training epochs to perform\n","    output_dir=\"/content/drive/MyDrive/whisper\", # model predictions and checkpoints will be written on Google Drive to be able to recover checkpoints\n","    per_device_train_batch_size=16, # The batch size per GPU/TPU core/CPU for training\n","    gradient_accumulation_steps=1,  # increase by 2x for every 2x decrease in batch size\n","    learning_rate=1e-5, # The initial learning rate for AdamW optimizer\n","    warmup_steps=500, # Number of steps used for a linear warmup from 0 to learning_rate\n","    gradient_checkpointing=True, # use gradient checkpointing to save memory at the expense of slower backward pass\n","    fp16=True, #  Whether to use fp16 16-bit (mixed) precision training instead of 32-bit training\n","    evaluation_strategy=\"steps\", # Evaluation is done (and logged) every eval_steps\n","    save_strategy=\"steps\", # Save is done every save_steps\n","    per_device_eval_batch_size=8, # The batch size per GPU/TPU core/CPU for evaluation\n","    predict_with_generate=True, # Whether to use generate to calculate generative metrics\n","    generation_max_length=225, # The max_length to use on each evaluation loop\n","    save_steps=100, # Number of updates steps before two checkpoint saves\n","    save_total_limit=2, # will limit the total amount of checkpoints. Deletes the older checkpoints in output_dir\n","    eval_steps=100, # Number of update steps between two evaluations if evaluation_strategy=\"steps\"\n","    logging_steps=25, # Number of update steps between two logs if logging_strategy=\"steps\"\n","    report_to=[\"tensorboard\"], # Report the results and logs to tensorboard\n","    load_best_model_at_end=True, # load the best model found during training at the end of training\n","    metric_for_best_model=\"wer\", # specify the metric to use to compare two different models\n","    greater_is_better=False, # set it to False as our metric is better when lower\n","    push_to_hub=True, # push the model to the Hub every time the model is saved\n",")"],"id":"0ae3e9af-97b7-4aa0-ae85-20b23b5bcb3a"},{"cell_type":"markdown","metadata":{"id":"b3a944d8-3112-4552-82a0-be25988b3857"},"source":["**Note**: if one does not want to upload the model checkpoints to the Hub, \n","set `push_to_hub=False`."],"id":"b3a944d8-3112-4552-82a0-be25988b3857"},{"cell_type":"markdown","metadata":{"id":"bac29114-d226-4f54-97cf-8718c9f94e1e"},"source":["We can forward the training arguments to the 🤗 Trainer along with our model,\n","dataset, data collator and `compute_metrics` function:"],"id":"bac29114-d226-4f54-97cf-8718c9f94e1e"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":31696,"status":"ok","timestamp":1670483861384,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"d546d7fe-0543-479a-b708-2ebabec19493","outputId":"ecd42cb5-c706-4c5a-c410-075712f06b81"},"outputs":[{"name":"stderr","output_type":"stream","text":["/content/drive/MyDrive/whisper is already a clone of https://huggingface.co/whispy/whisper. Make sure you pull the latest changes with `repo.git_pull()`.\n","WARNING:huggingface_hub.repository:/content/drive/MyDrive/whisper is already a clone of https://huggingface.co/whispy/whisper. Make sure you pull the latest changes with `repo.git_pull()`.\n","Using cuda_amp half precision backend\n"]}],"source":["from transformers import Seq2SeqTrainer\n","\n","trainer = Seq2SeqTrainer(\n","    args=training_args,\n","    model=model,\n","    train_dataset=common_voice[\"train\"],\n","    eval_dataset=common_voice[\"test\"],\n","    data_collator=data_collator,\n","    compute_metrics=compute_metrics,\n","    tokenizer=processor.feature_extractor,\n",")"],"id":"d546d7fe-0543-479a-b708-2ebabec19493"},{"cell_type":"markdown","metadata":{"id":"uOrRhDGtN5S4"},"source":["We'll save the processor object once before starting training. Since the processor is not trainable, it won't change over the course of training:"],"id":"uOrRhDGtN5S4"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":6769,"status":"ok","timestamp":1670483868134,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"-2zQwMfEOBJq","outputId":"e6d770dd-fcf6-4bf9-9c58-785e967fb983"},"outputs":[{"name":"stderr","output_type":"stream","text":["Feature extractor saved in /content/drive/MyDrive/whisper/preprocessor_config.json\n","tokenizer config file saved in /content/drive/MyDrive/whisper/tokenizer_config.json\n","Special tokens file saved in /content/drive/MyDrive/whisper/special_tokens_map.json\n","added tokens file saved in /content/drive/MyDrive/whisper/added_tokens.json\n"]}],"source":["processor.save_pretrained(training_args.output_dir)"],"id":"-2zQwMfEOBJq"},{"cell_type":"markdown","metadata":{"id":"7f404cf9-4345-468c-8196-4bd101d9bd51"},"source":["### Training"],"id":"7f404cf9-4345-468c-8196-4bd101d9bd51"},{"cell_type":"markdown","metadata":{"id":"5e8b8d56-5a70-4f68-bd2e-f0752d0bd112"},"source":["Training will take approximately 5-10 hours depending on your GPU or the one \n","allocated to this Google Colab. If using this Google Colab directly to \n","fine-tune a Whisper model, you should make sure that training isn't \n","interrupted due to inactivity. A simple workaround to prevent this is \n","to paste the following code into the console of this tab (_right mouse click_ \n","-> _inspect_ -> _Console tab_ -> _insert code_)."],"id":"5e8b8d56-5a70-4f68-bd2e-f0752d0bd112"},{"cell_type":"markdown","metadata":{"id":"890a63ed-e87b-4e53-a35a-6ec1eca560af"},"source":["```javascript\n","function ConnectButton(){\n","    console.log(\"Connect pushed\"); \n","    document.querySelector(\"#top-toolbar > colab-connect-button\").shadowRoot.querySelector(\"#connect\").click() \n","}\n","setInterval(ConnectButton, 60000);\n","```"],"id":"890a63ed-e87b-4e53-a35a-6ec1eca560af"},{"cell_type":"markdown","metadata":{"id":"5a55168b-2f46-4678-afa0-ff22257ec06d"},"source":["The peak GPU memory for the given training configuration is approximately 15.8GB. \n","Depending on the GPU allocated to the Google Colab, it is possible that you will encounter a CUDA `\"out-of-memory\"` error when you launch training. \n","In this case, you can reduce the `per_device_train_batch_size` incrementally by factors of 2 \n","and employ [`gradient_accumulation_steps`](https://huggingface.co/docs/transformers/main_classes/trainer#transformers.Seq2SeqTrainingArguments.gradient_accumulation_steps)\n","to compensate.\n","\n","To launch training, simply execute:"],"id":"5a55168b-2f46-4678-afa0-ff22257ec06d"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":1000},"id":"ee8b7b8e-1c9a-4d77-9137-1778a629e6de","outputId":"b6d49f1f-3e82-40d3-f13c-e0a7ecab632d"},"outputs":[{"name":"stderr","output_type":"stream","text":["/usr/local/lib/python3.8/dist-packages/transformers/optimization.py:306: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n","  warnings.warn(\n","***** Running training *****\n","  Num examples = 15261\n","  Num Epochs = 2\n","  Instantaneous batch size per device = 16\n","  Total train batch size (w. parallel, distributed & accumulation) = 16\n","  Gradient Accumulation steps = 1\n","  Total optimization steps = 1908\n","  Number of trainable parameters = 241734912\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n"]},{"data":{"text/html":["\n","    <div>\n","      \n","      <progress value='213' max='1908' style='width:300px; height:20px; vertical-align: middle;'></progress>\n","      [ 213/1908 56:05 < 7:30:36, 0.06 it/s, Epoch 0.22/2]\n","    </div>\n","    <table border=\"1\" class=\"dataframe\">\n","  <thead>\n"," <tr style=\"text-align: left;\">\n","      <th>Step</th>\n","      <th>Training Loss</th>\n","      <th>Validation Loss</th>\n","      <th>Wer</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <td>100</td>\n","      <td>1.452100</td>\n","      <td>1.377093</td>\n","      <td>120.348031</td>\n","    </tr>\n","    <tr>\n","      <td>200</td>\n","      <td>0.752600</td>\n","      <td>0.912025</td>\n","      <td>83.894897</td>\n","    </tr>\n","  </tbody>\n","</table><p>"],"text/plain":["<IPython.core.display.HTML object>"]},"metadata":{},"output_type":"display_data"},{"name":"stderr","output_type":"stream","text":["`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 1\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-100\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-100/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-100/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-100/preprocessor_config.json\n","Feature extractor saved in /content/drive/MyDrive/whisper/preprocessor_config.json\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 1\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-200\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-200/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-200/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-200/preprocessor_config.json\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n"]}],"source":["trainer.train()"],"id":"ee8b7b8e-1c9a-4d77-9137-1778a629e6de"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["356c781a31a3427c8b32c1ddbb6caca0","8f11d319f40542eeb9ac82f234d9ab29","4a1b25f43e9846c8afca72905e164612","756f0a7608c14cda9dfbdc7762b4d714","7e08d1e3d6ce4089ba276f5eee263542","047765c4094e430f97f8839dcdc478a4","670efd5fab184f1f898215a889fd1ea6","f1b671de93e045c1ae06935191be61f6","60235e841f4c48768d6e11d2f5ad065b","b1a7aa9ee2404763bf0414df97bb92db","ac6f5ac61cd34458967f1389e8ce72f0"]},"executionInfo":{"elapsed":16028680,"status":"ok","timestamp":1670499901302,"user":{"displayName":"Branco Colline Bassano 3","userId":"07535808357024135408"},"user_tz":-60},"id":"gFVTImvTGJbr","outputId":"41366abb-9e0f-423a-d95a-4cc97b525141"},"outputs":[{"name":"stderr","output_type":"stream","text":["Loading model from /content/drive/MyDrive/whisper/checkpoint-700.\n","/usr/local/lib/python3.8/dist-packages/transformers/optimization.py:306: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n","  warnings.warn(\n","***** Running training *****\n","  Num examples = 15261\n","  Num Epochs = 2\n","  Instantaneous batch size per device = 16\n","  Total train batch size (w. parallel, distributed & accumulation) = 16\n","  Gradient Accumulation steps = 1\n","  Total optimization steps = 1908\n","  Number of trainable parameters = 241734912\n","  Continuing training from checkpoint, will skip to saved global_step\n","  Continuing training from epoch 0\n","  Continuing training from global step 700\n","  Will skip the first 0 epochs then the first 700 batches in the first epoch. If this takes a lot of time, you can add the `--ignore_data_skip` flag to your launch command, but you will resume the training on data already seen by your model.\n"]},{"data":{"application/vnd.jupyter.widget-view+json":{"model_id":"356c781a31a3427c8b32c1ddbb6caca0","version_major":2,"version_minor":0},"text/plain":["  0%|          | 0/700 [00:00<?, ?it/s]"]},"metadata":{},"output_type":"display_data"},{"name":"stderr","output_type":"stream","text":["`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n"]},{"data":{"text/html":["\n","    <div>\n","      \n","      <progress value='1908' max='1908' style='width:300px; height:20px; vertical-align: middle;'></progress>\n","      [1908/1908 4:05:24, Epoch 2/2]\n","    </div>\n","    <table border=\"1\" class=\"dataframe\">\n","  <thead>\n"," <tr style=\"text-align: left;\">\n","      <th>Step</th>\n","      <th>Training Loss</th>\n","      <th>Validation Loss</th>\n","      <th>Wer</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <td>800</td>\n","      <td>0.272700</td>\n","      <td>0.288787</td>\n","      <td>19.549132</td>\n","    </tr>\n","    <tr>\n","      <td>900</td>\n","      <td>0.253200</td>\n","      <td>0.277948</td>\n","      <td>19.383169</td>\n","    </tr>\n","    <tr>\n","      <td>1000</td>\n","      <td>0.232000</td>\n","      <td>0.272154</td>\n","      <td>18.677823</td>\n","    </tr>\n","    <tr>\n","      <td>1100</td>\n","      <td>0.216900</td>\n","      <td>0.271972</td>\n","      <td>18.926769</td>\n","    </tr>\n","    <tr>\n","      <td>1200</td>\n","      <td>0.249300</td>\n","      <td>0.274051</td>\n","      <td>20.067768</td>\n","    </tr>\n","    <tr>\n","      <td>1300</td>\n","      <td>0.231200</td>\n","      <td>0.266588</td>\n","      <td>18.276744</td>\n","    </tr>\n","    <tr>\n","      <td>1400</td>\n","      <td>0.215800</td>\n","      <td>0.265121</td>\n","      <td>19.652859</td>\n","    </tr>\n","    <tr>\n","      <td>1500</td>\n","      <td>0.217100</td>\n","      <td>0.258326</td>\n","      <td>18.608672</td>\n","    </tr>\n","    <tr>\n","      <td>1600</td>\n","      <td>0.207400</td>\n","      <td>0.255080</td>\n","      <td>17.682041</td>\n","    </tr>\n","    <tr>\n","      <td>1700</td>\n","      <td>0.186200</td>\n","      <td>0.249114</td>\n","      <td>17.412350</td>\n","    </tr>\n","    <tr>\n","      <td>1800</td>\n","      <td>0.204400</td>\n","      <td>0.247503</td>\n","      <td>17.896411</td>\n","    </tr>\n","    <tr>\n","      <td>1900</td>\n","      <td>0.187700</td>\n","      <td>0.242086</td>\n","      <td>17.370860</td>\n","    </tr>\n","  </tbody>\n","</table><p>"],"text/plain":["<IPython.core.display.HTML object>"]},"metadata":{},"output_type":"display_data"},{"name":"stderr","output_type":"stream","text":["`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-800\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-800/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-800/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-800/preprocessor_config.json\n","Feature extractor saved in /content/drive/MyDrive/whisper/preprocessor_config.json\n","Several commits (3) will be pushed upstream.\n","WARNING:huggingface_hub.repository:Several commits (3) will be pushed upstream.\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-600] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-900\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-900/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-900/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-900/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-700] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1000\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1000/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1000/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1000/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-800] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1100\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1100/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1100/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1100/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-900] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1200\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1200/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1200/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1200/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-1100] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1300\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1300/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1300/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1300/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-1000] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1400\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1400/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1400/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1400/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-1200] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1500\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1500/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1500/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1500/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-1400] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1600\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1600/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1600/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1600/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-1300] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1700\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1700/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1700/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1700/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-1500] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1800\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1800/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1800/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1800/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-1600] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","***** Running Evaluation *****\n","  Num examples = 1500\n","  Batch size = 8\n","Saving model checkpoint to /content/drive/MyDrive/whisper/checkpoint-1900\n","Configuration saved in /content/drive/MyDrive/whisper/checkpoint-1900/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/checkpoint-1900/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/checkpoint-1900/preprocessor_config.json\n","Deleting older checkpoint [/content/drive/MyDrive/whisper/checkpoint-1700] due to args.save_total_limit\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n","\n","\n","Training completed. Do not forget to share your model on huggingface.co/models =)\n","\n","\n","Loading best model from /content/drive/MyDrive/whisper/checkpoint-1900 (score: 17.37085955328124).\n"]},{"data":{"text/plain":["TrainOutput(global_step=1908, training_loss=0.1447156570242636, metrics={'train_runtime': 16011.5573, 'train_samples_per_second': 1.906, 'train_steps_per_second': 0.119, 'total_flos': 8.80820358856704e+18, 'train_loss': 0.1447156570242636, 'epoch': 2.0})"]},"execution_count":23,"metadata":{},"output_type":"execute_result"}],"source":["trainer.train(resume_from_checkpoint=True)"],"id":"gFVTImvTGJbr"},{"cell_type":"markdown","metadata":{"id":"810ced54-7187-4a06-b2fe-ba6dcca94dc3"},"source":["Our best WER is 17.39% - not bad for 4h of training data! We can submit our checkpoint to the [`hf-speech-bench`](https://huggingface.co/spaces/huggingface/hf-speech-bench) on push by setting the appropriate key-word arguments (kwargs):"],"id":"810ced54-7187-4a06-b2fe-ba6dcca94dc3"},{"cell_type":"code","execution_count":null,"metadata":{"id":"c704f91e-241b-48c9-b8e0-f0da396a9663"},"outputs":[],"source":["kwargs = {\n","    \"dataset_tags\": \"mozilla-foundation/common_voice_11_0\",\n","    \"dataset\": \"Common Voice 11.0\",  # a 'pretty' name for the training dataset\n","    \"dataset_args\": \"config: it, split: test\",\n","    \"language\": \"it\",\n","    \"model_name\": \"Whisper Small Italian\",  # a 'pretty' name for our model\n","    \"finetuned_from\": \"openai/whisper-small\",\n","    \"tasks\": \"automatic-speech-recognition\",\n","    \"tags\": \"hf-asr-leaderboard\",\n","}"],"id":"c704f91e-241b-48c9-b8e0-f0da396a9663"},{"cell_type":"markdown","metadata":{"id":"090d676a-f944-4297-a938-a40eda0b2b68"},"source":["The training results can now be uploaded to the Hub. To do so, execute the `push_to_hub` command and save the preprocessor object we created:"],"id":"090d676a-f944-4297-a938-a40eda0b2b68"},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"d7030622-caf7-4039-939b-6195cdaa2585","outputId":"433d8ef8-e2a8-47f7-b723-fbed6a287344"},"outputs":[{"metadata":{"tags":null},"name":"stderr","output_type":"stream","text":["Saving model checkpoint to /content/drive/MyDrive/whisper\n","Configuration saved in /content/drive/MyDrive/whisper/config.json\n","Model weights saved in /content/drive/MyDrive/whisper/pytorch_model.bin\n","Feature extractor saved in /content/drive/MyDrive/whisper/preprocessor_config.json\n","Several commits (5) will be pushed upstream.\n","WARNING:huggingface_hub.repository:Several commits (5) will be pushed upstream.\n","The progress bars may be unreliable.\n","WARNING:huggingface_hub.repository:The progress bars may be unreliable.\n"]}],"source":["trainer.push_to_hub(**kwargs)"],"id":"d7030622-caf7-4039-939b-6195cdaa2585"}],"metadata":{"accelerator":"GPU","colab":{"provenance":[]},"gpuClass":"standard","kernelspec":{"display_name":"Python 3 (ipykernel)","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.8.9"},"widgets":{"application/vnd.jupyter.widget-state+json":{"022b715638f14ad3b0a0bd902d04ee40":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_81f5eca0699f41cebb7dbd2f22462c6a","placeholder":"​","style":"IPY_MODEL_a4574156b5ea4208be9c1eea692cc45e","value":" 967M/967M [00:14&lt;00:00, 77.3MB/s]"}},"02c3874e6bc3460283a76811e0752959":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_83b3d040e5c243ccbd96ad31fd823b5d","placeholder":"​","style":"IPY_MODEL_21f8c09534674ba7ab2909d3f19fc8b8","value":" 494k/494k [00:01&lt;00:00, 470kB/s]"}},"047765c4094e430f97f8839dcdc478a4":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"063ef8e4621b4d35b23897c55ee1577d":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"0674bb92deae44f8bd5b7d1b49b1a95b":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"0713f929148d4e36915825e4ecc63d9a":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_a5d95c5957dc456898aee68b169545b8","max":829,"min":0,"orientation":"horizontal","style":"IPY_MODEL_c79df9040e1f4ec6bfadfa4f31c71901","value":829}},"0f123428ba844a3fa632fcff5ce21bdc":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_0fe13f12176d422c9ffbbda948f556ff","max":493864,"min":0,"orientation":"horizontal","style":"IPY_MODEL_e4bd42a517c842228db369d452078236","value":493864}},"0fe13f12176d422c9ffbbda948f556ff":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"11d8863439724b2fbba1cc45a251793a":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_6716f8506a484f8d943acd1130c541e2","placeholder":"​","style":"IPY_MODEL_7dd77edb9dbc4d888f132bccae8e77ad","value":"Downloading: 100%"}},"12df766e00d542f4b0f59d3fa0daee74":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1390c0c15d85484d9e9435baec75a719":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"155e018a929c417ba76461e99ce36d76":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_ac6a42c2fb0a4cf6adc2eed4e62d2f48","placeholder":"​","style":"IPY_MODEL_afdc831e6dd6444f9093d5fbfe4f878d","value":" 185k/185k [00:00&lt;00:00, 170kB/s]"}},"1928776dc6aa457aa4e23565fcb45018":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"1abcff86d9224149a0c2005f721f9289":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1b84f540e77645b394ad11e80a982e69":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_f0ab68a9bab8483191f4379d6edc2f1a","IPY_MODEL_ac0fdf9cd93342c8b29815b9a698a207","IPY_MODEL_bf1ba3028c4e4d81a1df5619ebe28427"],"layout":"IPY_MODEL_1abcff86d9224149a0c2005f721f9289"}},"1d77aa7c8e774c03b94f9d041a9f726b":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1da2108d020f4a1caea77c14b728563e":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_2112377e0a0d40d38b754b3fdf0e73e6","IPY_MODEL_ad53db4440f14624a29d7aae697f0f6f","IPY_MODEL_313e0c881dda490480a0ae5ce9f68881"],"layout":"IPY_MODEL_daad90ec2847417cba2c088b06a04e3b"}},"1dba384ffb4b41ed94a9392888ca22af":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_1390c0c15d85484d9e9435baec75a719","placeholder":"​","style":"IPY_MODEL_a68bfd45fd2c4739a67e0e7b3c204658","value":" 4.49k/4.49k [00:00&lt;00:00, 163kB/s]"}},"1f152ad895c944e3956bb0de19e994de":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2112377e0a0d40d38b754b3fdf0e73e6":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_26a16996dda64b23baa04d33c22a70f7","placeholder":"​","style":"IPY_MODEL_abefd869593a473d8375da57a1673a50","value":"Downloading: 100%"}},"21f8c09534674ba7ab2909d3f19fc8b8":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"2248de092340492090f3effc93942afe":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2446b535103f496b918b71430493922d":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_cd9992aa7a844e5a9b008a6dd0e88ea9","placeholder":"​","style":"IPY_MODEL_3fe51e9d5ff4405b8d30a9a51f6e9bb0","value":" 829/829 [00:00&lt;00:00, 9.68kB/s]"}},"26a16996dda64b23baa04d33c22a70f7":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2a2a87a4c78b4851992bee0c9d664459":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"313e0c881dda490480a0ae5ce9f68881":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_9f9d9cf3f5f04d33802f2afe8c86bb84","placeholder":"​","style":"IPY_MODEL_8c0338b9cfb34d1085251c808f64027a","value":" 1.97k/1.97k [00:00&lt;00:00, 44.9kB/s]"}},"356c781a31a3427c8b32c1ddbb6caca0":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_8f11d319f40542eeb9ac82f234d9ab29","IPY_MODEL_4a1b25f43e9846c8afca72905e164612","IPY_MODEL_756f0a7608c14cda9dfbdc7762b4d714"],"layout":"IPY_MODEL_7e08d1e3d6ce4089ba276f5eee263542"}},"357635536f0b4a399110198698f0ede3":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"365103571a0947dc95cff90c8ac5dfa9":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_fa1f9546c1314aefbde34c2d85034166","placeholder":"​","style":"IPY_MODEL_382a10a4cf484f11af6fbd90a8a094d9","value":"Downloading: 100%"}},"37a25154c3144eb3ba3fa7d4eac1f6c7":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"382a10a4cf484f11af6fbd90a8a094d9":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"3d6e2ee8184c434cbdc65b884d6b5fb5":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"3f0432f225204d96b6041bb327ca1d54":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_64c6659ef231455380f880b618e409d7","placeholder":"​","style":"IPY_MODEL_c583dc3062f1489cbaae9331ce2177a3","value":"Downloading: 100%"}},"3fe51e9d5ff4405b8d30a9a51f6e9bb0":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"42ae1aa22c0547cdbb5f6ab63b46652d":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"46706a4f12234781ab8b0578de842602":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"4a1b25f43e9846c8afca72905e164612":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_f1b671de93e045c1ae06935191be61f6","max":700,"min":0,"orientation":"horizontal","style":"IPY_MODEL_60235e841f4c48768d6e11d2f5ad065b","value":700}},"4a2d5b98c2984d05a98a0ecc16a6395b":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"4a4bc16ccd8f427e9ecb2963b5f50dd6":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_365103571a0947dc95cff90c8ac5dfa9","IPY_MODEL_60efdd5034af4a1d8a6fc455b0082391","IPY_MODEL_951ff7b9b354460d94d4027ecafae8cb"],"layout":"IPY_MODEL_bdea2290d0854741b69fcce3ab0ff68b"}},"4de948681a2443a69eeba5332a1a98e5":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"4eb60c8e03bd4d0598cfa16ca4478679":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_a753d8675ad34c97abe76cfaa1cd060f","max":52666,"min":0,"orientation":"horizontal","style":"IPY_MODEL_e7cb60f0fe544408861c4f967a38d250","value":52666}},"5e1ef85190b344eb893e739782b5161a":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_83b037975d3d47d8bfef2ac26e43c62d","IPY_MODEL_0713f929148d4e36915825e4ecc63d9a","IPY_MODEL_2446b535103f496b918b71430493922d"],"layout":"IPY_MODEL_cedb734eb66a41fe89566c537c8fe8af"}},"5f72b58a6d0748c39e85951d152a13d2":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"60235e841f4c48768d6e11d2f5ad065b":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"60efdd5034af4a1d8a6fc455b0082391":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_feca744e4ec147f29ec62bfeeafcaa7c","max":2108,"min":0,"orientation":"horizontal","style":"IPY_MODEL_c1f788534bda49238a93f90416a481a4","value":2108}},"644915d9b6d442b39569d0bfb3b173ab":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_4a2d5b98c2984d05a98a0ecc16a6395b","max":967092419,"min":0,"orientation":"horizontal","style":"IPY_MODEL_1928776dc6aa457aa4e23565fcb45018","value":967092419}},"64c6659ef231455380f880b618e409d7":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"64c7f45f0c3342b491b7be7aea4cb9f9":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"670dee1015044da0ba816fcf98a46b88":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_7db0487572a24eab86f451c80566a71b","placeholder":"​","style":"IPY_MODEL_063ef8e4621b4d35b23897c55ee1577d","value":"Downloading: 100%"}},"670efd5fab184f1f898215a889fd1ea6":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"6716f8506a484f8d943acd1130c541e2":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"6dc8a5f7ee3c40ee9a706567df0fd49b":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_670dee1015044da0ba816fcf98a46b88","IPY_MODEL_c3bc8c29e168410ebd118230610df290","IPY_MODEL_cde404d1c30f4e0187d570e83562e97a"],"layout":"IPY_MODEL_efdd0260986346ee8478e0bc717109b1"}},"6f01165e885a436e88735af84f3a9937":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_c7d18883e0574a359965714206f72c3e","max":184990,"min":0,"orientation":"horizontal","style":"IPY_MODEL_46706a4f12234781ab8b0578de842602","value":184990}},"756f0a7608c14cda9dfbdc7762b4d714":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_b1a7aa9ee2404763bf0414df97bb92db","placeholder":"​","style":"IPY_MODEL_ac6f5ac61cd34458967f1389e8ce72f0","value":" 700/700 [21:15&lt;00:00,  1.68s/it]"}},"7db0487572a24eab86f451c80566a71b":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"7dd77edb9dbc4d888f132bccae8e77ad":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"7e08d1e3d6ce4089ba276f5eee263542":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"81f5eca0699f41cebb7dbd2f22462c6a":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"83b037975d3d47d8bfef2ac26e43c62d":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_1f152ad895c944e3956bb0de19e994de","placeholder":"​","style":"IPY_MODEL_c5d555dab9c5477d8568cb0cc296c3a3","value":"Downloading: 100%"}},"83b3d040e5c243ccbd96ad31fd823b5d":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"88ccd521de7e47748bfb4dd19155105f":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"8a69de99d9994ba796c85532046060e7":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"8c0338b9cfb34d1085251c808f64027a":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"8f11d319f40542eeb9ac82f234d9ab29":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_047765c4094e430f97f8839dcdc478a4","placeholder":"​","style":"IPY_MODEL_670efd5fab184f1f898215a889fd1ea6","value":"Skipping the first batches: 100%"}},"92744e4ecc7545948d25e2267ce543ae":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_64c7f45f0c3342b491b7be7aea4cb9f9","placeholder":"​","style":"IPY_MODEL_e632fba106be44ce9d0f348b9c2a6642","value":" 52.7k/52.7k [00:00&lt;00:00, 65.9kB/s]"}},"92e3c43102ff4910877b1fffa39897e1":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"951ff7b9b354460d94d4027ecafae8cb":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_92e3c43102ff4910877b1fffa39897e1","placeholder":"​","style":"IPY_MODEL_3d6e2ee8184c434cbdc65b884d6b5fb5","value":" 2.11k/2.11k [00:00&lt;00:00, 63.7kB/s]"}},"97d5fa052b264958845d4abdd6bb170c":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"9a3c3b759e45413384e99e16b1c32160":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"9f9d9cf3f5f04d33802f2afe8c86bb84":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a00699fd95e94fb8a60cb6b4e186616f":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"a148e8c68c5e4285b24a9c6a27b3d470":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_e7d6166efe73473383c363d15e87419a","IPY_MODEL_bf9536fc0ba448ef8031b30cb9f79eba","IPY_MODEL_1dba384ffb4b41ed94a9392888ca22af"],"layout":"IPY_MODEL_0674bb92deae44f8bd5b7d1b49b1a95b"}},"a4574156b5ea4208be9c1eea692cc45e":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"a5d95c5957dc456898aee68b169545b8":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a68bfd45fd2c4739a67e0e7b3c204658":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"a753d8675ad34c97abe76cfaa1cd060f":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a825b0b5778044b28973a6e214d3c33e":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"abefd869593a473d8375da57a1673a50":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"ac0fdf9cd93342c8b29815b9a698a207":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_1d77aa7c8e774c03b94f9d041a9f726b","max":2064,"min":0,"orientation":"horizontal","style":"IPY_MODEL_b7e5d192936f4deaa4ac899fd0500e8d","value":2064}},"ac6a42c2fb0a4cf6adc2eed4e62d2f48":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"ac6f5ac61cd34458967f1389e8ce72f0":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"ad53db4440f14624a29d7aae697f0f6f":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_4de948681a2443a69eeba5332a1a98e5","max":1967,"min":0,"orientation":"horizontal","style":"IPY_MODEL_8a69de99d9994ba796c85532046060e7","value":1967}},"afdc831e6dd6444f9093d5fbfe4f878d":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"b1a7aa9ee2404763bf0414df97bb92db":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"b308ea76ea5e4fc8bf23c915e0bcd3c8":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_beb5d681b9084eaf964c4b8bb880c138","IPY_MODEL_0f123428ba844a3fa632fcff5ce21bdc","IPY_MODEL_02c3874e6bc3460283a76811e0752959"],"layout":"IPY_MODEL_e78c99367e36487ba36cf5d2e0dee246"}},"b688d6c5bc014555b571e245b42790cd":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"b7e5d192936f4deaa4ac899fd0500e8d":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"bdea2290d0854741b69fcce3ab0ff68b":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"beb5d681b9084eaf964c4b8bb880c138":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_88ccd521de7e47748bfb4dd19155105f","placeholder":"​","style":"IPY_MODEL_dd515248ef0f4a7692d22b5342a6c01a","value":"Downloading: 100%"}},"bf1ba3028c4e4d81a1df5619ebe28427":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_b688d6c5bc014555b571e245b42790cd","placeholder":"​","style":"IPY_MODEL_c85fdf789e2e4766a8cdf25feabb9f47","value":" 2.06k/2.06k [00:00&lt;00:00, 47.7kB/s]"}},"bf9536fc0ba448ef8031b30cb9f79eba":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_bfed2b2b2e1e4bcdbddcaf2d7d3aff96","max":4485,"min":0,"orientation":"horizontal","style":"IPY_MODEL_9a3c3b759e45413384e99e16b1c32160","value":4485}},"bfed2b2b2e1e4bcdbddcaf2d7d3aff96":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"c1f788534bda49238a93f90416a481a4":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"c3bc8c29e168410ebd118230610df290":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"FloatProgressModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_5f72b58a6d0748c39e85951d152a13d2","max":1036558,"min":0,"orientation":"horizontal","style":"IPY_MODEL_c62fd52f13f247aca9558caac063d52f","value":1036558}},"c583dc3062f1489cbaae9331ce2177a3":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"c5d555dab9c5477d8568cb0cc296c3a3":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"c62fd52f13f247aca9558caac063d52f":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"c79df9040e1f4ec6bfadfa4f31c71901":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"c7d18883e0574a359965714206f72c3e":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"c85fdf789e2e4766a8cdf25feabb9f47":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"c8ae189458064ef6bcbc66f8b50c3fa0":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_d6f4b10125e447ab81c5e4b537e92da6","IPY_MODEL_6f01165e885a436e88735af84f3a9937","IPY_MODEL_155e018a929c417ba76461e99ce36d76"],"layout":"IPY_MODEL_37a25154c3144eb3ba3fa7d4eac1f6c7"}},"cd790e60a5e9466db209abe06d745623":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_3f0432f225204d96b6041bb327ca1d54","IPY_MODEL_4eb60c8e03bd4d0598cfa16ca4478679","IPY_MODEL_92744e4ecc7545948d25e2267ce543ae"],"layout":"IPY_MODEL_357635536f0b4a399110198698f0ede3"}},"cd9992aa7a844e5a9b008a6dd0e88ea9":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"cde404d1c30f4e0187d570e83562e97a":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_ea14d1775c0d47dc87855a2d9aa4927c","placeholder":"​","style":"IPY_MODEL_97d5fa052b264958845d4abdd6bb170c","value":" 1.04M/1.04M [00:01&lt;00:00, 955kB/s]"}},"cedb734eb66a41fe89566c537c8fe8af":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"d6f4b10125e447ab81c5e4b537e92da6":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a825b0b5778044b28973a6e214d3c33e","placeholder":"​","style":"IPY_MODEL_2a2a87a4c78b4851992bee0c9d664459","value":"Downloading: 100%"}},"daad90ec2847417cba2c088b06a04e3b":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"dd515248ef0f4a7692d22b5342a6c01a":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"e092beefae0a4a4f927b4a9fcc71453c":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HBoxModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_11d8863439724b2fbba1cc45a251793a","IPY_MODEL_644915d9b6d442b39569d0bfb3b173ab","IPY_MODEL_022b715638f14ad3b0a0bd902d04ee40"],"layout":"IPY_MODEL_12df766e00d542f4b0f59d3fa0daee74"}},"e4bd42a517c842228db369d452078236":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"e632fba106be44ce9d0f348b9c2a6642":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"DescriptionStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"e78c99367e36487ba36cf5d2e0dee246":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e7cb60f0fe544408861c4f967a38d250":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"ProgressStyleModel","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"e7d6166efe73473383c363d15e87419a":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_e8af0512ce24409fb80df8251a9bb012","placeholder":"​","style":"IPY_MODEL_a00699fd95e94fb8a60cb6b4e186616f","value":"Downloading builder script: 100%"}},"e8af0512ce24409fb80df8251a9bb012":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"ea14d1775c0d47dc87855a2d9aa4927c":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"efdd0260986346ee8478e0bc717109b1":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f0ab68a9bab8483191f4379d6edc2f1a":{"model_module":"@jupyter-widgets/controls","model_module_version":"1.5.0","model_name":"HTMLModel","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_2248de092340492090f3effc93942afe","placeholder":"​","style":"IPY_MODEL_42ae1aa22c0547cdbb5f6ab63b46652d","value":"Downloading: 100%"}},"f1b671de93e045c1ae06935191be61f6":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"fa1f9546c1314aefbde34c2d85034166":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"feca744e4ec147f29ec62bfeeafcaa7c":{"model_module":"@jupyter-widgets/base","model_module_version":"1.2.0","model_name":"LayoutModel","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}}}}},"nbformat":4,"nbformat_minor":5}