Training in progress, epoch 1

README.md

@@ -0,0 +1,78 @@
+---
+library_name: transformers
+license: apache-2.0
+base_model: google/flan-t5-small
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+model-index:
+- name: flan-t5-small-prompt-compression
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# flan-t5-small-prompt-compression
+
+This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.5181
+- Rouge1: 0.8820
+- Rouge2: 0.7104
+- Rougel: 0.8485
+- Rougelsum: 0.8488
+- Comp Ratio Mean: 0.6611
+- Comp Ratio P90: 0.7674
+- Pct Violations: 0.0
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0001
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Use adafactor and the args are:
+No additional optimizer arguments
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 10
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Comp Ratio Mean | Comp Ratio P90 | Pct Violations |
+|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:---------------:|:--------------:|:--------------:|
+| 1.2576        | 1.0   | 1594  | 0.6457          | 0.8528 | 0.6587 | 0.8197 | 0.8199    | 0.6626          | 0.7736         | 0.0            |
+| 0.7688        | 2.0   | 3188  | 0.5727          | 0.8689 | 0.6851 | 0.8345 | 0.8349    | 0.6647          | 0.7694         | 0.0            |
+| 0.6591        | 3.0   | 4782  | 0.5405          | 0.8750 | 0.6963 | 0.8413 | 0.8417    | 0.6684          | 0.7692         | 0.0            |
+| 0.5957        | 4.0   | 6376  | 0.5333          | 0.8771 | 0.7002 | 0.8438 | 0.8440    | 0.6600          | 0.7660         | 0.0            |
+| 0.548         | 5.0   | 7970  | 0.5212          | 0.8792 | 0.7059 | 0.8467 | 0.8470    | 0.6617          | 0.7648         | 0.0004         |
+| 0.5139        | 6.0   | 9564  | 0.5196          | 0.8799 | 0.7064 | 0.8472 | 0.8473    | 0.6597          | 0.7636         | 0.0            |
+| 0.4862        | 7.0   | 11158 | 0.5144          | 0.8805 | 0.7076 | 0.8473 | 0.8474    | 0.6656          | 0.7705         | 0.0004         |
+| 0.466         | 8.0   | 12752 | 0.5157          | 0.8819 | 0.7098 | 0.8489 | 0.8492    | 0.6622          | 0.7674         | 0.0            |
+| 0.4499        | 9.0   | 14346 | 0.5156          | 0.8816 | 0.7096 | 0.8486 | 0.8489    | 0.6604          | 0.7660         | 0.0            |
+| 0.4393        | 10.0  | 15940 | 0.5181          | 0.8820 | 0.7104 | 0.8485 | 0.8488    | 0.6611          | 0.7674         | 0.0            |
+
+
+### Framework versions
+
+- Transformers 4.57.1
+- Pytorch 2.6.0+cu124
+- Datasets 4.4.1
+- Tokenizers 0.22.1

added_tokens.json

@@ -0,0 +1,102 @@
+{
+  "<extra_id_0>": 32099,
+  "<extra_id_10>": 32089,
+  "<extra_id_11>": 32088,
+  "<extra_id_12>": 32087,
+  "<extra_id_13>": 32086,
+  "<extra_id_14>": 32085,
+  "<extra_id_15>": 32084,
+  "<extra_id_16>": 32083,
+  "<extra_id_17>": 32082,
+  "<extra_id_18>": 32081,
+  "<extra_id_19>": 32080,
+  "<extra_id_1>": 32098,
+  "<extra_id_20>": 32079,
+  "<extra_id_21>": 32078,
+  "<extra_id_22>": 32077,
+  "<extra_id_23>": 32076,
+  "<extra_id_24>": 32075,
+  "<extra_id_25>": 32074,
+  "<extra_id_26>": 32073,
+  "<extra_id_27>": 32072,
+  "<extra_id_28>": 32071,
+  "<extra_id_29>": 32070,
+  "<extra_id_2>": 32097,
+  "<extra_id_30>": 32069,
+  "<extra_id_31>": 32068,
+  "<extra_id_32>": 32067,
+  "<extra_id_33>": 32066,
+  "<extra_id_34>": 32065,
+  "<extra_id_35>": 32064,
+  "<extra_id_36>": 32063,
+  "<extra_id_37>": 32062,
+  "<extra_id_38>": 32061,
+  "<extra_id_39>": 32060,
+  "<extra_id_3>": 32096,
+  "<extra_id_40>": 32059,
+  "<extra_id_41>": 32058,
+  "<extra_id_42>": 32057,
+  "<extra_id_43>": 32056,
+  "<extra_id_44>": 32055,
+  "<extra_id_45>": 32054,
+  "<extra_id_46>": 32053,
+  "<extra_id_47>": 32052,
+  "<extra_id_48>": 32051,
+  "<extra_id_49>": 32050,
+  "<extra_id_4>": 32095,
+  "<extra_id_50>": 32049,
+  "<extra_id_51>": 32048,
+  "<extra_id_52>": 32047,
+  "<extra_id_53>": 32046,
+  "<extra_id_54>": 32045,
+  "<extra_id_55>": 32044,
+  "<extra_id_56>": 32043,
+  "<extra_id_57>": 32042,
+  "<extra_id_58>": 32041,
+  "<extra_id_59>": 32040,
+  "<extra_id_5>": 32094,
+  "<extra_id_60>": 32039,
+  "<extra_id_61>": 32038,
+  "<extra_id_62>": 32037,
+  "<extra_id_63>": 32036,
+  "<extra_id_64>": 32035,
+  "<extra_id_65>": 32034,
+  "<extra_id_66>": 32033,
+  "<extra_id_67>": 32032,
+  "<extra_id_68>": 32031,
+  "<extra_id_69>": 32030,
+  "<extra_id_6>": 32093,
+  "<extra_id_70>": 32029,
+  "<extra_id_71>": 32028,
+  "<extra_id_72>": 32027,
+  "<extra_id_73>": 32026,
+  "<extra_id_74>": 32025,
+  "<extra_id_75>": 32024,
+  "<extra_id_76>": 32023,
+  "<extra_id_77>": 32022,
+  "<extra_id_78>": 32021,
+  "<extra_id_79>": 32020,
+  "<extra_id_7>": 32092,
+  "<extra_id_80>": 32019,
+  "<extra_id_81>": 32018,
+  "<extra_id_82>": 32017,
+  "<extra_id_83>": 32016,
+  "<extra_id_84>": 32015,
+  "<extra_id_85>": 32014,
+  "<extra_id_86>": 32013,
+  "<extra_id_87>": 32012,
+  "<extra_id_88>": 32011,
+  "<extra_id_89>": 32010,
+  "<extra_id_8>": 32091,
+  "<extra_id_90>": 32009,
+  "<extra_id_91>": 32008,
+  "<extra_id_92>": 32007,
+  "<extra_id_93>": 32006,
+  "<extra_id_94>": 32005,
+  "<extra_id_95>": 32004,
+  "<extra_id_96>": 32003,
+  "<extra_id_97>": 32002,
+  "<extra_id_98>": 32001,
+  "<extra_id_99>": 32000,
+  "<extra_id_9>": 32090
+}

config.json

@@ -0,0 +1,61 @@
+{
+  "architectures": [
+    "T5ForConditionalGeneration"
+  ],
+  "classifier_dropout": 0.0,
+  "d_ff": 1024,
+  "d_kv": 64,
+  "d_model": 512,
+  "decoder_start_token_id": 0,
+  "dense_act_fn": "gelu_new",
+  "dropout_rate": 0.05,
+  "dtype": "float32",
+  "eos_token_id": 1,
+  "feed_forward_proj": "gated-gelu",
+  "initializer_factor": 1.0,
+  "is_encoder_decoder": true,
+  "is_gated_act": true,
+  "layer_norm_epsilon": 1e-06,
+  "model_type": "t5",
+  "n_positions": 512,
+  "num_decoder_layers": 8,
+  "num_heads": 6,
+  "num_layers": 8,
+  "output_past": true,
+  "pad_token_id": 0,
+  "relative_attention_max_distance": 128,
+  "relative_attention_num_buckets": 32,
+  "task_specific_params": {
+    "summarization": {
+      "early_stopping": true,
+      "length_penalty": 2.0,
+      "max_length": 200,
+      "min_length": 30,
+      "no_repeat_ngram_size": 3,
+      "num_beams": 4,
+      "prefix": "summarize: "
+    },
+    "translation_en_to_de": {
+      "early_stopping": true,
+      "max_length": 300,
+      "num_beams": 4,
+      "prefix": "translate English to German: "
+    },
+    "translation_en_to_fr": {
+      "early_stopping": true,
+      "max_length": 300,
+      "num_beams": 4,
+      "prefix": "translate English to French: "
+    },
+    "translation_en_to_ro": {
+      "early_stopping": true,
+      "max_length": 300,
+      "num_beams": 4,
+      "prefix": "translate English to Romanian: "
+    }
+  },
+  "tie_word_embeddings": false,
+  "transformers_version": "4.57.1",
+  "use_cache": true,
+  "vocab_size": 32128
+}

generation_config.json

@@ -0,0 +1,10 @@
+{
+  "decoder_start_token_id": 0,
+  "eos_token_id": [
+    1
+  ],
+  "no_repeat_ngram_size": 3,
+  "num_beams": 4,
+  "pad_token_id": 0,
+  "transformers_version": "4.57.1"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:60eff07c615fdd9b287f4df102b2a2c8a837674b2783898a642df0ea449445a5
+size 307867048

run_stats.json

@@ -0,0 +1,19 @@
+{
+  "dataset_stats": {
+    "rows_before_filter": 15000.0,
+    "rows_after_filter": 15000.0,
+    "dropped_for_length": 0.0,
+    "max_input_length": 256.0,
+    "max_target_length": 128.0,
+    "short_threshold": 40.0
+  },
+  "baseline_scores": {
+    "rouge1": 0.25675665009084964,
+    "rouge2": 0.13416016149259882,
+    "rougeL": 0.23903438122862936,
+    "rougeLsum": 0.23864111489830342,
+    "comp_ratio_mean": 0.2556183630363363,
+    "comp_ratio_p90": 0.535846560846561,
+    "pct_violations": 0.0
+  }
+}

samples_all.txt

@@ -0,0 +1,570 @@
+
+
+Epoch 1 — 7650 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(16 tok): summarize: What is measured on the Gay-Lussac scale...
+Pred (1 tok): ...
+Ref  (10 tok): Gay-Lussac scale measures what...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(41 tok): summarize: I would greatly appreciate it if you could kindly provide information about the teams that are regarded as the rivals of the Air Force Falcons football team....
+Pred (1 tok): ...
+Ref  (8 tok): Air Force Falcons football rivals...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(37 tok): summarize: I would greatly appreciate it if you could inform me how many teaspoons correspond to a single tablespoon, thank you very much....
+Pred (1 tok): ...
+Ref  (7 tok): Teaspoons per tablespoon...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 2 — 15300 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(18 tok): summarize: Was gilt als Emma Edmondsons beste Arbeit als Schauspielerin?...
+Pred (1 tok): ...
+Ref  (9 tok): Beste Schauspielarbeit von Emma Edmondson...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(24 tok): summarize: Gib mir eine Liste indischer Gerichte, die ich für eine Hausparty zubereiten kann....
+Pred (1 tok): ...
+Ref  (9 tok): Liste indische Gerichte für Hausparty...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(50 tok): summarize: Pourriez-vous s'il vous plaît me conseiller sur quel auteur russe je devrais lire en premier afin de commencer à découvrir la littérature russe ?...
+Pred (1 tok): ...
+Ref  (10 tok): Premier auteur russe à lire...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 3 — 22950 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(15 tok): summarize: Summarize best way to climb Mount Everest...
+Pred (1 tok): ...
+Ref  (11 tok): Summarize best way to summit Everest...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(32 tok): summarize: Could you please, at your earliest convenience, provide me with some information regarding the identity of Marshall Strickland?...
+Pred (1 tok): ...
+Ref  (6 tok): Who is Marshall Strickland...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(81 tok): summarize: Would you be so kind as to classify each of the following countries according to whether they follow left-hand or right-hand traffic conventions, that is, based on the side of the road on which vehicles typically travel: USA, Spain, UK, India, Singapore, Switzerland, Australia, Egypt, France, and Italy?...
+Pred (1 tok): ...
+Ref  (32 tok): Classify driving side (left/right) for: USA, Spain, UK, India, Singapore, Switzerland, Australia, Egypt, France, Italy...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 1 — 7650 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(16 tok): summarize: What is measured on the Gay-Lussac scale...
+Pred (12 tok): What is measured on Gay-Lussac scale...
+Ref  (10 tok): Gay-Lussac scale measures what...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(41 tok): summarize: I would greatly appreciate it if you could kindly provide information about the teams that are regarded as the rivals of the Air Force Falcons football team....
+Pred (9 tok): Air Force Falcons football team rivals...
+Ref  (8 tok): Air Force Falcons football rivals...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(37 tok): summarize: I would greatly appreciate it if you could inform me how many teaspoons correspond to a single tablespoon, thank you very much....
+Pred (11 tok): How many teaspoons are single tablespoons...
+Ref  (7 tok): Teaspoons per tablespoon...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 2 — 15300 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(18 tok): summarize: Was gilt als Emma Edmondsons beste Arbeit als Schauspielerin?...
+Pred (10 tok): Emma Edmondsons beste Arbeit als Schauspielerin...
+Ref  (9 tok): Beste Schauspielarbeit von Emma Edmondson...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(24 tok): summarize: Gib mir eine Liste indischer Gerichte, die ich für eine Hausparty zubereiten kann....
+Pred (9 tok): Liste indischer Gerichte für Hausparty...
+Ref  (9 tok): Liste indische Gerichte für Hausparty...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(50 tok): summarize: Pourriez-vous s'il vous plaît me conseiller sur quel auteur russe je devrais lire en premier afin de commencer à découvrir la littérature russe ?...
+Pred (22 tok): Quel auteur russe devrais lire en premier pour découvrir la littérature russe...
+Ref  (10 tok): Premier auteur russe à lire...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 3 — 22950 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(15 tok): summarize: Summarize best way to climb Mount Everest...
+Pred (12 tok): Summarize best way to climb Mount Everest...
+Ref  (11 tok): Summarize best way to summit Everest...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(32 tok): summarize: Could you please, at your earliest convenience, provide me with some information regarding the identity of Marshall Strickland?...
+Pred (6 tok): Marshall Strickland identity...
+Ref  (6 tok): Who is Marshall Strickland...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(81 tok): summarize: Would you be so kind as to classify each of the following countries according to whether they follow left-hand or right-hand traffic conventions, that is, based on the side of the road on which vehicles typically travel: USA, Spain, UK, India, Singapore, Switzerland, Australia, Egypt, France, and Italy?...
+Pred (37 tok): Classify each country as left-hand or right-hand traffic conventions: USA, Spain, UK, India, Singapore, Switzerland, Australia, Egypt, France, Italy...
+Ref  (32 tok): Classify driving side (left/right) for: USA, Spain, UK, India, Singapore, Switzerland, Australia, Egypt, France, Italy...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 4 — 30600 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(24 tok): summarize: In welcher Episode erkennt Jon Snow die Autorität von Daenerys Targaryen an?...
+Pred (14 tok): Episode von Jon Snow Autorität von Daenerys Targaryen...
+Ref  (20 tok): In welcher Episode erkennt Jon Snow die Autorität von Daenerys Targaryen an...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(34 tok): summarize: Wie würden Sie die folgenden Sportarten in zwei Gruppen einteilen: Baseball, Bogenschießen, Zehnkampf und Hockey?...
+Pred (23 tok): Wie diese Sportarten in zwei Gruppen einteilen: Baseball, Bogenschießen, Zehnkampf, Hockey...
+Ref  (19 tok): Teile in zwei Gruppen: Baseball, Bogenschießen, Zehnkampf, Hockey...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(28 tok): summarize: Veuillez me donner une liste des cinq principales attractions touristiques à visiter en Europe....
+Pred (11 tok): Liste 5 principales attractions touristiques en Europe...
+Ref  (9 tok): Top 5 attractions touristiques en Europe...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 5 — 38250 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(17 tok): summarize: ¿Qué es una clique en teoría de grafos?...
+Pred (13 tok): Qué es una clique en teoría de grafos...
+Ref  (11 tok): Definir clique en teoría de grafos...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(16 tok): summarize: ¿En qué año se jugó el Ice Bowl?...
+Pred (9 tok): Qué año se jugó Ice Bowl...
+Ref  (5 tok): Año Ice Bowl...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(20 tok): summarize: ¿Podría explicarme qué es un flat white, por favor?...
+Pred (7 tok): Qué es un flat white...
+Ref  (6 tok): Definición de flat white...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 6 — 45900 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(30 tok): summarize: Basierend auf dem untenstehenden Absatz, beschreiben Sie bitte zwei geeignete Anwendungen von Edelgasen....
+Pred (18 tok): Aus dem Absatz, beschreiben Sie zwei geeignete Edelgas-Anwendungen....
+Ref  (17 tok): Aus dem Absatz unten zwei Anwendungen von Edelgasen beschreiben....
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(10 tok): summarize: ¿Qué es PySpark?...
+Pred (3 tok): PySpark...
+Ref  (6 tok): Explica PySpark...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(70 tok): summarize: I would greatly appreciate it if you could please identify all albums released by the band Radiohead, noting both their titles and their respective years of release, and then list them neatly in the format {name} - {year}, separated by semicolons....
+Pred (25 tok): List Radiohead albums with titles and release years; format {name} - {year}, semicolons...
+Ref  (25 tok): Radiohead albums: list {name} - {year} for all albums; semicolon-separated...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 7 — 53550 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(66 tok): summarize: Classifiez les modèles d’avions ci-dessous en fonction des entreprises qui les ont créés : Next-Generation 737, A220, 737 MAX, A350, A330, 747-8, 767, A320, 777, 777X, A380, 787....
+Pred (52 tok): Classifiez les modèles d’avions par entreprises : Next-Generation 737, A220, 737 MAX, A350, A330, 747-8, 767, A320, 777, 777X, A380, 787....
+Ref  (48 tok): Classifiez ces avions par constructeur : Next-Generation 737, A220, 737 MAX, A350, A330, 747-8, 767, A320, 777, 777X, A380, 787....
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(20 tok): summarize: Who composed the 'Moonlight Sonata', and when?...
+Pred (11 tok): Who composed Moonlight Sonata and when...
+Ref  (10 tok): Moonlight Sonata: composer and date...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(26 tok): summarize: What Breaking Bad actor guest starred on Season 6, Episode 2 "Drive" of The X-Files?...
+Pred (21 tok): What Breaking Bad actor guest starred on Season 6, Episode 2 "Drive" of X-Files...
+Ref  (23 tok): Which Breaking Bad actor guest-starred on X-Files S6E2 'Drive'...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 8 — 61200 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(55 tok): summarize: Considering the increasing presence of plastics in our natural surroundings, could you kindly share your thoughts on whether LEGO bricks remain a suitable and beneficial toy choice for children today?...
+Pred (12 tok): Is LEGO bricks useful for children today...
+Ref  (19 tok): Are LEGO bricks still good kids' toy amid rising plastic pollution...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(39 tok): summarize: Quels éléments devrais-je prendre en compte lorsque je décide entre une voiture électrique ou une voiture à essence ?...
+Pred (20 tok): Quels éléments prendre en compte quand je décide électrique ou essence...
+Ref  (17 tok): Facteurs à considérer pour choisir voiture électrique ou essence...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(23 tok): summarize: Quel type de musique est présenté dans l’album The Great Ray Charles ?...
+Pred (14 tok): Quel genre de musique est présenté dans The Great Ray Charles...
+Ref  (12 tok): Genre de l’album The Great Ray Charles...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 9 — 68850 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(28 tok): summarize: ¿Podrías decirme si Twitter llega alguna vez a incumplir sus propias reglas?...
+Pred (10 tok): Twitter a incumplir sus reglas...
+Ref  (11 tok): Twitter incumple sus propias reglas...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(38 tok): summarize: I would greatly appreciate it if you could kindly inform me about the bird that produces the largest egg among all avian species....
+Pred (6 tok): Largest avian egg...
+Ref  (6 tok): Bird with largest egg...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(36 tok): summarize: I would greatly appreciate it if you could take a moment to describe what a pot hole refers to, in clear terms....
+Pred (5 tok): What is pot hole...
+Ref  (5 tok): What is pot hole...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 10 — 76500 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(46 tok): summarize: I would greatly appreciate it if you could kindly furnish me with information regarding the ten latest winners of the Men's Boat Race held between Oxford and Cambridge....
+Pred (16 tok): List 10 latest Oxford–Cambridge Men's Boat Race winners...
+Ref  (16 tok): List last 10 winners of Oxford–Cambridge Men's Boat Race...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(19 tok): summarize: What is the best way to evaluate the performance of my marketing spend?...
+Pred (9 tok): Best way to evaluate marketing spend performance...
+Ref  (9 tok): Best way to evaluate marketing spend performance...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(11 tok): summarize: What is a PFD?...
+Pred (4 tok): PFD definition...
+Ref  (4 tok): PFD definition...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 1 — 8074 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(23 tok): summarize: Welche sind einige der Möglichkeiten, wie die Gesellschaft verbessert werden kann?...
+Pred (6 tok): From s -...
+Ref  (12 tok): Liste einige Möglichkeiten zur Verbesserung der Gesellschaft...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(39 tok): summarize: Según el párrafo que aparece a continuación, ¿cuáles son los parques nacionales más y menos populares de los Estados Unidos?...
+Pred (3 tok): What,...
+Ref  (22 tok): Según párrafo abajo, parques nacionales EE.UU. más y menos populares...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(19 tok): summarize: Wie wird die Reihenfolge des NFL-Drafts festgelegt?...
+Pred (17 tok): Classruption,,,?s,  oderncestoNFLerst,tailsNFLNFL...
+Ref  (11 tok): Wie Reihenfolge NFL-Draft festgelegt...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 2 — 16148 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(55 tok): summarize: Tell me which of these terms are related to artificial intelligence versus gardening: tilling, seed, gradient descent, production, Bayesian optimization, genetically modified organism, heirloom, transfer learning...
+Pred (4 tok): What ,...
+Ref  (43 tok): Classify terms as AI-related or gardening: tilling; seed; gradient descent; production; Bayesian optimization; genetically modified organism; heirloom; transfer learning...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(17 tok): summarize: Who were the major players in the Watergate conspiracy?...
+Pred (2 tok): What...
+Ref  (8 tok): Watergate conspiracy major players...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(19 tok): summarize: What is the average lifespan of a Golden Retriever?...
+Pred (2 tok): What...
+Ref  (9 tok): Golden Retriever average lifespan...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 3 — 24222 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(19 tok): summarize: Wie sollte ich auswählen, welchen Käse ich kaufen soll?...
+Pred (2 tok): List...
+Ref  (9 tok): Wie Käse zum Kaufen auswählen...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(31 tok): summarize: ¿Cuáles son algunos de los principales riesgos relacionados con los grandes modelos de lenguaje?...
+Pred (2 tok): From...
+Ref  (16 tok): Principales riesgos de los grandes modelos de lenguaje...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(33 tok): summarize: ما أكثر ما يزعجك عند استخدام فلاتر البريد الإلكتروني لتنظيم صندوق الوارد لديك؟...
+Pred (5 tok): How, ,...
+Ref  (30 tok): ما أكثر ما يزعجك عند استخدام فلاتر البريد الإلكتروني لتنظيم صندوق الوارد لديك؟...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 1 — 8074 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(23 tok): summarize: Welche sind einige der Möglichkeiten, wie die Gesellschaft verbessert werden kann?...
+Pred (6 tok): From s -...
+Ref  (12 tok): Liste einige Möglichkeiten zur Verbesserung der Gesellschaft...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(39 tok): summarize: Según el párrafo que aparece a continuación, ¿cuáles son los parques nacionales más y menos populares de los Estados Unidos?...
+Pred (3 tok): What,...
+Ref  (22 tok): Según párrafo abajo, parques nacionales EE.UU. más y menos populares...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(19 tok): summarize: Wie wird die Reihenfolge des NFL-Drafts festgelegt?...
+Pred (17 tok): Classruption,,,?s,  oderncestoNFLerst,tailsNFLNFL...
+Ref  (11 tok): Wie Reihenfolge NFL-Draft festgelegt...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 2 — 16148 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(55 tok): summarize: Tell me which of these terms are related to artificial intelligence versus gardening: tilling, seed, gradient descent, production, Bayesian optimization, genetically modified organism, heirloom, transfer learning...
+Pred (4 tok): What ,...
+Ref  (43 tok): Classify terms as AI-related or gardening: tilling; seed; gradient descent; production; Bayesian optimization; genetically modified organism; heirloom; transfer learning...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(17 tok): summarize: Who were the major players in the Watergate conspiracy?...
+Pred (2 tok): What...
+Ref  (8 tok): Watergate conspiracy major players...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(19 tok): summarize: What is the average lifespan of a Golden Retriever?...
+Pred (2 tok): What...
+Ref  (9 tok): Golden Retriever average lifespan...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 3 — 24222 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(19 tok): summarize: Wie sollte ich auswählen, welchen Käse ich kaufen soll?...
+Pred (2 tok): List...
+Ref  (9 tok): Wie Käse zum Kaufen auswählen...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(31 tok): summarize: ¿Cuáles son algunos de los principales riesgos relacionados con los grandes modelos de lenguaje?...
+Pred (2 tok): From...
+Ref  (16 tok): Principales riesgos de los grandes modelos de lenguaje...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(33 tok): summarize: ما أكثر ما يزعجك عند استخدام فلاتر البريد الإلكتروني لتنظيم صندوق الوارد لديك؟...
+Pred (5 tok): How, ,...
+Ref  (30 tok): ما أكثر ما يزعجك عند استخدام فلاتر البريد الإلكتروني لتنظيم صندوق الوارد لديك؟...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 1 — 1594 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(64 tok): How does the estimated weight and speed of Santa’s sleigh—320,000 tons moving at about 650 miles (1,050 km) per second—compare to real-world physics limitations, and what would this mean for reindeer like Dasher, Dancer, and Rudolph?...
+Pred (49 tok): How Santa sleigh weight speed 320,000 tons moving 650 miles (1,050 km) per second compares to real-world physics limitations, what this mean for reindeer like Dasher, Dancer, Rudolph...
+Ref  (37 tok): How Santa sleigh 320000 tons 650 miles 1050 km per second compares real-world physics limits and implications for reindeer Dasher Dancer Rudolph...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(39 tok): During the 2012 Christmas season, what were some of the main highlights of the White House holiday decorations preview on November 28, including the replica of Bo, the Obama's Portuguese Water Dog?...
+Pred (20 tok): Main highlights White House holiday decorations preview November 28 including replica Bo Obama's Portuguese Water Dog replica...
+Ref  (22 tok): Main highlights White House holiday decorations preview Nov 28 2012 Christmas season including Bo replica Obama's Portuguese Water Dog...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(35 tok): What challenges did early participants like Charles Nimmo identify regarding the scalability and international cooperation required for Project Loon to become a viable global Internet solution?...
+Pred (28 tok): What challenges early participants like Charles Nimmo identified regarding scalability international cooperation required for Project Loon become viable global Internet solution...
+Ref  (29 tok): What challenges Charles Nimmo, other early participants identified about scalability, international cooperation needed for Project Loon global Internet viability...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 2 — 3188 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(30 tok): Why is access to the Spireworks app in New York City currently restricted to invited users, and how does this exclusivity affect public participation?...
+Pred (20 tok): Why Spireworks app New York City restricted to invited users, how exclusivity affect public participation...
+Ref  (19 tok): Why Spireworks app access NYC restricted to invited users how exclusivity affects public participation...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(57 tok): How did Sergio Aguero’s performance in Manchester City’s 4-1 victory over Sunderland at the Stadium of Light in December 2014 help the team end its six-year winless streak at that venue since Sheikh Mansour’s 2008 takeover?...
+Pred (40 tok): How Sergio Aguero performance Manchester City 4-1 win over Sunderland Stadium of Light December 2014 helped team end six-year winless streak since Sheikh Mansour 2008 takeover...
+Ref  (41 tok): How Sergio Aguero performance in Manchester City 4-1 win over Sunderland Stadium of Light December 2014 helped end six-year winless streak there since Sheikh Mansour 2008 takeover...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(42 tok): In what ways did the Greater Manchester Police investigate the 2013 online trolling campaign against Michael Le Vell, and what legal challenges did they face in determining whether the material broke contempt of court laws?...
+Pred (31 tok): How Greater Manchester Police investigate 2013 online trolling campaign against Michael Le Vell and what legal challenges they faced determining material broke contempt of court laws...
+Ref  (30 tok): How Greater Manchester Police investigated 2013 online trolling campaign against Michael Le Vell and legal challenges determining if material broke contempt of court laws...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 3 — 4782 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(45 tok): Why did Edward Snowden’s father, Lon Snowden, travel to Moscow in October 2013, and what did he say about the possibility of his son returning to the United States after being granted asylum in Russia?...
+Pred (28 tok): Why Edward Snowden father Lon Snowden travel Moscow October 2013 what he say about possibility son returning United States after asylum granted Russia...
+Ref  (23 tok): Why Lon Snowden travel Moscow October 2013 what he say about Edward Snowden return US after asylum Russia...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(48 tok): What role did U.S. Secretary of State John Kerry and U.K. Foreign Secretary William Hague play in coordinating potential international financial support for Ukraine in late February 2014, and what conditions did they set for such assistance?...
+Pred (29 tok): Role John Kerry and William Hague in coordinating potential international financial support for Ukraine late February 2014 and what conditions they set for such assistance...
+Ref  (23 tok): Role John Kerry, William Hague coordinating international financial support Ukraine late February 2014, conditions set for assistance...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(55 tok): How did the 2008 arrest of Ricardo Gutierrez Vargas, Mexico’s Interpol chief, raise concerns that Interpol’s communications systems and databases may have been compromised, leading the agency’s France-based headquarters to send investigators to Mexico?...
+Pred (33 tok): How 2008 arrest Ricardo Gutierrez Vargas Mexico Interpol chief raised concerns Interpol communications systems databases compromised leading France headquarters to send investigators to Mexico...
+Ref  (32 tok): How 2008 arrest Ricardo Gutierrez Vargas Mexico Interpol chief raised concerns Interpol communications systems databases compromised leading France headquarters send investigators to Mexico...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 4 — 6376 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(56 tok): What were the circumstances that led former Premier League footballer Marlon King to plead guilty to dangerous driving at Nottingham Crown Court in March 2014, and what injuries resulted from the crash on the A46/A17 in Winthorpe, Nottinghamshire?...
+Pred (39 tok): What circumstances led former Premier League footballer Marlon King plead guilty dangerous driving Nottingham Crown Court March 2014 and what injuries caused crash A46/A17 Winthorpe Nottinghamshire...
+Ref  (47 tok): What circumstances led former Premier League footballer Marlon King to plead guilty to dangerous driving at Nottingham Crown Court March 2014 and what injuries resulted from crash on A46/A17 in Winthorpe Nottinghamshire...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(42 tok): How did the emotional impact of being unable to attend her uncle’s funeral in Hampshire serve as a turning point in Kim Freshwater’s decision to lose weight and reclaim her health?...
+Pred (22 tok): How emotional impact unable attend uncle funeral Hampshire shaped Kim Freshwater decision lose weight reclaim health...
+Ref  (16 tok): How missing uncle funeral Hampshire became turning point Kim Freshwater weight loss health recovery...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(46 tok): What role did Robert Seldon Lady, the former CIA base chief in Milan, play in the 2003 extraordinary rendition of Abu Omar, and why did an Italian court convict him and 22 other Americans in 2009?...
+Pred (32 tok): Role Robert Seldon Lady former CIA base chief Milan in 2003 extraordinary Abu Omar rendition and why Italian court convict him 22 other Americans 2009...
+Ref  (31 tok): What role Robert Seldon Lady former CIA base chief Milan played 2003 extraordinary rendition Abu Omar and why Italian court convicted him and 22 Americans 2009...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 5 — 7970 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(63 tok): What evidence did Mexican federal police reportedly seize during the August 2010 searches of Jean Baptiste Kingery Moinssonm’s properties in Mazatlan, Sinaloa, and how might those items be connected to alleged arms trafficking activities for the Sinaloa cartel?...
+Pred (46 tok): What evidence Mexican federal police reportedly seize August 2010 searches Jean Baptiste Kingery Moinssonm properties Mazatlan Sinaloa, how items link alleged arms trafficking Sinalona cartel...
+Ref  (46 tok): What evidence Mexican federal police reportedly seized August 2010 searches Jean Baptiste Kingery Moinssonm properties Mazatlan Sinaloa, how items connected alleged arms trafficking Sinaloa cartel...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(39 tok): According to World Bank data cited in 2024, why does 90% of Uganda’s population still lack access to electricity, and what economic and educational effects does this have on rural families?...
+Pred (21 tok): Why 90% Uganda population lack electricity per World Bank 2024 data, what economic educational effects on rural families...
+Ref  (20 tok): Why 90% Uganda population lack electricity per 2024 World Bank data, economic educational effects on rural families...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(50 tok): Why has the Battersea neighborhood in South-West London, despite its affluent reputation, been described as a crime hotspot in 2011, and what other high-profile violent incidents occurred there around that time?...
+Pred (33 tok): Why Battersea South-West London despite affluent reputation described crime hotspot 2011 what other high-profile violent incidents occurred there...
+Ref  (32 tok): Why Battersea South-West London affluent area called crime hotspot 2011, what other high-profile violent incidents occurred there then...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 6 — 9564 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(40 tok): Why did Pat Ekins decide to sell her house in Middlesbrough, North Yorkshire, without informing her children, and how did this decision affect her relationship with her family afterward?...
+Pred (26 tok): Why Pat Ekins sell house Middlesbrough North Yorkshire without informing children, how decision affect relationship with family afterward...
+Ref  (24 tok): Why Pat Ekins sell house Middlesbrough North Yorkshire without telling children, how decision affect family relationship afterward...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(57 tok): What role did former CIA operative John Kiriakou play in the 2002 capture of al Qaeda member Abu Zubaydah in Faisalabad, Pakistan, and how did he verify Zubaydah’s identity after the raid?...
+Pred (45 tok): Role former CIA operative John Kiriakou in 2002 capture al Qaeda member Abu Zubaydah Faisalabad Pakistan, how he verify Zubaydadah identity after raid...
+Ref  (44 tok): What role former CIA operative John Kiriakou play 2002 capture al Qaeda member Abu Zubaydah Faisalabad Pakistan how he verify Zubaydah identity after raid...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(51 tok): What symptoms did players and spectators experience from the carbon monoxide exposure during the Dells Ducks and Ice Hawks hockey game at the Poppy Waterman Ice Rink in Lake Delton, Wisconsin, and how did medical teams respond?...
+Pred (37 tok): What symptoms players spectators experienced from carbon monoxide exposure Dells Ducks Ice Hawks hockey Poppy Waterman Ice Rink Lake Delton Wisconsin and how medical teams responded...
+Ref  (38 tok): What symptoms players spectators had from carbon monoxide exposure during Dells Ducks Ice Hawks hockey game Poppy Waterman Ice Rink Lake Delton Wisconsin how medical teams responded...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 7 — 11158 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(57 tok): What economic impact did Illinois officials in 2009 predict from the federal government’s purchase and expansion of the Thomson Correctional Center, including estimates for job creation, local investment, and the use of the facility to relieve overcrowding in other U.S. prisons?...
+Pred (32 tok): What economic impact Illinois officials 2009 predicted from federal purchase expansion Thomson Correctional Center including job creation local investment facility relief overcrowding other US prisons...
+Ref  (36 tok): What economic impact Illinois officials 2009 predicted from federal purchase expansion Thomson Correctional Center including job creation local investment use to relieve overcrowding other U.S. prisons...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(46 tok): What evidence did South Korean intelligence officials cite in their 2012 report suggesting that North Korea was preparing for a third nuclear test at the Punggye-ri site, and how did satellite imagery support these claims?...
+Pred (31 tok): What evidence South Korean intelligence officials cite 2012 report suggesting North Korea prepared third nuclear test Punggye-ri site, how satellite imagery supported claims...
+Ref  (31 tok): What evidence South Korean intelligence cite 2012 report suggesting North Korea preparing third nuclear test Punggye-ri site, how satellite imagery supported claims...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(56 tok): According to the China Internet Network Information Center, China had nearly 600 million internet users in 2014. How does this number compare to the 254 million internet users in the United States reported by the Harvard Business Review, and what does it suggest about the growth of internet connectivity in China?...
+Pred (56 tok): According to China Internet Network Information Center, China had nearly 600 million internet users in 2014, how does this number compare to the 254 million Internet users in the United States reported by the Harvard Business Review, and what does it suggest about the growth of internet connectivity in China?...
+Ref  (32 tok): How 2014 China 600M internet users per China Internet Network Information Center compare to US 254M per Harvard Business Review, what it suggest about China internet growth...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 8 — 12752 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(45 tok): What is 'The Message,' the modern-language Bible translation by Eugene Peterson that reportedly stopped two bullets during the February 2014 shooting of Dayton bus driver Rickey Wagoner?...
+Pred (30 tok): What modern-language Bible translation by Eugene Peterson stopping two bullets during February 2014 shooting Dayton bus driver Rickey Wagoner...
+Ref  (38 tok): What is The Message modern-language Bible translation by Eugene Peterson that reportedly stopped two bullets during February 2014 shooting of Dayton bus driver Rickey Wagoner...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(44 tok): How did Generals Lloyd Austin and Martin Dempsey differ or agree on the potential role of U.S. troops in the 2015 offensive to liberate Mosul, Iraq, from ISIS control?...
+Pred (29 tok): How Lloyd Austin Martin Dempsey differ or agree on potential US troops role 2015 offensive liberating Mosul Iraq from ISIS control...
+Ref  (28 tok): How Lloyd Austin Martin Dempsey differ or agree on U.S. troop role in 2015 Mosul offensive against ISIS...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(45 tok): What role did Philly Tech Week play in helping Frank Lee secure approval from Brandywine Realty Trust CEO Gerard Sweeney to stage the giant Pong game on the Circa Centre building in Philadelphia?...
+Pred (36 tok): How Philly Tech Week helped Frank Lee secure approval from Brandywine Realty Trust CEO Gerard Sweeney to stage giant Pong game Circa Centre building Philadelphia...
+Ref  (34 tok): How Philly Tech Week helped Frank Lee get Brandywine Realty Trust CEO Gerard Sweeney approval to stage giant Pong on Circa Centre Philadelphia...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 9 — 14346 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(62 tok): How did the CIA respond to allegations from Majid Shoukat Khan’s lawyers in 2012 that he had been tortured in secret CIA prisons prior to being transferred to Guantanamo Bay, and what justification did the agency provide for its interrogation program?...
+Pred (40 tok): How CIA respond 2012 allegations Majid Shoukat Khan tortured secret CIA prisons before transfer Guantanamo Bay, what justification agency gave for interrogation program...
+Ref  (39 tok): How CIA respond 2012 to Majid Shoukat Khan lawyer allegations torture in secret prisons before Guantanamo transfer, what justification agency gave for interrogation program...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(49 tok): In a 2014 survey conducted by the UK energy company E.ON, why did the British public vote online shopping as the most important technological development of the 21st century, ranking it above innovations like internet banking and mobile internet devices?...
+Pred (27 tok): Why British public vote online shopping most important technological development 21st century 2014 E.ON survey ranking it above internet banking mobile devices...
+Ref  (28 tok): Why British public in 2014 E.ON survey ranked online shopping top 21st-century tech over internet banking, mobile internet devices...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(54 tok): What was the significance of German tennis player Martin Emmrich proposing to Dutch player Michaella Krajicek on the court at the Topshelf Open in Rosmalen, Netherlands in June 2014, and how did the crowd react to the proposal?...
+Pred (32 tok): Significance Martin Emmrich proposing to Michaella Krajicek on Topshelf Open Rosmalen Netherlands June 2014 and crowd reaction...
+Ref  (40 tok): Significance of German tennis player Martin Emmrich proposing to Dutch player Michaella Krajicek on court at Topshelf Open Rosmalen Netherlands June 2014 and crowd reaction...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 10 — 15940 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(49 tok): How did Southern California artist Sandow Birk’s surfing trips in countries such as Indonesia, India, and Morocco influence his decision to begin the 'American Quran' art project after the September 11, 2001 attacks in the United States?...
+Pred (26 tok): How Sandow Birk surfing trips Indonesia India Morocco influenced decision start American Quran art project after September 11 2001 US attacks...
+Ref  (26 tok): How Sandow Birk surfing trips Indonesia India Morocco influenced decision start American Quran project after September 11 2001 attacks United States...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(77 tok): How did stuntman Monte Perlin’s early life in Lake Arrowhead, California, and his experience riding motocross bikes from the age of 10 help prepare him for his later work on major films like 'Spider-Man,' 'Star Trek,' and 'Indiana Jones and the Kingdom of the Crystal Skull'?...
+Pred (39 tok): How Monte Perlin early life Lake Arrowhead California and riding motocross bikes age 10 prepared him for later films Spider-Man Star Trek Indiana Jones Kingdom of the Crystal Skull...
+Ref  (41 tok): How Monte Perlin early life Lake Arrowhead California and motocross experience from age 10 prepared him for stunt work on films Spider-Man Star Trek Indiana Jones and Kingdom of Crystal Skull...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(55 tok): How did critical recognition, such as Rolling Stone naming The Kills’ 2011 album 'Blood Pressures' one of the best albums of the year, influence the band’s sense of identity as an underground act gaining mainstream attention?...
+Pred (37 tok): How critical recognition like Rolling Stone naming The Kills 2011 album Blood Pressures one of best albums of year influenced band sense of identity as underground act gaining mainstream attention...
+Ref  (28 tok): How Rolling Stone naming The Kills 2011 album Blood Pressures best of year affected band identity as underground act gaining mainstream attention...
+----------------------------------------------------------------------------------------------------
+
+
+Epoch 1 — 1594 steps
+----------------------------------------------------------------------------------------------------
+Sample 1
+Input(64 tok): How does the estimated weight and speed of Santa’s sleigh—320,000 tons moving at about 650 miles (1,050 km) per second—compare to real-world physics limitations, and what would this mean for reindeer like Dasher, Dancer, and Rudolph?...
+Pred (49 tok): How Santa sleigh weight speed 320,000 tons moving 650 miles (1,050 km) per second compares to real-world physics limitations, what this mean for reindeer like Dasher, Dancer, Rudolph...
+Ref  (37 tok): How Santa sleigh 320000 tons 650 miles 1050 km per second compares real-world physics limits and implications for reindeer Dasher Dancer Rudolph...
+----------------------------------------------------------------------------------------------------
+Sample 2
+Input(39 tok): During the 2012 Christmas season, what were some of the main highlights of the White House holiday decorations preview on November 28, including the replica of Bo, the Obama's Portuguese Water Dog?...
+Pred (20 tok): Main highlights White House holiday decorations preview November 28 including replica Bo Obama's Portuguese Water Dog replica...
+Ref  (22 tok): Main highlights White House holiday decorations preview Nov 28 2012 Christmas season including Bo replica Obama's Portuguese Water Dog...
+----------------------------------------------------------------------------------------------------
+Sample 3
+Input(35 tok): What challenges did early participants like Charles Nimmo identify regarding the scalability and international cooperation required for Project Loon to become a viable global Internet solution?...
+Pred (28 tok): What challenges early participants like Charles Nimmo identified regarding scalability international cooperation required for Project Loon become viable global Internet solution...
+Ref  (29 tok): What challenges Charles Nimmo, other early participants identified about scalability, international cooperation needed for Project Loon global Internet viability...
+----------------------------------------------------------------------------------------------------

special_tokens_map.json

@@ -0,0 +1,125 @@
+{
+  "additional_special_tokens": [
+    "<extra_id_0>",
+    "<extra_id_1>",
+    "<extra_id_2>",
+    "<extra_id_3>",
+    "<extra_id_4>",
+    "<extra_id_5>",
+    "<extra_id_6>",
+    "<extra_id_7>",
+    "<extra_id_8>",
+    "<extra_id_9>",
+    "<extra_id_10>",
+    "<extra_id_11>",
+    "<extra_id_12>",
+    "<extra_id_13>",
+    "<extra_id_14>",
+    "<extra_id_15>",
+    "<extra_id_16>",
+    "<extra_id_17>",
+    "<extra_id_18>",
+    "<extra_id_19>",
+    "<extra_id_20>",
+    "<extra_id_21>",
+    "<extra_id_22>",
+    "<extra_id_23>",
+    "<extra_id_24>",
+    "<extra_id_25>",
+    "<extra_id_26>",
+    "<extra_id_27>",
+    "<extra_id_28>",
+    "<extra_id_29>",
+    "<extra_id_30>",
+    "<extra_id_31>",
+    "<extra_id_32>",
+    "<extra_id_33>",
+    "<extra_id_34>",
+    "<extra_id_35>",
+    "<extra_id_36>",
+    "<extra_id_37>",
+    "<extra_id_38>",
+    "<extra_id_39>",
+    "<extra_id_40>",
+    "<extra_id_41>",
+    "<extra_id_42>",
+    "<extra_id_43>",
+    "<extra_id_44>",
+    "<extra_id_45>",
+    "<extra_id_46>",
+    "<extra_id_47>",
+    "<extra_id_48>",
+    "<extra_id_49>",
+    "<extra_id_50>",
+    "<extra_id_51>",
+    "<extra_id_52>",
+    "<extra_id_53>",
+    "<extra_id_54>",
+    "<extra_id_55>",
+    "<extra_id_56>",
+    "<extra_id_57>",
+    "<extra_id_58>",
+    "<extra_id_59>",
+    "<extra_id_60>",
+    "<extra_id_61>",
+    "<extra_id_62>",
+    "<extra_id_63>",
+    "<extra_id_64>",
+    "<extra_id_65>",
+    "<extra_id_66>",
+    "<extra_id_67>",
+    "<extra_id_68>",
+    "<extra_id_69>",
+    "<extra_id_70>",
+    "<extra_id_71>",
+    "<extra_id_72>",
+    "<extra_id_73>",
+    "<extra_id_74>",
+    "<extra_id_75>",
+    "<extra_id_76>",
+    "<extra_id_77>",
+    "<extra_id_78>",
+    "<extra_id_79>",
+    "<extra_id_80>",
+    "<extra_id_81>",
+    "<extra_id_82>",
+    "<extra_id_83>",
+    "<extra_id_84>",
+    "<extra_id_85>",
+    "<extra_id_86>",
+    "<extra_id_87>",
+    "<extra_id_88>",
+    "<extra_id_89>",
+    "<extra_id_90>",
+    "<extra_id_91>",
+    "<extra_id_92>",
+    "<extra_id_93>",
+    "<extra_id_94>",
+    "<extra_id_95>",
+    "<extra_id_96>",
+    "<extra_id_97>",
+    "<extra_id_98>",
+    "<extra_id_99>"
+  ],
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

spiece.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86
+size 791656

tokenizer_config.json

@@ -0,0 +1,941 @@
+{
+  "add_prefix_space": true,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32000": {
+      "content": "<extra_id_99>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32001": {
+      "content": "<extra_id_98>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32002": {
+      "content": "<extra_id_97>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32003": {
+      "content": "<extra_id_96>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32004": {
+      "content": "<extra_id_95>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32005": {
+      "content": "<extra_id_94>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32006": {
+      "content": "<extra_id_93>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32007": {
+      "content": "<extra_id_92>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32008": {
+      "content": "<extra_id_91>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32009": {
+      "content": "<extra_id_90>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32010": {
+      "content": "<extra_id_89>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32011": {
+      "content": "<extra_id_88>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32012": {
+      "content": "<extra_id_87>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32013": {
+      "content": "<extra_id_86>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32014": {
+      "content": "<extra_id_85>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32015": {
+      "content": "<extra_id_84>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32016": {
+      "content": "<extra_id_83>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32017": {
+      "content": "<extra_id_82>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32018": {
+      "content": "<extra_id_81>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32019": {
+      "content": "<extra_id_80>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32020": {
+      "content": "<extra_id_79>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32021": {
+      "content": "<extra_id_78>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32022": {
+      "content": "<extra_id_77>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32023": {
+      "content": "<extra_id_76>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32024": {
+      "content": "<extra_id_75>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32025": {
+      "content": "<extra_id_74>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32026": {
+      "content": "<extra_id_73>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32027": {
+      "content": "<extra_id_72>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32028": {
+      "content": "<extra_id_71>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32029": {
+      "content": "<extra_id_70>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32030": {
+      "content": "<extra_id_69>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32031": {
+      "content": "<extra_id_68>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32032": {
+      "content": "<extra_id_67>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32033": {
+      "content": "<extra_id_66>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32034": {
+      "content": "<extra_id_65>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32035": {
+      "content": "<extra_id_64>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32036": {
+      "content": "<extra_id_63>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32037": {
+      "content": "<extra_id_62>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32038": {
+      "content": "<extra_id_61>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32039": {
+      "content": "<extra_id_60>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32040": {
+      "content": "<extra_id_59>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32041": {
+      "content": "<extra_id_58>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32042": {
+      "content": "<extra_id_57>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32043": {
+      "content": "<extra_id_56>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32044": {
+      "content": "<extra_id_55>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32045": {
+      "content": "<extra_id_54>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32046": {
+      "content": "<extra_id_53>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32047": {
+      "content": "<extra_id_52>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32048": {
+      "content": "<extra_id_51>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32049": {
+      "content": "<extra_id_50>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32050": {
+      "content": "<extra_id_49>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32051": {
+      "content": "<extra_id_48>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32052": {
+      "content": "<extra_id_47>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32053": {
+      "content": "<extra_id_46>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32054": {
+      "content": "<extra_id_45>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32055": {
+      "content": "<extra_id_44>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32056": {
+      "content": "<extra_id_43>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32057": {
+      "content": "<extra_id_42>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32058": {
+      "content": "<extra_id_41>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32059": {
+      "content": "<extra_id_40>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32060": {
+      "content": "<extra_id_39>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32061": {
+      "content": "<extra_id_38>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32062": {
+      "content": "<extra_id_37>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32063": {
+      "content": "<extra_id_36>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32064": {
+      "content": "<extra_id_35>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32065": {
+      "content": "<extra_id_34>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32066": {
+      "content": "<extra_id_33>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32067": {
+      "content": "<extra_id_32>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32068": {
+      "content": "<extra_id_31>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32069": {
+      "content": "<extra_id_30>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32070": {
+      "content": "<extra_id_29>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32071": {
+      "content": "<extra_id_28>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32072": {
+      "content": "<extra_id_27>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32073": {
+      "content": "<extra_id_26>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32074": {
+      "content": "<extra_id_25>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32075": {
+      "content": "<extra_id_24>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32076": {
+      "content": "<extra_id_23>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32077": {
+      "content": "<extra_id_22>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32078": {
+      "content": "<extra_id_21>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32079": {
+      "content": "<extra_id_20>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32080": {
+      "content": "<extra_id_19>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32081": {
+      "content": "<extra_id_18>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32082": {
+      "content": "<extra_id_17>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32083": {
+      "content": "<extra_id_16>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32084": {
+      "content": "<extra_id_15>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32085": {
+      "content": "<extra_id_14>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32086": {
+      "content": "<extra_id_13>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32087": {
+      "content": "<extra_id_12>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32088": {
+      "content": "<extra_id_11>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32089": {
+      "content": "<extra_id_10>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32090": {
+      "content": "<extra_id_9>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32091": {
+      "content": "<extra_id_8>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32092": {
+      "content": "<extra_id_7>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32093": {
+      "content": "<extra_id_6>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32094": {
+      "content": "<extra_id_5>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32095": {
+      "content": "<extra_id_4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32096": {
+      "content": "<extra_id_3>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32097": {
+      "content": "<extra_id_2>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32098": {
+      "content": "<extra_id_1>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32099": {
+      "content": "<extra_id_0>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<extra_id_0>",
+    "<extra_id_1>",
+    "<extra_id_2>",
+    "<extra_id_3>",
+    "<extra_id_4>",
+    "<extra_id_5>",
+    "<extra_id_6>",
+    "<extra_id_7>",
+    "<extra_id_8>",
+    "<extra_id_9>",
+    "<extra_id_10>",
+    "<extra_id_11>",
+    "<extra_id_12>",
+    "<extra_id_13>",
+    "<extra_id_14>",
+    "<extra_id_15>",
+    "<extra_id_16>",
+    "<extra_id_17>",
+    "<extra_id_18>",
+    "<extra_id_19>",
+    "<extra_id_20>",
+    "<extra_id_21>",
+    "<extra_id_22>",
+    "<extra_id_23>",
+    "<extra_id_24>",
+    "<extra_id_25>",
+    "<extra_id_26>",
+    "<extra_id_27>",
+    "<extra_id_28>",
+    "<extra_id_29>",
+    "<extra_id_30>",
+    "<extra_id_31>",
+    "<extra_id_32>",
+    "<extra_id_33>",
+    "<extra_id_34>",
+    "<extra_id_35>",
+    "<extra_id_36>",
+    "<extra_id_37>",
+    "<extra_id_38>",
+    "<extra_id_39>",
+    "<extra_id_40>",
+    "<extra_id_41>",
+    "<extra_id_42>",
+    "<extra_id_43>",
+    "<extra_id_44>",
+    "<extra_id_45>",
+    "<extra_id_46>",
+    "<extra_id_47>",
+    "<extra_id_48>",
+    "<extra_id_49>",
+    "<extra_id_50>",
+    "<extra_id_51>",
+    "<extra_id_52>",
+    "<extra_id_53>",
+    "<extra_id_54>",
+    "<extra_id_55>",
+    "<extra_id_56>",
+    "<extra_id_57>",
+    "<extra_id_58>",
+    "<extra_id_59>",
+    "<extra_id_60>",
+    "<extra_id_61>",
+    "<extra_id_62>",
+    "<extra_id_63>",
+    "<extra_id_64>",
+    "<extra_id_65>",
+    "<extra_id_66>",
+    "<extra_id_67>",
+    "<extra_id_68>",
+    "<extra_id_69>",
+    "<extra_id_70>",
+    "<extra_id_71>",
+    "<extra_id_72>",
+    "<extra_id_73>",
+    "<extra_id_74>",
+    "<extra_id_75>",
+    "<extra_id_76>",
+    "<extra_id_77>",
+    "<extra_id_78>",
+    "<extra_id_79>",
+    "<extra_id_80>",
+    "<extra_id_81>",
+    "<extra_id_82>",
+    "<extra_id_83>",
+    "<extra_id_84>",
+    "<extra_id_85>",
+    "<extra_id_86>",
+    "<extra_id_87>",
+    "<extra_id_88>",
+    "<extra_id_89>",
+    "<extra_id_90>",
+    "<extra_id_91>",
+    "<extra_id_92>",
+    "<extra_id_93>",
+    "<extra_id_94>",
+    "<extra_id_95>",
+    "<extra_id_96>",
+    "<extra_id_97>",
+    "<extra_id_98>",
+    "<extra_id_99>"
+  ],
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "extra_ids": 100,
+  "extra_special_tokens": {},
+  "legacy": true,
+  "model_max_length": 512,
+  "pad_token": "<pad>",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "T5Tokenizer",
+  "unk_token": "<unk>"
+}

trainer_log_history.csv

@@ -0,0 +1,22 @@
+loss,grad_norm,learning_rate,epoch,step,eval_loss,eval_rouge1,eval_rouge2,eval_rougeL,eval_rougeLsum,eval_comp_ratio_mean,eval_comp_ratio_p90,eval_pct_violations,eval_runtime,eval_samples_per_second,eval_steps_per_second,train_runtime,train_samples_per_second,train_steps_per_second,total_flos,train_loss
+1.2576,4.137552261352539,9.993726474278545e-05,1.0,1594,,,,,,,,,,,,,,,,
+,,,1.0,1594,0.6456611752510071,0.8528364838438867,0.6586661877158779,0.819669484356327,0.8199279895987595,0.6625529499788416,0.7735849056603774,0.0,348.4597,6.457,0.809,,,,,
+0.7688,2.573607921600342,8.889585947302385e-05,2.0,3188,,,,,,,,,,,,,,,,
+,,,2.0,3188,0.5727154016494751,0.8689474874470693,0.6851048712818919,0.8344968972913525,0.8348697620320389,0.6647169049402463,0.7693568726355614,0.0,351.9831,6.392,0.801,,,,,
+0.6591,2.8348424434661865,7.778474836191274e-05,3.0,4782,,,,,,,,,,,,,,,,
+,,,3.0,4782,0.540533185005188,0.8750090385391008,0.6962724429732516,0.8413137437626381,0.8416859973545814,0.6684329676796582,0.7692307692307693,0.0,348.7712,6.451,0.809,,,,,
+0.5957,3.485762357711792,6.667363725080162e-05,4.0,6376,,,,,,,,,,,,,,,,
+,,,4.0,6376,0.5332812666893005,0.8771052673801956,0.7001549309721768,0.8437587332299845,0.8440177737862178,0.6599911370905979,0.7659574468085106,0.0,349.0362,6.446,0.808,,,,,
+0.548,3.5571165084838867,5.5562526139690505e-05,5.0,7970,,,,,,,,,,,,,,,,
+,,,5.0,7970,0.5211982727050781,0.8791677438074604,0.705867129952528,0.8467215753256596,0.8470289702216209,0.6616752445040748,0.7647977941176471,0.00044444444444444447,349.8527,6.431,0.806,,,,,
+0.5139,2.7198104858398438,4.4451415028579393e-05,6.0,9564,,,,,,,,,,,,,,,,
+,,,6.0,9564,0.519557535648346,0.8798753890192361,0.7063785492018196,0.8472026138402767,0.8473323428755936,0.659716430748814,0.7636363636363637,0.0,349.511,6.438,0.807,,,,,
+0.4862,3.862455129623413,3.334030391746828e-05,7.0,11158,,,,,,,,,,,,,,,,
+,,,7.0,11158,0.5143899917602539,0.8804832259801447,0.7076066408588376,0.8472581234680618,0.8474001918954426,0.6656473506268799,0.7704918032786885,0.00044444444444444447,354.8833,6.34,0.795,,,,,
+0.466,3.4800119400024414,2.2229192806357174e-05,8.0,12752,,,,,,,,,,,,,,,,
+,,,8.0,12752,0.5157203674316406,0.8819074337590058,0.709796994728016,0.848893205872066,0.8492418483342343,0.6622329738091887,0.7674418604651163,0.0,348.7139,6.452,0.809,,,,,
+0.4499,2.951266288757324,1.1118081695246062e-05,9.0,14346,,,,,,,,,,,,,,,,
+,,,9.0,14346,0.5155828595161438,0.8816110197232148,0.7095513359852312,0.8486239346338051,0.8488813378849979,0.6603841749226899,0.7659574468085106,0.0,351.8852,6.394,0.801,,,,,
+0.4393,2.2352824211120605,6.97058413495051e-09,10.0,15940,,,,,,,,,,,,,,,,
+,,,10.0,15940,0.5180955529212952,0.88198348953885,0.7104253099452262,0.848536449353483,0.8488333749106418,0.6611201077120823,0.7674418604651163,0.0,350.1548,6.426,0.805,,,,,
+,,,10.0,15940,,,,,,,,,,,,7097.9611,17.963,2.246,2976335712768000.0,0.6184487030527074

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f69853457e9c7f766c33cb6572ae7a83647dd580e9309b65ed7e66e400b44226
+size 5752