Copy_of_Unsloth_Puzzles.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/ashioyajotham/Daily-ML/blob/main/Copy_of_Unsloth_Puzzles.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "5uwPWn_fCGFo"
      },
      "source": [
        "### 🦥 Unsloth is growing! Come join us :)\n",
        "<div class=\"align-center\">\n",
        "<a href=\"https://unsloth.ai/\"><img src=\"https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png\" width=\"115\"></a>\n",
        "<a href=\"https://discord.gg/unsloth\"><img src=\"https://github.com/unslothai/unsloth/raw/main/images/Discord button.png\" width=\"145\"></a>\n",
        "<a href=\"https://docs.unsloth.ai/\"><img src=\"https://github.com/unslothai/unsloth/blob/main/images/documentation%20green%20button.png?raw=true\" width=\"125\"></a></a>\n",
        "\n",
        "Up to $500K USD salary + bonus equity, health care benefits + other benefits, USA relocation etc! Complete some puzzles and earn points!\n",
        "\n",
        "* We encourage you to use AI for coding!<ins> No experience or PhD / Masters needed</ins> - just get enough points for consideration!\n",
        "* There are <ins>negative points</ins> for incorrect submissions. Read each criteria! Read [Submission](#SUBMISSION) steps.\n",
        "\n",
        "| Role              | Compensation   | Role Description | Points Needed |\n",
        "| ----------------- | -------------- | ----------- | --- |\n",
        "| Founding Engineer | \\$400K to \\$500K & equity | Help push Unsloth forward - bug fixes, core features, UI, kernels, nearly anything! | 47 |\n",
        "| ML Engineer | \\$250K to \\$300K & equity | Help with FSDP2, Float8, Float4, kernels, Unsloth core and more! | 32 |\n",
        "| ML Intern | up to \\$150K py | Implementing specific features in Unsloth core. Can be remote.  | 18 |\n",
        "\n",
        "1. [Convert `nf4` to Triton](#NF4) [Difficulty: Hard] [Max points: 14]\n",
        "2. [Make `QLoRA` work with `FSDP2`](#FSDP2) [Difficulty: Medium to Hard] [Max points: 12]\n",
        "3. [Make `torch.compile` work without graph breaks for QLoRA](#COMPILE) [Difficulty: Easy to Medium] [Max points: 9]\n",
        "4. [Help solve 🦥 Unsloth issues!](#ISSUES) [Difficulty: Varies] [Max points: 12]\n",
        "5. [Memory Efficient Backprop](#MATH) [Difficulty: Medium to Hard] [Max points: 10]\n",
        "6. [Submission steps](#SUBMISSION)\n",
        "\n",
        "### 🦥 Who are we?\n",
        "* 1.58bit DeepSeek R1 GGUFs [Tweet](https://x.com/UnslothAI/status/1883899061893546254) and [HF Model Page](https://huggingface.co/unsloth/DeepSeek-R1-GGUF)\n",
        "* GRPO Llama 3.1 8B on a free Colab [Tweet](https://x.com/UnslothAI/status/1887562753126408210)\n",
        "* Gemma bug fixes [Tweet](https://x.com/danielhanchen/status/1765446273661075609) and bug fixes for Llama 3, Phi 3, Qwen 2.5 [Details](https://unsloth.ai/blog/phi3) Llama-fying Phi-4 [Details](https://unsloth.ai/blog/phi4)\n",
        "* Gradient accumulation bug fixes [Tweet](https://x.com/danielhanchen/status/1846235913443262891) 4bit Dynamic Quantization [Details](https://unsloth.ai/blog/dynamic-4bit)\n",
        "* Unsloth Gradient Checkpointing async offloads activations [Details](https://unsloth.ai/blog/long-context)\n",
        "* 30K Github Stars [Github](https://github.com/unslothai/unsloth) & 7 million monthly downloads on [Hugging Face](https://huggingface.co/unsloth)\n",
        "* PyTorch conference [video](https://www.youtube.com/watch?v=PdtKkc5jB4g) AI Engineer World's Fair [video](https://www.youtube.com/watch?v=pRM_P6UfdIc) GPU / CUDA MODE [talk](https://www.youtube.com/watch?v=hfb_AIhDYnA)\n",
        "\n",
        "\n",
        "### Clarifications:\n",
        "1. We'll compensate you if we interview you but don't hire you\n",
        "2. \\$100-\\$1000 bounties for Task 4\n",
        "3. Submissions must be Apache-2 licensed\n",
        "4. Task 4 involves solving Github issues for OSS Unsloth\n",
        "5. No time limit: rolling basis\n",
        "6. US based preferred"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "F_rx9FYMOc2T"
      },
      "outputs": [],
      "source": [
        "# Code to install Unsloth, Triton, Torch etc\n",
        "%%capture\n",
        "!pip install --no-deps bitsandbytes accelerate xformers==0.0.29 peft trl triton\n",
        "!pip install --no-deps cut_cross_entropy unsloth_zoo\n",
        "!pip install sentencepiece protobuf datasets huggingface_hub hf_transfer\n",
        "!pip install --no-deps unsloth"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "EI_d4FLkR51i"
      },
      "outputs": [],
      "source": [
        "# Helpful functions used through the entire notebook\n",
        "import torch\n",
        "import torch.nn as nn\n",
        "from transformers import set_seed\n",
        "import time\n",
        "import inspect\n",
        "import os\n",
        "major_version, minor_version = torch.cuda.get_device_capability()\n",
        "HAS_BFLOAT16 = (major_version >= 8)\n",
        "from inspect import currentframe as _C, getframeinfo\n",
        "_F = lambda c: getframeinfo(c).lineno # Gets line number\n",
        "WARN = lambda x: print(f\"\\033[31m{x}\\033[0m\") # Red colored warnings\n",
        "\n",
        "# https://stackoverflow.com/questions/18425225/getting-the-name-of-a-variable-as-a-string\n",
        "def NAME(var):\n",
        "    callers_local_vars = inspect.currentframe().f_back.f_locals.items()\n",
        "    names = [var_name for var_name, var_val in callers_local_vars if var_val is var]\n",
        "    return names[0] if len(names) != 0 else \"\"\n",
        "\n",
        "def assert_same(x, y, line, dtype):\n",
        "    assert(x.dtype == dtype)\n",
        "    try: torch.testing.assert_close(x, y, check_stride = True)\n",
        "    except Exception as error:\n",
        "        raise RuntimeError(\n",
        "            f\"Failed allclose at line [{line}]: {NAME(x)}, {NAME(y)}\\n{str(error)}\"\n",
        "        )\n",
        "\n",
        "os.environ[\"HF_HUB_ENABLE_HF_TRANSFER\"] = \"1\""
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "QoE2DGRZG2Ng"
      },
      "source": [
        "---\n",
        "---\n",
        "---\n",
        "<a name=\"NF4\"></a>\n",
        "## A) Convert `nf4` to Triton. [Difficulty: Hard] [Max points: 14]\n",
        "\n",
        "1. Goal: Convert a `nf4` quantized tensor into `fp16` or `bf16` into a *single* Triton kernel The double dequant of the `absmax` and weight forming must be done in 1 Triton kernel. Must work on Tesla T4.\n",
        "2. Must be faster than Unsloth's `fast_dequantize` by 1.15x or more, and not use large intermediate memory buffers.\n",
        "3. Must not use `torch.compile`, but can use `trace.enabled` to help on writing Triton kernels.\n",
        "4. Good material: [Unsloth `fast_dequantize` function](https://github.com/unslothai/unsloth/blob/main/unsloth/kernels/utils.py#L128), also [bitsandbytes `dequantize_blockwise`](https://github.com/bitsandbytes-foundation/bitsandbytes/blob/86b6c37a8ad448230cedb60753f63150b603a112/bitsandbytes/functional.py#L958)\n",
        "5. Use `test_dequantize_function` to test your implementation.\n",
        "6. No CUDA allowed. Custom CUDA inside of the Triton is allowed.\n",
        "7. Watch Tim's videos on Youtube: [8-bit Optimizers](https://www.youtube.com/watch?v=2ETNONas068)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "WKQ9hdqNOXpe",
        "outputId": "d2e34774-0fcc-4939-bd69-7abc836368a0"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.\n",
            "🦥 Unsloth Zoo will now patch everything to make training faster!\n"
          ]
        }
      ],
      "source": [
        "from bitsandbytes.nn import Linear4bit\n",
        "from transformers.activations import ACT2FN\n",
        "from unsloth.kernels.utils import fast_dequantize\n",
        "from peft.utils.integrations import dequantize_module_weight as peft_dequantize\n",
        "def unsloth_dequantize(weight):\n",
        "    return fast_dequantize(weight.weight, weight.weight.quant_state)\n",
        "\n",
        "def bnb_Linear4bit(hd, m, dtype = torch.float16):\n",
        "    return Linear4bit(\n",
        "        hd, m, bias = None,\n",
        "        compute_dtype       = dtype,\n",
        "        compress_statistics = True,\n",
        "        quant_type          = \"nf4\",\n",
        "    )\n",
        "\n",
        "# [NEW] as at 18th Feb 2025\n",
        "def assert_correct_bnb(weight, dtype):\n",
        "    assert(weight.weight.dtype == torch.uint8)\n",
        "    assert(weight.weight.quant_state.dtype == dtype)\n",
        "    assert(weight.weight.quant_state.absmax.dtype == torch.uint8)\n",
        "    assert(weight.weight.quant_state.code.dtype == torch.float32)\n",
        "    assert(weight.weight.quant_state.offset.dtype == torch.float32)\n",
        "    assert(weight.weight.quant_state.blocksize == 64)\n",
        "    assert(weight.weight.quant_state.state2.absmax.dtype == torch.float32)\n",
        "    assert(weight.weight.quant_state.state2.code.dtype == torch.float32)\n",
        "    assert(weight.weight.quant_state.state2.blocksize == 256)\n",
        "\n",
        "class MLP(nn.Module):\n",
        "    def __init__(self, hd = 4096, m = 14336, dtype = torch.float16):\n",
        "        super().__init__()\n",
        "        self.gate_proj = bnb_Linear4bit(hd, m, dtype = dtype).to(\"cuda\")\n",
        "        self.up_proj   = bnb_Linear4bit(hd, m, dtype = dtype).to(\"cuda\")\n",
        "        self.down_proj = bnb_Linear4bit(m, hd, dtype = dtype).to(\"cuda\")\n",
        "        # [NEW] as at 18th Feb 2025\n",
        "        self.gate_proj.weight.quant_state.dtype = dtype\n",
        "        self.up_proj  .weight.quant_state.dtype = dtype\n",
        "        self.down_proj.weight.quant_state.dtype = dtype\n",
        "        self.act_fn = ACT2FN[\"silu\"]\n",
        "    def forward(self, x):\n",
        "        return self.down_proj(self.act_fn(self.gate_proj(x)) * self.up_proj(x))\n",
        "\n",
        "def mlp_forward(X, mlp, fx):\n",
        "    up   = X @ fx(mlp.  up_proj).t()\n",
        "    gate = X @ fx(mlp.gate_proj).t()\n",
        "    h = mlp.act_fn(gate) * up\n",
        "    down = h @ fx(mlp.down_proj).t()\n",
        "    return down\n",
        "\n",
        "def mlp_dequantize(X, mlp, fx):\n",
        "    a = fx(mlp.  up_proj).t(); torch.cuda.synchronize()\n",
        "    b = fx(mlp.gate_proj).t(); torch.cuda.synchronize()\n",
        "    c = fx(mlp.down_proj).t(); torch.cuda.synchronize()\n",
        "    return a, b, c\n",
        "\n",
        "def test_dequantize(dequantize_fx):\n",
        "    elapsed = 0\n",
        "    options = [\n",
        "        (2, 3333, 2048,  8192, 3407, torch.float16),\n",
        "        (5,  777, 1024,  4096, 3409, torch.bfloat16),\n",
        "        (3, 2048, 4096, 14336, 3408, torch.bfloat16),\n",
        "    ]\n",
        "    for (bsz, qlen, hd, m, seed, dt) in options:\n",
        "        set_seed(seed)\n",
        "        torch.set_default_dtype(torch.float32)\n",
        "        mlp = MLP(hd = hd, m = m, dtype = dt)\n",
        "        X = torch.randn((bsz, qlen, hd), device = \"cuda\", dtype = dt)\n",
        "        torch.cuda.synchronize()\n",
        "\n",
        "        # Warmup\n",
        "        for _ in range(2):\n",
        "            assert_same( mlp_forward(X, mlp, dequantize_fx), mlp(X), _F(_C()), dt)\n",
        "            # [NEW] as at 18th Feb 2025\n",
        "            assert_correct_bnb(mlp.  up_proj, dt)\n",
        "            assert_correct_bnb(mlp.gate_proj, dt)\n",
        "            assert_correct_bnb(mlp.down_proj, dt)\n",
        "            a, b, c = mlp_dequantize(X, mlp, dequantize_fx)\n",
        "            A, B, C = mlp_dequantize(X, mlp, unsloth_dequantize)\n",
        "            assert_same(a, A, _F(_C()), dt)\n",
        "            assert_same(b, B, _F(_C()), dt)\n",
        "            assert_same(c, C, _F(_C()), dt)\n",
        "\n",
        "        # Benchmarking\n",
        "        torch.cuda.synchronize()\n",
        "        start = time.time()\n",
        "        for _ in range(1000): mlp_dequantize(X, mlp, dequantize_fx)\n",
        "        elapsed += time.time() - start\n",
        "    return elapsed"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "P9EiO1cu2YKB"
      },
      "source": [
        "For example, we can test our implementation via:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "OM8q3rDX1XfZ",
        "outputId": "38d7a827-e08e-46e1-a76b-3e9d2ec07dba"
      },
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "5.320246934890747"
            ]
          },
          "metadata": {},
          "execution_count": 4
        }
      ],
      "source": [
        "from unsloth.kernels.utils import fast_dequantize\n",
        "def unsloth_dequantize(weight):\n",
        "    return fast_dequantize(weight.weight, weight.weight.quant_state)\n",
        "test_dequantize(unsloth_dequantize)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "nETwlex22lMN"
      },
      "source": [
        "The elapsed time for our implementation over 1000 trials is 5.38 seconds or so.\n",
        "\n",
        "PEFT also has one, which should be mostly identical to Unsloth's version, albeit slightly slower."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Zu5RShLO1h-Y",
        "outputId": "1ea04e15-6bd4-4990-c0d5-2e9637e05141"
      },
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "5.588372230529785"
            ]
          },
          "metadata": {},
          "execution_count": 5
        }
      ],
      "source": [
        "from peft.utils.integrations import dequantize_module_weight as peft_dequantize\n",
        "test_dequantize(peft_dequantize)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "lE5pUaSN3JcM"
      },
      "source": [
        "Write your Triton kernel below, and test it:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "P9ThmhbT2GPi"
      },
      "outputs": [],
      "source": [
        "from triton import jit\n",
        "import triton\n",
        "import triton.language as tl\n",
        "\n",
        "@triton.jit\n",
        "def _your_dequantize_nf4_kernel():\n",
        "    ### TRITON CODE GOES HERE\n",
        "    return\n",
        "\n",
        "def _your_dequantize_nf4(weight, quant_state):\n",
        "    ### SETUP TRITON LAUNCH HERE\n",
        "    return None\n",
        "\n",
        "def your_dequantize_nf4(weight):\n",
        "    return _your_dequantize_nf4(weight.weight.data, weight.weight.quant_state)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "NvvEm6ZH35fB"
      },
      "outputs": [],
      "source": [
        "### TEST IT BELOW:\n",
        "# test_dequantize(your_dequantize_nf4)\n",
        "\n",
        "### CALCULATE SPEEDUP (hopefully 1.15x faster or more)\n",
        "# test_dequantize(unsloth_dequantize) / test_dequantize(your_dequantize_nf4)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "jYaff1Ror8R_"
      },
      "source": [
        "## Marking Criteria for A) Max points = 14\n",
        "```python\n",
        "if attemped_A:\n",
        "    A_score = 0\n",
        "    if single_triton_kernel: A_score += 3\n",
        "    speedup = old_time / new_time\n",
        "    if speedup <= 1.00: A_score -= 3\n",
        "    if speedup >= 1.05: A_score += 1\n",
        "    if speedup >= 1.10: A_score += 2\n",
        "    if speedup >= 1.15: A_score += 2\n",
        "    if kernel_works_in_torch_compile: A_score += 1\n",
        "    else: A_score -= 1\n",
        "    if custom_asm_works: A_score += 3\n",
        "    if uses_cache_eviction: A_score += 1\n",
        "    if tested_in_f16_and_bf16: A_score += 1\n",
        "    else: A_score -= 1\n",
        "    final_score += A_score\n",
        "else:\n",
        "    final_score += 0\n",
        "```"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "uXshnajO44Kb"
      },
      "source": [
        "---\n",
        "---\n",
        "---\n",
        "<a name=\"FSDP2\"></a>\n",
        "## B) Make `QLoRA` work with `FSDP2` [Difficulty: Medium to Hard] [Max points: 10]\n",
        "\n",
        "1. Goal: Write a single Python script to finetune Llama 3.1 8B on 2x or more GPUs with FSDP2.\n",
        "\n",
        "2. You must showcase this working in a free **Kaggle notebook with 2 x Tesla T4 GPUs**.\n",
        "\n",
        "3. Pipeline parallelism is also fine, but must utilize [`zero bubble scheduling`](https://pytorch.org/docs/stable/distributed.pipelining.html#torch.distributed.pipelining.schedules.ScheduleInterleavedZeroBubble) somehow.\n",
        "\n",
        "4. Can use a pre-quantized 4bit BnB safetensor file from [Unsloth's HF page](https://huggingface.co/unsloth) or a full 16bit one, but must do QLoRA.\n",
        "\n",
        "5. Can use `accelerate` but must be FSDP2 or related - you can investigate https://github.com/huggingface/accelerate/pull/3394, Torch Titan, other repos etc.\n",
        "\n",
        "6. Must be fully `transformers` compatible - so we must use `TrainingArguments` and `Trainer`, or `TRL` related classes.\n",
        "\n",
        "7. The loss must be equivalent to single GPU training.\n",
        "\n",
        "8. You must enable all features in FSDP2 - ie showcase offloading, checkpointing, mixed precision training etc.\n",
        "\n",
        "9. You can use `nf4` from `torch AO`, but best from `bitsandbytes`.\n",
        "\n",
        "10. Finally showcase everything working in a free Kaggle 2x Tesla T4 notebook."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "sjo8K1lHAyI0"
      },
      "outputs": [],
      "source": [
        "# HELPFUL functions to undo Unsloth patches:\n",
        "import sys\n",
        "\n",
        "def remove_patched_module(package_name):\n",
        "    modules_to_delete = [\n",
        "        name for name in sys.modules\n",
        "        if name == package_name or name.startswith(package_name + \".\")\n",
        "    ]\n",
        "    for name in modules_to_delete: del sys.modules[name]\n",
        "\n",
        "remove_patched_module(\"trl\")\n",
        "remove_patched_module(\"transformers\")\n",
        "remove_patched_module(\"peft\")\n",
        "remove_patched_module(\"bitsandbytes\")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "0QYoe7A0PwXY"
      },
      "source": [
        "Below is an example script which should run fine in Kaggle 2x Telsa T4s:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 328,
          "referenced_widgets": [
            "d33171e7f9f7435e9609ebce0a7bae64",
            "cb46e9b7a8a540a1a7a09dd64823052b",
            "c402aa198f36471aae5499024f8d6d66",
            "edb68a122c334c5193fe21fde4eedc66",
            "6eadec6ada3640e5827d4a69a4b96132",
            "1f1d6c05ab1547da96a10ca82e003b92",
            "14c092ed314c4dc28b17e8c41e3d70f7",
            "d4d30920fadb42e688e7d935f5d388de",
            "a041a5627ac949068ae137f36a5f4dd0",
            "d8b246969dba462faf712ca1a742ba37",
            "5381b6e7723b41a4b6a7f903759a1a7b",
            "02a7355fe4e4487c9f93adc03b0965c2",
            "d4b583ad5b1841d1b17f7d9e624adb7f",
            "34623fb46fbc43409ecfa76aafde60fb",
            "dccc44fdef36476d9053466e95ef3a03",
            "51befa7ea9444beb974cd898fd269c49",
            "dd0d238272494a9ebab48d9f9b3cc07f",
            "b1ea87cf2c6346db987d9ebe67d970e0",
            "3fec812d653f43aab6daef1ad96b25bb",
            "6b47182ca29c4efba3d1a985bdd6154b",
            "9217b9e57e134811a71c5689dc10dfb3",
            "8393a23d15454a18bbd2daefb7880047",
            "60745962f179450ea4d09848cd469a13",
            "60d5707fab6b4f1cb693caba407ca242",
            "c63f9a8cfc4347c29716689640b82438",
            "171067bb692449deb203d823aaf354ae",
            "4c0e101302144196834f21146ae86a56",
            "87a9db0c3e1342718d2a92a3331b931e",
            "e5f319c7991844e78f5f191e022352eb",
            "9416cc1dc4d2499aa80ed637ecb2524c",
            "ca1bf7a5cb9543f3a6e5d597c99da7cf",
            "c00c50c3e304452993bc14864fd803e1",
            "5c1eea500ca6417e8633e177b7e454f0",
            "4ca05f7a7f2c4a6b9411d932a581b96f",
            "557ccd6d1129493390e9de5af5047803",
            "aa8c7b1f23954bcdb6b6b5307231f324",
            "07a37e2cd57c40f291c453252946d7ae",
            "44f869ff4bbd4774b870a25f1c5ed7d3",
            "feff1dc3c37440c5a1457c4d6fae2814",
            "fb05393aac774c8196da8d2cca207f97",
            "2c2b659c738846818fd669d59ffea530",
            "e5e1e6c9f11f460ba59ebe947bd9c36a",
            "9c85585806d741a88a99732ba74266b8",
            "2ff3472c871842eabb81b1963e59fd63",
            "7bc08a39aa144c3391e9152ab590d345",
            "f9d3ca662f2e479a83d0fbbd40cb2cdd",
            "5c9c61b46fd94e8982fef8dc23c8835d",
            "bd012dbe82844efebf286fdfe6698685",
            "ecf789c2c2054120a7470a7f1c2de51e",
            "0875f4cfb3e04b72870389ade4aca0dc",
            "4f2247c6f3ab484e93c13ea16407784a",
            "e4d6416795d046a69279025141db9028",
            "8db8ffc5db77427080a6adeff922718d",
            "66e1a997a07341dc9e433aeee69796a1",
            "7e304840b3194b63a35429312f60bbd0",
            "8d8e553c2da34ea0b39b8876172feacc",
            "f68b4512f73047a4a34795c4afb8c02e",
            "cd40dcff85454a668104c90c7f7df805",
            "913472fdbb59469698c710707ab23ef9",
            "b5224851afa040f49ad1d627cc1a770c",
            "0ba82e790b954e78b5807e82c4e97e21",
            "7188c0a589c54560ae13f9d438a211d1",
            "7a7535c05c394abf80bc1421bf5aaff5",
            "39763d4b0744409db567dcc5792d6a4d",
            "d91a18b3322c47159f971b4fe6101228",
            "80b51d6d9e66498b8b830282d5ea678d",
            "b10a9ec495a94fd08076841eb67a9e3e",
            "306412737a9c4098a27329966f3f364c",
            "51268827e9d44ce5844f2959646355e9",
            "cae52970160a4a52b3d4a52deda0d96d",
            "35e697a93d4b4040a5b27d67987a2bb6",
            "014be59294894ed6bc68f839cf3de5e9",
            "7c174a9af7624b8584fd63ecc195fd31",
            "3c8ae3592bca4bc0b091b7db4b025c44",
            "60144d2c919744f7b7934c9d523b523a",
            "c8459c680f4d4e46a156714642178fe4",
            "54862b67e81547b197560323e3fedc08",
            "b0780c6be64c46e99bdc40a6044d518d",
            "1ba8c5c7ab9e4552907ca55247d510e2",
            "3a213a5a54b94b14a95a439b5950754b",
            "12ef112247ee4464a9af2496afd2ca56",
            "66427fa7a07a4cc6befa8f4ddf863487",
            "22ae3abacb844fe2b30faff45bb5c1ff",
            "63a697198d7c4eae8fbe7b304f2f9e21",
            "6a02115f60154e6e9a5cc85bddba58b9",
            "988bc7535aba4886adff9a8aaac8ba55",
            "e6c07f50c49f4d6aa3783b535e4c5c06",
            "c9f98890e58d4b91a5b10d4acf765b4f"
          ]
        },
        "id": "fxY0ycaRB4PY",
        "outputId": "b64671d7-512b-4b29-b996-77bcaecd4720"
      },
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "config.json:   0%|          | 0.00/1.53k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "d33171e7f9f7435e9609ebce0a7bae64"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.\n",
            "Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "model.safetensors:   0%|          | 0.00/5.70G [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "02a7355fe4e4487c9f93adc03b0965c2"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "generation_config.json:   0%|          | 0.00/239 [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "60745962f179450ea4d09848cd469a13"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "tokenizer_config.json:   0%|          | 0.00/55.5k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "4ca05f7a7f2c4a6b9411d932a581b96f"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "tokenizer.json:   0%|          | 0.00/17.2M [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "7bc08a39aa144c3391e9152ab590d345"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "special_tokens_map.json:   0%|          | 0.00/454 [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "8d8e553c2da34ea0b39b8876172feacc"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "unified_chip2.jsonl:   0%|          | 0.00/95.6M [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "b10a9ec495a94fd08076841eb67a9e3e"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Generating train split: 0 examples [00:00, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "b0780c6be64c46e99bdc40a6044d518d"
            }
          },
          "metadata": {}
        }
      ],
      "source": [
        "import os\n",
        "os.environ[\"HF_HUB_ENABLE_HF_TRANSFER\"] = \"1\"\n",
        "os.environ[\"CUDA_VISIBLE_DEVICES\"] = \"0,1\"\n",
        "os.environ[\"PYTORCH_CUDA_ALLOC_CONF\"] = \"expandable_segments:True,\"\\\n",
        "    \"roundup_power2_divisions:[32:256,64:128,256:64,>:32]\"\n",
        "\n",
        "from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig\n",
        "from peft import get_peft_model, LoraConfig, TaskType\n",
        "\n",
        "max_seq_length = 2048\n",
        "torch.set_default_dtype(torch.float16)\n",
        "model_name = \"unsloth/meta-Llama-3.1-8B-Instruct-bnb-4bit\"\n",
        "dtype = torch.float16\n",
        "bnb_config = BitsAndBytesConfig(\n",
        "    load_in_4bit              = True,\n",
        "    bnb_4bit_use_double_quant = True,\n",
        "    bnb_4bit_quant_type       = \"nf4\",\n",
        "    bnb_4bit_compute_dtype    = dtype,\n",
        ")\n",
        "model = AutoModelForCausalLM.from_pretrained(\n",
        "    model_name,\n",
        "    device_map = \"auto\",\n",
        "    attn_implementation = \"sdpa\",\n",
        "    quantization_config = bnb_config,\n",
        ")\n",
        "tokenizer = AutoTokenizer.from_pretrained(model_name)\n",
        "tokenizer.padding_side = \"right\"\n",
        "\n",
        "lora_config = LoraConfig(\n",
        "    r = 64,\n",
        "    lora_alpha = 128,\n",
        "    target_modules = [\"q_proj\", \"k_proj\", \"v_proj\", \"o_proj\",\n",
        "                      \"gate_proj\", \"up_proj\", \"down_proj\"],\n",
        "    lora_dropout = 0,\n",
        "    bias = \"none\",\n",
        "    task_type = TaskType.CAUSAL_LM,\n",
        ")\n",
        "\n",
        "# Get LoRA and setup model\n",
        "model = get_peft_model(model, lora_config)\n",
        "with torch.no_grad():\n",
        "    for name, param in model.named_parameters():\n",
        "        if \".lora_A.\" in name or \".lora_B.\" in name: param.requires_grad_(True)\n",
        "        else: param.requires_grad_(False)\n",
        "model.gradient_checkpointing_enable()\n",
        "model.enable_input_require_grads()\n",
        "\n",
        "# Get dataset\n",
        "from datasets import load_dataset\n",
        "from trl import SFTTrainer, SFTConfig\n",
        "url = \"https://huggingface.co/datasets/laion/OIG/resolve/main/unified_chip2.jsonl\"\n",
        "dataset = load_dataset(\"json\", data_files = {\"train\" : url}, split = \"train[:10%]\")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "71dEjjtGmtuH"
      },
      "source": [
        "Reminder your code must have the same loss curve over 60 steps or so."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 600,
          "referenced_widgets": [
            "c78a6c11d9124e5a92920422d122c852",
            "287cc5d4be704e70b9590a67725013ad",
            "4cf101f8733e440ca126ed0128581f8e",
            "2788b87a6db64edf987ea456f2d7269a",
            "749b7205bc35409196003d174ec44375",
            "536152188fd9436fbc936f46aed55e83",
            "d039da580f404715aca774ea535e9c71",
            "2ed9f2257feb45e09d68cd0b96082a1d",
            "1b394c083a144afe9f785e48a31cedb3",
            "ad0d75c3655e418fb4dcbafd0a639632",
            "c68c4c0fc48c42548e7e399a0f7485f7",
            "43e589f13119463ab3f25cbab46d10e7",
            "7954981b42c64509aad1ead118cba61d",
            "9c99c79f2f5e4afbae5c3b1cc342e700",
            "385eb08545164b9f8eb455fc4ef6e097",
            "7b22ea5fd5ca444280d8cf8a43136099",
            "1023af6301f44ebeab7a8d899eb58522",
            "52a6557e482d446ea1e98ffa83441e9b",
            "0cb5711d02dd43218e4955e1be601e54",
            "85e9bbf72bb6422591fe9d84e6acd391",
            "f889097fad314f59ac0f27c097ac28ae",
            "57af46dfdba74fa58bcf7db42a378f60",
            "5b8ef0c9583b4879a7f0ae04a60fb39f",
            "ecb68987b074428380ea39a71ea4560c",
            "995a7668bdc74fb8a4fdec8ca802db4d",
            "1c64b2646537410693cf41f077b9f40f",
            "ae0ace153e6e42429bc80707effc7c97",
            "6630d0e47d2842f7a5261f89e9235ae4",
            "996c93f8e21649fea2720ab9cb8e21fc",
            "f7678cabf31849e493628c4fb260b98e",
            "16129167e0be4d77989b5cfb8d840bd3",
            "9b7470b87b804d868f5430769c230592",
            "b43cf65240104debb35756801cee867b"
          ]
        },
        "id": "BV2WK_wEDtUn",
        "outputId": "57ac1b9a-ca27-4e2f-f894-e44510a2ecbf"
      },
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Applying chat template to train dataset (num_proc=4):   0%|          | 0/21029 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "c78a6c11d9124e5a92920422d122c852"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Tokenizing train dataset (num_proc=4):   0%|          | 0/21029 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "43e589f13119463ab3f25cbab46d10e7"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Tokenizing train dataset (num_proc=4):   0%|          | 0/21029 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "5b8ef0c9583b4879a7f0ae04a60fb39f"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "`use_cache=True` is incompatible with gradient checkpointing. Setting `use_cache=False`.\n",
            "`use_cache=True` is incompatible with gradient checkpointing. Setting `use_cache=False`.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<IPython.core.display.HTML object>"
            ],
            "text/html": [
              "\n",
              "    <div>\n",
              "      \n",
              "      <progress value='10' max='10' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
              "      [10/10 01:23, Epoch 0/1]\n",
              "    </div>\n",
              "    <table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              " <tr style=\"text-align: left;\">\n",
              "      <th>Step</th>\n",
              "      <th>Training Loss</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <td>1</td>\n",
              "      <td>2.039400</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>2</td>\n",
              "      <td>2.254400</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>3</td>\n",
              "      <td>2.649500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>4</td>\n",
              "      <td>1.936600</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>5</td>\n",
              "      <td>1.886300</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>6</td>\n",
              "      <td>1.873100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>7</td>\n",
              "      <td>1.577100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>8</td>\n",
              "      <td>1.687100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>9</td>\n",
              "      <td>1.540900</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>10</td>\n",
              "      <td>1.792700</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table><p>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "TrainOutput(global_step=10, training_loss=1.9237143635749816, metrics={'train_runtime': 91.7565, 'train_samples_per_second': 0.872, 'train_steps_per_second': 0.109, 'total_flos': 461650822987776.0, 'train_loss': 1.9237143635749816})"
            ]
          },
          "metadata": {},
          "execution_count": 10
        }
      ],
      "source": [
        "trainer = SFTTrainer(\n",
        "    model = model,\n",
        "    train_dataset = dataset,\n",
        "    processing_class = tokenizer,\n",
        "    args = SFTConfig(\n",
        "        per_device_train_batch_size = 2,\n",
        "        gradient_accumulation_steps = 4,\n",
        "        warmup_steps = 1,\n",
        "        max_steps = 10,\n",
        "        logging_steps = 1,\n",
        "        output_dir = \"outputs\",\n",
        "        seed = 3407,\n",
        "        max_seq_length = max_seq_length,\n",
        "        fp16 = model.get_input_embeddings().weight.dtype == torch.float16,\n",
        "        bf16 = model.get_input_embeddings().weight.dtype == torch.bfloat16,\n",
        "        report_to = \"none\", # For W&B\n",
        "        dataset_num_proc = 4,\n",
        "    ),\n",
        ")\n",
        "trainer.train()"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "Mnm9AlVvpPhb"
      },
      "outputs": [],
      "source": [
        "del model\n",
        "import gc\n",
        "gc.collect()\n",
        "torch.cuda.empty_cache()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "5vIg_ZjYt1Tq"
      },
      "source": [
        "## Marking Criteria for B) Max points = 10\n",
        "```python\n",
        "if attemped_B:\n",
        "    B_score = 0\n",
        "    if FSDP2_works_with_QLoRA:\n",
        "        if torch_compile_works: B_score += 5\n",
        "        else: B_score += 3\n",
        "        if uses_part_A_and_single_kernel_and_faster: B_score += 3\n",
        "        elif uses_torchAO:\n",
        "            if torchAO_slower_than_BnB: B_score -= 3\n",
        "    elif TP_or_PP_with_QLoRA:\n",
        "        if zero_bubble: B_score += 3\n",
        "        else: B_score += 2\n",
        "    elif FSDP1_works_with_QLoRA:\n",
        "        B_score += 1\n",
        "    if kaggle_notebook_2_tesla_t4_example:\n",
        "        B_score += 2\n",
        "    else:\n",
        "        B_score = 0\n",
        "    final_score += B_score\n",
        "else:\n",
        "    final_score -= 2\n",
        "```"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "pukEsR2YnIHQ"
      },
      "source": [
        "---\n",
        "---\n",
        "---\n",
        "<a name=\"COMPILE\"></a>\n",
        "## C) Make `torch.compile` work without graph breaks for QLoRA [Difficulty: Easy to Medium] [Max points: 9]\n",
        "\n",
        "1. Goal: Write a single Python script like task B), except the goal is to `torch.compile` all modules if possible.\n",
        "\n",
        "2. There must NOT be graph breaks, and excessive re-compilations should not be seen.\n",
        "\n",
        "3. You should have say max 30 compilations. Over 60 is definitely wrong.\n",
        "\n",
        "4. The loss must match with the non compiled module.\n",
        "\n",
        "5. Utilize patching as much as possible.\n",
        "\n",
        "6. Think about which areas might need disabling for compilation. Think about regional compilation. How do we compile sections efficiently?\n",
        "\n",
        "7. Log memory / VRAM usage, and monitor speedups as well.\n",
        "\n",
        "8. Must work for QLoRA.\n",
        "\n",
        "We provided a script below, and showcased how to detect if graph breaks are seen. We also torch compiled the MLP for Llama:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "QFOXncAVNqmK"
      },
      "outputs": [],
      "source": [
        "import torch\n",
        "torch_compile_options = torch_compile_options = {\n",
        "    \"epilogue_fusion\"   : True,\n",
        "    \"max_autotune\"      : True,\n",
        "    \"shape_padding\"     : True,\n",
        "    \"trace.enabled\"     : True,\n",
        "    \"triton.cudagraphs\" : False,\n",
        "}\n",
        "\n",
        "@torch.compile(fullgraph = False, dynamic = True, options = torch_compile_options)\n",
        "def compiled_llama_mlp(self, x):\n",
        "    down_proj = self.down_proj(self.act_fn(self.gate_proj(x)) * self.up_proj(x))\n",
        "    return down_proj\n",
        "\n",
        "import transformers.models.llama.modeling_llama\n",
        "transformers.models.llama.modeling_llama.LlamaMLP.forward = compiled_llama_mlp"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 264,
          "referenced_widgets": [
            "2650669091e449f7a12f3ead7d4c20ad",
            "3dc8d64196b14f4197cd3339742a34bc",
            "7158ed68d61d4d80b2e3747c390fda80",
            "641623b174014cf1a971e3e09acf9164",
            "a2de6c359c5449b19f2f20534b3cddfc",
            "5fdf71c34276475b9f06d1f0f3df43a0",
            "0a3d0e0a03d047a8b90bbe9d98c26f3f",
            "09299fa4aa0e41ce87f9b27df73600f1",
            "4e7bcee3a16949b3a6ea93bba773e43f",
            "92a1f52385ef425eafd685fc7dc351c7",
            "e3a2d60dd4c24aacb6425b4bb0ee066e",
            "83a069d07e62433fbdeccd446629f933",
            "7f598a003c3a46d8b1bc9b9e09961d8f",
            "c8759c84b0cc41d1b26c9ebb8d1c1bd8",
            "6d472692e8ef41568614da4c8524ac90",
            "06831f66e5ea482e93837ee00fce9413",
            "559908d1ab2247e693e273b9da52c5a7",
            "cd3fc5a7061c4ce6b66c3ee70b0dc4ab",
            "4210ab573d8e4eb586989b74b51c7244",
            "5da5844a476641679e995289c3e6701c",
            "7df04b49b6d14d7fb4900c315c1d9369",
            "6186d0196b584ebc9debb77ed3835fc3",
            "85cacea45f094105921c3430f0f9ff16",
            "4120cf65fc154f7aa0f339a0ca9ccf04",
            "a397ac9ead5644e79e3201669253bbee",
            "a2ab9f82bf8949df8fcec7067153ced0",
            "472ff429959940a09c8ba6d08b50991c",
            "0c3c7a2269ab4099b8a9232ccd358fd7",
            "056f3c7e217140e384b934511108a211",
            "2bd03db6056546698822b83c0aae3519",
            "28eef2874a974ffd887bbed667a44161",
            "a97ff63c9116491284dcc086330a68a9",
            "56f84a989c0b4637a5f4695f7e255d03",
            "9867e25e17a24d59935f0fbed4aed30e",
            "3edc46c5a96d4e9c9fea69c1e180abd4",
            "1efa9da14cd94d0e9e50d97fa326fe74",
            "86febc74651a47ffb4d02ee4e34340de",
            "eeff3f5036cb4642a6cdbf34f1342c07",
            "d2161b9b632d4c2e9ad5667c189ce7bf",
            "52eb5d70f7d540c28ce8e39d7eb3569e",
            "67ea2cdb7b424448882e76b8f7fa767d",
            "6df34bb109bc49909b15b58a76027d04",
            "fb452d291e9f42c5ba93f4a7a4a17ca7",
            "e1cd8b04457b4943b6027cde16089378",
            "358313f3922d439fa511a83f01faa2db",
            "28c1d59998ea4c278f75b9f1fb8f62ca",
            "e730ff355cb4498e83cbc92e5edd7274",
            "1705fd65a03a4e4e9b5d9b5a09691a2f",
            "1e9a88491bf6473db41743d92ff3dbe7",
            "4e374cbbaa1849f5856bae0e3023352e",
            "c5c42f84490340e78c0f972c3108ed47",
            "d6ece92b44074841bda3a29889fa0363",
            "61ec012bc6b242f39b8b67e47db3b6b4",
            "fcf382a7918641ebb174928df69ce161",
            "00e10167b3164042bee7a2495181e2f0",
            "f9d5827a6d9648fd812228e9af59495b",
            "f9aa215287dd4b6aa89530e7454be6e0",
            "713ff98c8a4e4703a843ebf5fdcf7bc7",
            "1e7e6d5390804c12a0d14481686fdaec",
            "9045d8eca08b4889a8706893de6702b9",
            "201b0ed743184b73ae61038d5552c233",
            "221f4d520dc7498fad01f741688e7606",
            "8654cb9bfe994d0fa53a3dbde9a2e38e",
            "ec1df11660394fc69591c3f1c946b406",
            "369110b87c79404b9e4e9dea18d3ab99",
            "42abe8c63c4d46bdbc7077f0d546f2d8"
          ]
        },
        "id": "WmoQzMDzm1zL",
        "outputId": "34baecbb-30b6-4057-ae96-c4c0f0017e7a"
      },
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "config.json:   0%|          | 0.00/1.52k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "2650669091e449f7a12f3ead7d4c20ad"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.\n",
            "Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "model.safetensors:   0%|          | 0.00/1.03G [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "83a069d07e62433fbdeccd446629f933"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "generation_config.json:   0%|          | 0.00/234 [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "85cacea45f094105921c3430f0f9ff16"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "tokenizer_config.json:   0%|          | 0.00/54.7k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "9867e25e17a24d59935f0fbed4aed30e"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "tokenizer.json:   0%|          | 0.00/17.2M [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "358313f3922d439fa511a83f01faa2db"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "special_tokens_map.json:   0%|          | 0.00/454 [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "f9d5827a6d9648fd812228e9af59495b"
            }
          },
          "metadata": {}
        }
      ],
      "source": [
        "from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig\n",
        "from peft import get_peft_model, LoraConfig, TaskType\n",
        "os.environ[\"HF_HUB_ENABLE_HF_TRANSFER\"] = \"1\"\n",
        "os.environ[\"CUDA_VISIBLE_DEVICES\"] = \"0,1\"\n",
        "os.environ[\"PYTORCH_CUDA_ALLOC_CONF\"] = \\\n",
        "    \"expandable_segments:True,\"\\\n",
        "    \"roundup_power2_divisions:[32:256,64:128,256:64,>:32]\"\n",
        "\n",
        "max_seq_length = 1024\n",
        "torch.set_default_dtype(torch.float16)\n",
        "model_name = \"unsloth/Llama-3.2-1B-Instruct-bnb-4bit\"\n",
        "dtype = torch.float16\n",
        "bnb_config = BitsAndBytesConfig(\n",
        "    load_in_4bit              = True,\n",
        "    bnb_4bit_use_double_quant = True,\n",
        "    bnb_4bit_quant_type       = \"nf4\",\n",
        "    bnb_4bit_compute_dtype    = dtype,\n",
        ")\n",
        "model = AutoModelForCausalLM.from_pretrained(\n",
        "    model_name,\n",
        "    device_map = \"auto\",\n",
        "    attn_implementation = \"sdpa\",\n",
        "    quantization_config = bnb_config,\n",
        ")\n",
        "tokenizer = AutoTokenizer.from_pretrained(model_name)\n",
        "tokenizer.padding_side = \"right\"\n",
        "\n",
        "lora_config = LoraConfig(\n",
        "    r = 32,\n",
        "    lora_alpha = 64,\n",
        "    target_modules = [\"q_proj\", \"k_proj\", \"v_proj\", \"o_proj\",\n",
        "                      \"gate_proj\", \"up_proj\", \"down_proj\"],\n",
        "    lora_dropout = 0,\n",
        "    bias = \"none\",\n",
        "    task_type = TaskType.CAUSAL_LM,\n",
        ")\n",
        "\n",
        "# Get LoRA and setup model\n",
        "model = get_peft_model(model, lora_config)\n",
        "with torch.no_grad():\n",
        "    for name, param in model.named_parameters():\n",
        "        if \".lora_A.\" in name or \".lora_B.\" in name: param.requires_grad_(True)\n",
        "        else: param.requires_grad_(False)\n",
        "\n",
        "# Currently GC will cause torch.compile to be disabled, so disable it\n",
        "# model.gradient_checkpointing_enable()\n",
        "model.enable_input_require_grads()\n",
        "\n",
        "# Get dataset\n",
        "from datasets import load_dataset\n",
        "from trl import SFTTrainer, SFTConfig\n",
        "url = \"https://huggingface.co/datasets/laion/OIG/resolve/main/unified_chip2.jsonl\"\n",
        "dataset = load_dataset(\"json\", data_files = {\"train\" : url}, split = \"train[:10%]\")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "TbVNGNQ5LlpJ"
      },
      "source": [
        "We provide full logging for `torch.compile` like below:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "EsekFGdsK5hZ"
      },
      "outputs": [],
      "source": [
        "# Must show all graph breaks are not seen with torch.compile\n",
        "import os\n",
        "os.environ[\"TORCHDYNAMO_VERBOSE\"] = \"1\"\n",
        "os.environ[\"TORCHINDUCTOR_FORCE_DISABLE_CACHES\"] = \"1\"\n",
        "os.environ[\"TORCHINDUCTOR_COMPILE_THREADS\"] = \"1\"\n",
        "\n",
        "import logging\n",
        "torch._inductor.config.debug = True\n",
        "torch._logging.set_logs(\n",
        "    dynamo = logging.WARN,\n",
        "    inductor = logging.WARN,\n",
        "    graph_breaks = True,\n",
        "    recompiles = True,\n",
        "    recompiles_verbose = True,\n",
        "    compiled_autograd_verbose = True,\n",
        "    # aot_joint_graph = True, # Enable for more logs\n",
        "    # aot_graphs = True,\n",
        ")\n",
        "torch._dynamo.config.verbose = True\n",
        "torch._dynamo.config.suppress_errors = False"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "7RdragY7P-dL"
      },
      "source": [
        "When we execute the code below, we can see graph breaks - remove them."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000,
          "referenced_widgets": [
            "c569982bf1e1461d8420942006eddd7e",
            "ad0a04a22dd04eabaeae0375b424ac94",
            "e9c7b3bd81f34747b3b6cf8189788cb4",
            "a6552b94ea344a7fa53a35352c1743ef",
            "088c6c53f266406bba3f1614492793bc",
            "1342101e639f42bba05a1ecdee4ae5b0",
            "a5f0590c337143f18de2cae6220438c0",
            "2f6e799457e241e6803979f9d63126fe",
            "6116da2861ec4bb9ab7f3dc3dd062828",
            "6d137f63d0f14053be7df4a557587e7b",
            "bd35c05cb1c24645a8379085af5c5087",
            "899129dc4b1a440189ad260c70719e9e",
            "63819eb6a68a4bbcb86097deca94fad2",
            "4c9e79a8ca6246c19abfc0136bc6c9ef",
            "3d9be9df29a24dc39da2790c62022c3e",
            "102f47d56b884467aac72e6c92410945",
            "5bcf49bfcc9f4bd98aefec9914362d67",
            "27f1aef7f00749a49429b62ea8e24c77",
            "68b99acc74a043f4a3c8863deef2b38e",
            "e44f6f098c554a268849d0e9854da9ab",
            "5584dee86489456fa5081d28cf3ae894",
            "d72981c7760e492bb99010baef06488e",
            "aa58e4a7a57c4f9a810d8e6bd6f8d8ef",
            "99545b5498674edb9e06f9b71f8eb860",
            "9b59528418774c1586b3fd637af6d730",
            "cb79e36afe3f484198b0215bd0180260",
            "d3e11401c1e34bd3a1e283f68e566180",
            "e5b705fdc1584bd1978b9dd83a63f356",
            "e057e275c41d4d3590450cb0696b5768",
            "890f8f47485f43f1903fd7d382c6f5db",
            "2c4f42c69e9946eebb9d17b0968e4550",
            "1246631ec02242d9a8ce291332dc2bb5",
            "fc51618d304c4eb0820a1a443223e654"
          ]
        },
        "id": "wHOBZGLepYgg",
        "outputId": "15228920-f7af-4a6b-8039-4ca637824ff5"
      },
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Applying chat template to train dataset (num_proc=4):   0%|          | 0/21029 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "c569982bf1e1461d8420942006eddd7e"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Tokenizing train dataset (num_proc=4):   0%|          | 0/21029 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "899129dc4b1a440189ad260c70719e9e"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Tokenizing train dataset (num_proc=4):   0%|          | 0/21029 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "aa58e4a7a57c4f9a810d8e6bd6f8d8ef"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"<ipython-input-12-7786d8f77241>\", line 12, in compiled_llama_mlp\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     down_proj = self.down_proj(self.act_fn(self.gate_proj(x)) * self.up_proj(x))\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/peft/tuners/lora/bnb.py\", line 496, in forward\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     result = self.base_layer(x, *args, **kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/nn/modules.py\", line 484, in forward\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return bnb.matmul_4bit(x, self.weight.t(), bias=bias, quant_state=self.weight.quant_state).to(inp_dtype)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/lazy.py\", line 156, in realize_and_forward\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return getattr(self.realize(), name)(*args, **kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/nn_module.py\", line 899, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return variables.UserFunctionVariable(fn, source=source).call_function(\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 1680, in CALL_FUNCTION_EX\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self.call_function(fn, argsvars.items, kwargsvars)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/lazy.py\", line 156, in realize_and_forward\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return getattr(self.realize(), name)(*args, **kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/nn_module.py\", line 899, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return variables.UserFunctionVariable(fn, source=source).call_function(\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 796, in call_method\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     return super().call_method(tx, name, args, kwargs)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/base.py\", line 343, in call_method\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     unimplemented(f\"call_method {self} {name} {args} {kwargs}\")\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:14.558000 1548 torch/_dynamo/symbolic_convert.py:617] [0/0] [__graph_breaks] torch._dynamo.exc.Unsupported: call_method UserDefinedObjectVariable(Params4bit) t [] {}\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/peft/tuners/lora/bnb.py\", line 496, in forward\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     result = self.base_layer(x, *args, **kwargs)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/nn/modules.py\", line 484, in forward\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return bnb.matmul_4bit(x, self.weight.t(), bias=bias, quant_state=self.weight.quant_state).to(inp_dtype)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 1680, in CALL_FUNCTION_EX\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     self.call_function(fn, argsvars.items, kwargsvars)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/lazy.py\", line 156, in realize_and_forward\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return getattr(self.realize(), name)(*args, **kwargs)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/nn_module.py\", line 899, in call_function\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return variables.UserFunctionVariable(fn, source=source).call_function(\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 796, in call_method\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     return super().call_method(tx, name, args, kwargs)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/base.py\", line 343, in call_method\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     unimplemented(f\"call_method {self} {name} {args} {kwargs}\")\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:14.643000 1548 torch/_dynamo/symbolic_convert.py:617] [1/0] [__graph_breaks] torch._dynamo.exc.Unsupported: call_method UserDefinedObjectVariable(Params4bit) t [] {}\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/nn/modules.py\", line 484, in forward\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]     return bnb.matmul_4bit(x, self.weight.t(), bias=bias, quant_state=self.weight.quant_state).to(inp_dtype)\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 796, in call_method\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]     return super().call_method(tx, name, args, kwargs)\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/base.py\", line 343, in call_method\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]     unimplemented(f\"call_method {self} {name} {args} {kwargs}\")\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:14.718000 1548 torch/_dynamo/symbolic_convert.py:617] [2/0] [__graph_breaks] torch._dynamo.exc.Unsupported: call_method UserDefinedObjectVariable(Params4bit) t [] {}\n",
            "W0218 11:31:18.741000 1548 torch/_inductor/debug.py:434] [2/0_1] model__0_forward_1 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__0_forward_1.0\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/autograd/_functions.py\", line 533, in matmul_4bit\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return MatMul4Bit.apply(A, B, out, bias, quant_state)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/autograd/_functions.py\", line 462, in forward\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     output = torch.nn.functional.linear(A, F.dequantize_4bit(B, quant_state).to(A.dtype).t(), bias)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1352, in dequantize_4bit\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     absmax = dequantize_blockwise(quant_state.absmax, quant_state.state2)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1029, in dequantize_blockwise\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     get_ptr(quant_state.code),\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 774, in call_method\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return self.call_apply(tx, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 699, in call_apply\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     ).call_function(tx, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/higher_order_ops.py\", line 2015, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     (fwd_out, _), fwd_graph, fwd_freevars = speculate_subgraph(\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]                                             ^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/higher_order_ops.py\", line 533, in speculate_subgraph\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     raise ex\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/higher_order_ops.py\", line 462, in speculate_subgraph\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     output = f.call_function(tx, args, sub_kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:18.915000 1548 torch/_dynamo/symbolic_convert.py:617] [5/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "W0218 11:31:18.962000 1548 torch/_inductor/debug.py:434] [5/0_1] model__1_inference_2 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__1_inference_2.1\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/autograd/_functions.py\", line 462, in forward\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     output = torch.nn.functional.linear(A, F.dequantize_4bit(B, quant_state).to(A.dtype).t(), bias)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1352, in dequantize_4bit\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     absmax = dequantize_blockwise(quant_state.absmax, quant_state.state2)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1029, in dequantize_blockwise\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     get_ptr(quant_state.code),\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:19.033000 1548 torch/_dynamo/symbolic_convert.py:617] [6/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "W0218 11:31:19.086000 1548 torch/_inductor/debug.py:434] [6/0_1] model__2_inference_3 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__2_inference_3.2\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1352, in dequantize_4bit\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     absmax = dequantize_blockwise(quant_state.absmax, quant_state.state2)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1029, in dequantize_blockwise\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     get_ptr(quant_state.code),\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:19.171000 1548 torch/_dynamo/symbolic_convert.py:617] [7/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "W0218 11:31:19.213000 1548 torch/_inductor/debug.py:434] [7/0_1] model__3_inference_4 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__3_inference_4.3\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1029, in dequantize_blockwise\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     get_ptr(quant_state.code),\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:19.291000 1548 torch/_dynamo/symbolic_convert.py:617] [8/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "W0218 11:31:20.216000 1548 torch/_inductor/debug.py:434] [8/0_1] model__4_inference_5 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__4_inference_5.4\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.277000 1548 torch/_dynamo/symbolic_convert.py:617] [9/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1030, in torch_dynamo_resume_in_dequantize_blockwise_at_1029\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     get_ptr(A),\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.303000 1548 torch/_dynamo/symbolic_convert.py:617] [10/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "V0218 11:31:20.356000 1548 torch/_dynamo/guards.py:2811] [9/1] [__recompiles_verbose] Recompiling function get_ptr in /usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py:485\n",
            "V0218 11:31:20.356000 1548 torch/_dynamo/guards.py:2811] [9/1] [__recompiles_verbose]     triggered by the following guard failure(s):\n",
            "V0218 11:31:20.356000 1548 torch/_dynamo/guards.py:2811] [9/1] [__recompiles_verbose]     guard 0 failures:\n",
            "V0218 11:31:20.356000 1548 torch/_dynamo/guards.py:2811] [9/1] [__recompiles_verbose]     - 9/0: tensor 'L['A']' dtype mismatch. expected Float, actual Byte\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.364000 1548 torch/_dynamo/symbolic_convert.py:617] [9/1] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1031, in torch_dynamo_resume_in_dequantize_blockwise_at_1030\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     get_ptr(absmax),\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.409000 1548 torch/_dynamo/symbolic_convert.py:617] [11/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1032, in torch_dynamo_resume_in_dequantize_blockwise_at_1031\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     get_ptr(out),\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.498000 1548 torch/_dynamo/symbolic_convert.py:617] [12/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1033, in torch_dynamo_resume_in_dequantize_blockwise_at_1032\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     ct.c_int(quant_state.blocksize),\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/polyfills/__init__.py\", line 144, in instantiate_user_defined_class_object\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     obj = cls.__new__(cls, *args, **kwargs)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 563, in call_function\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     return tx.inline_user_function_return(\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 1680, in CALL_FUNCTION_EX\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     self.call_function(fn, argsvars.items, kwargsvars)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 727, in call_function\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     unimplemented(msg)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.553000 1548 torch/_dynamo/symbolic_convert.py:617] [13/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Graph break due to unsupported builtin None._SimpleCData.__new__. This function is either a Python builtin (e.g. _warnings.warn) or a third-party C/C++ Python extension (perhaps created with pybind). If it is a Python builtin, please file an issue on GitHub so the PyTorch team can add support for it and see the next case for a workaround. If it is a third-party C/C++ Python extension, please either wrap it into a PyTorch-understood custom operator (see https://pytorch.org/tutorials/advanced/custom_ops_landing_page.html for more details) or, if it is traceable, use torch.compiler.allow_in_graph.\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1034, in torch_dynamo_resume_in_dequantize_blockwise_at_1033\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     ct.c_int(A.numel()),\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/polyfills/__init__.py\", line 144, in instantiate_user_defined_class_object\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     obj = cls.__new__(cls, *args, **kwargs)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 563, in call_function\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     return tx.inline_user_function_return(\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 1680, in CALL_FUNCTION_EX\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     self.call_function(fn, argsvars.items, kwargsvars)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 727, in call_function\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     unimplemented(msg)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.623000 1548 torch/_dynamo/symbolic_convert.py:617] [14/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Graph break due to unsupported builtin None._SimpleCData.__new__. This function is either a Python builtin (e.g. _warnings.warn) or a third-party C/C++ Python extension (perhaps created with pybind). If it is a Python builtin, please file an issue on GitHub so the PyTorch team can add support for it and see the next case for a workaround. If it is a third-party C/C++ Python extension, please either wrap it into a PyTorch-understood custom operator (see https://pytorch.org/tutorials/advanced/custom_ops_landing_page.html for more details) or, if it is traceable, use torch.compiler.allow_in_graph.\n",
            "W0218 11:31:20.654000 1548 torch/_inductor/debug.py:434] [14/0_1] model__5_inference_6 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__5_inference_6.5\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1035, in torch_dynamo_resume_in_dequantize_blockwise_at_1034\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     _get_tensor_stream(A),\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 482, in _get_tensor_stream\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     return ct.c_void_p(torch._C._cuda_getCurrentRawStream(tensor.device.index))\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/torch.py\", line 897, in call_function\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     tensor_variable = wrap_fx_proxy(\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]                       ^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/builder.py\", line 2037, in wrap_fx_proxy\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     return wrap_fx_proxy_cls(target_cls=TensorVariable, **kwargs)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/builder.py\", line 2333, in wrap_fx_proxy_cls\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     unimplemented(\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.705000 1548 torch/_dynamo/symbolic_convert.py:617] [15/0] [__graph_breaks] torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function <built-in function _cuda_getCurrentRawStream>\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 482, in _get_tensor_stream\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]     return ct.c_void_p(torch._C._cuda_getCurrentRawStream(tensor.device.index))\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/torch.py\", line 897, in call_function\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]     tensor_variable = wrap_fx_proxy(\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]                       ^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/builder.py\", line 2037, in wrap_fx_proxy\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]     return wrap_fx_proxy_cls(target_cls=TensorVariable, **kwargs)\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/builder.py\", line 2333, in wrap_fx_proxy_cls\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]     unimplemented(\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.759000 1548 torch/_dynamo/symbolic_convert.py:617] [16/0] [__graph_breaks] torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function <built-in function _cuda_getCurrentRawStream>\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 482, in torch_dynamo_resume_in__get_tensor_stream_at_482\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     return ct.c_void_p(torch._C._cuda_getCurrentRawStream(tensor.device.index))\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/polyfills/__init__.py\", line 144, in instantiate_user_defined_class_object\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     obj = cls.__new__(cls, *args, **kwargs)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/lazy.py\", line 156, in realize_and_forward\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     return getattr(self.realize(), name)(*args, **kwargs)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 563, in call_function\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     return tx.inline_user_function_return(\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 1680, in CALL_FUNCTION_EX\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     self.call_function(fn, argsvars.items, kwargsvars)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 727, in call_function\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     unimplemented(msg)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.779000 1548 torch/_dynamo/symbolic_convert.py:617] [17/0] [__graph_breaks] torch._dynamo.exc.Unsupported: Graph break due to unsupported builtin None._SimpleCData.__new__. This function is either a Python builtin (e.g. _warnings.warn) or a third-party C/C++ Python extension (perhaps created with pybind). If it is a Python builtin, please file an issue on GitHub so the PyTorch team can add support for it and see the next case for a workaround. If it is a third-party C/C++ Python extension, please either wrap it into a PyTorch-understood custom operator (see https://pytorch.org/tutorials/advanced/custom_ops_landing_page.html for more details) or, if it is traceable, use torch.compiler.allow_in_graph.\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1043, in torch_dynamo_resume_in_dequantize_blockwise_at_1035\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]     lib.cdequantize_blockwise_fp32(*args)\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 1680, in CALL_FUNCTION_EX\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]     self.call_function(fn, argsvars.items, kwargsvars)\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/lazy.py\", line 156, in realize_and_forward\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]     return getattr(self.realize(), name)(*args, **kwargs)\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 928, in call_function\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]     return self.call_method(tx, \"__call__\", args, kwargs)\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 796, in call_method\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]     return super().call_method(tx, name, args, kwargs)\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/base.py\", line 343, in call_method\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]     unimplemented(f\"call_method {self} {name} {args} {kwargs}\")\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.798000 1548 torch/_dynamo/symbolic_convert.py:617] [18/0] [__graph_breaks] torch._dynamo.exc.Unsupported: call_method UserDefinedObjectVariable(_FuncPtr) __call__ [LazyVariableTracker(), LazyVariableTracker(), LazyVariableTracker(), LazyVariableTracker(), LazyVariableTracker(), LazyVariableTracker(), LazyVariableTracker()] {}\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 1363, in torch_dynamo_resume_in_dequantize_4bit_at_1352\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     stream = _get_tensor_stream(A)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 482, in _get_tensor_stream\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     return ct.c_void_p(torch._C._cuda_getCurrentRawStream(tensor.device.index))\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/torch.py\", line 897, in call_function\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     tensor_variable = wrap_fx_proxy(\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]                       ^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/builder.py\", line 2037, in wrap_fx_proxy\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     return wrap_fx_proxy_cls(target_cls=TensorVariable, **kwargs)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/builder.py\", line 2333, in wrap_fx_proxy_cls\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     unimplemented(\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:20.899000 1548 torch/_dynamo/symbolic_convert.py:617] [20/0] [__graph_breaks] torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function <built-in function _cuda_getCurrentRawStream>\n",
            "W0218 11:31:21.022000 1548 torch/_inductor/debug.py:434] [20/0_1] model__6_inference_7 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__6_inference_7.6\n",
            "V0218 11:31:21.052000 1548 torch/_dynamo/guards.py:2811] [16/1] [__recompiles_verbose] Recompiling function _get_tensor_stream in /usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py:480\n",
            "V0218 11:31:21.052000 1548 torch/_dynamo/guards.py:2811] [16/1] [__recompiles_verbose]     triggered by the following guard failure(s):\n",
            "V0218 11:31:21.052000 1548 torch/_dynamo/guards.py:2811] [16/1] [__recompiles_verbose]     guard 0 failures:\n",
            "V0218 11:31:21.052000 1548 torch/_dynamo/guards.py:2811] [16/1] [__recompiles_verbose]     - 16/0: tensor 'L['tensor']' rank mismatch. expected 1, actual 2\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 482, in _get_tensor_stream\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]     return ct.c_void_p(torch._C._cuda_getCurrentRawStream(tensor.device.index))\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/torch.py\", line 897, in call_function\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]     tensor_variable = wrap_fx_proxy(\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]                       ^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/builder.py\", line 2037, in wrap_fx_proxy\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]     return wrap_fx_proxy_cls(target_cls=TensorVariable, **kwargs)\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/builder.py\", line 2333, in wrap_fx_proxy_cls\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]     unimplemented(\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:21.063000 1548 torch/_dynamo/symbolic_convert.py:617] [16/1] [__graph_breaks] torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function <built-in function _cuda_getCurrentRawStream>\n",
            "V0218 11:31:21.096000 1548 torch/_dynamo/guards.py:2811] [9/2] [__recompiles_verbose] Recompiling function get_ptr in /usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py:485\n",
            "V0218 11:31:21.096000 1548 torch/_dynamo/guards.py:2811] [9/2] [__recompiles_verbose]     triggered by the following guard failure(s):\n",
            "V0218 11:31:21.096000 1548 torch/_dynamo/guards.py:2811] [9/2] [__recompiles_verbose]     guard 0 failures:\n",
            "V0218 11:31:21.096000 1548 torch/_dynamo/guards.py:2811] [9/2] [__recompiles_verbose]     - 9/0: tensor 'L['A']' dtype mismatch. expected Float, actual Byte\n",
            "V0218 11:31:21.096000 1548 torch/_dynamo/guards.py:2811] [9/2] [__recompiles_verbose] \n",
            "V0218 11:31:21.096000 1548 torch/_dynamo/guards.py:2811] [9/2] [__recompiles_verbose]     guard 1 failures:\n",
            "V0218 11:31:21.096000 1548 torch/_dynamo/guards.py:2811] [9/2] [__recompiles_verbose]     - 9/1: tensor 'L['A']' rank mismatch. expected 1, actual 2\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:21.109000 1548 torch/_dynamo/symbolic_convert.py:617] [9/2] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose] Recompiling function get_ptr in /usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py:485\n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose]     triggered by the following guard failure(s):\n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose]     guard 0 failures:\n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose]     - 9/0: tensor 'L['A']' dtype mismatch. expected Float, actual BFloat16\n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose] \n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose]     guard 1 failures:\n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose]     - 9/2: tensor 'L['A']' dtype mismatch. expected Byte, actual BFloat16\n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose] \n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose]     guard 2 failures:\n",
            "V0218 11:31:21.135000 1548 torch/_dynamo/guards.py:2811] [9/3] [__recompiles_verbose]     - 9/1: tensor 'L['A']' dtype mismatch. expected Byte, actual BFloat16\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/functional.py\", line 497, in get_ptr\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]     return ct.c_void_p(A.data_ptr())\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 527, in call_method\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]     result = handler_method(*args, **kwargs)\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/tensor.py\", line 764, in method_data_ptr\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]     unimplemented(\"Tensor.data_ptr\")\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:21.146000 1548 torch/_dynamo/symbolic_convert.py:617] [9/3] [__graph_breaks] torch._dynamo.exc.Unsupported: Tensor.data_ptr\n",
            "W0218 11:31:21.361000 1548 torch/_inductor/debug.py:434] [23/0] model__7_inference_8 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__7_inference_8.7\n",
            "W0218 11:31:22.626000 1548 torch/_inductor/debug.py:434] [24/0] model__8_forward_10 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__8_forward_10.8\n",
            "W0218 11:31:23.202000 1548 torch/_inductor/debug.py:434] [24/0] model__8_backward_11 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__8_backward_11.9\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"<ipython-input-12-7786d8f77241>\", line 12, in torch_dynamo_resume_in_compiled_llama_mlp_at_12\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     down_proj = self.down_proj(self.act_fn(self.gate_proj(x)) * self.up_proj(x))\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/peft/tuners/lora/bnb.py\", line 496, in forward\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     result = self.base_layer(x, *args, **kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/nn/modules.py\", line 484, in forward\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return bnb.matmul_4bit(x, self.weight.t(), bias=bias, quant_state=self.weight.quant_state).to(inp_dtype)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/lazy.py\", line 156, in realize_and_forward\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return getattr(self.realize(), name)(*args, **kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/nn_module.py\", line 899, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return variables.UserFunctionVariable(fn, source=source).call_function(\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 1680, in CALL_FUNCTION_EX\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self.call_function(fn, argsvars.items, kwargsvars)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/lazy.py\", line 156, in realize_and_forward\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return getattr(self.realize(), name)(*args, **kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/nn_module.py\", line 899, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return variables.UserFunctionVariable(fn, source=source).call_function(\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 796, in call_method\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     return super().call_method(tx, name, args, kwargs)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/base.py\", line 343, in call_method\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     unimplemented(f\"call_method {self} {name} {args} {kwargs}\")\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:23.603000 1548 torch/_dynamo/symbolic_convert.py:617] [25/0] [__graph_breaks] torch._dynamo.exc.Unsupported: call_method UserDefinedObjectVariable(Params4bit) t [] {}\n",
            "W0218 11:31:24.258000 1548 torch/_inductor/debug.py:434] [25/0_1] model__9_forward_13 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__9_forward_13.10\n",
            "W0218 11:31:24.966000 1548 torch/_inductor/debug.py:434] [25/0_1] model__9_backward_14 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__9_backward_14.11\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks] Graph break: from user code at:\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"<ipython-input-12-7786d8f77241>\", line 12, in torch_dynamo_resume_in_compiled_llama_mlp_at_12\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     down_proj = self.down_proj(self.act_fn(self.gate_proj(x)) * self.up_proj(x))\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/peft/tuners/lora/bnb.py\", line 496, in forward\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     result = self.base_layer(x, *args, **kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/bitsandbytes/nn/modules.py\", line 484, in forward\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return bnb.matmul_4bit(x, self.weight.t(), bias=bias, quant_state=self.weight.quant_state).to(inp_dtype)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks] Traceback (most recent call last):\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/lazy.py\", line 156, in realize_and_forward\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return getattr(self.realize(), name)(*args, **kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/nn_module.py\", line 899, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return variables.UserFunctionVariable(fn, source=source).call_function(\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 1680, in CALL_FUNCTION_EX\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self.call_function(fn, argsvars.items, kwargsvars)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/lazy.py\", line 156, in realize_and_forward\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return getattr(self.realize(), name)(*args, **kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/nn_module.py\", line 899, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return variables.UserFunctionVariable(fn, source=source).call_function(\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 324, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return super().call_function(tx, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/functions.py\", line 111, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return tx.inline_user_function_return(self, [*self.self_args(), *args], kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 836, in inline_user_function_return\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return InliningInstructionTranslator.inline_call(self, fn, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3011, in inline_call\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return cls.inline_call_(parent, func, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 3139, in inline_call_\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     tracer.run()\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 983, in run\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     while self.step():\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]           ^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 895, in step\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self.dispatch_table[inst.opcode](self, inst)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 582, in wrapper\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return inner_fn(self, inst)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2279, in CALL\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self._call(inst)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 2273, in _call\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self.call_function(fn, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/symbolic_convert.py\", line 830, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     self.push(fn.call_function(self, args, kwargs))  # type: ignore[arg-type]\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/misc.py\", line 1024, in call_function\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return self.obj.call_method(tx, self.name, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/user_defined.py\", line 796, in call_method\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     return super().call_method(tx, name, args, kwargs)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/variables/base.py\", line 343, in call_method\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     unimplemented(f\"call_method {self} {name} {args} {kwargs}\")\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]   File \"/usr/local/lib/python3.11/dist-packages/torch/_dynamo/exc.py\", line 297, in unimplemented\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks]     raise Unsupported(msg, case_name=case_name)\n",
            "V0218 11:31:25.213000 1548 torch/_dynamo/symbolic_convert.py:617] [26/0] [__graph_breaks] torch._dynamo.exc.Unsupported: call_method UserDefinedObjectVariable(Params4bit) t [] {}\n",
            "W0218 11:31:25.683000 1548 torch/_inductor/debug.py:434] [26/0_1] model__10_forward_16 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__10_forward_16.12\n",
            "W0218 11:31:26.359000 1548 torch/_inductor/debug.py:434] [26/0_1] model__10_backward_17 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__10_backward_17.13\n",
            "V0218 11:31:26.483000 1548 torch/_dynamo/guards.py:2811] [24/1] [__recompiles_verbose] Recompiling function torch_dynamo_resume_in_forward_at_496 in /usr/local/lib/python3.11/dist-packages/peft/tuners/lora/bnb.py:496\n",
            "V0218 11:31:26.483000 1548 torch/_dynamo/guards.py:2811] [24/1] [__recompiles_verbose]     triggered by the following guard failure(s):\n",
            "V0218 11:31:26.483000 1548 torch/_dynamo/guards.py:2811] [24/1] [__recompiles_verbose]     guard 0 failures:\n",
            "V0218 11:31:26.483000 1548 torch/_dynamo/guards.py:2811] [24/1] [__recompiles_verbose]     - 24/0: tensor 'L['x']' size mismatch at index 2. expected 2048, actual 8192\n",
            "W0218 11:31:26.900000 1548 torch/_inductor/debug.py:434] [24/1] model__11_forward_19 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__11_forward_19.14\n",
            "W0218 11:31:27.054000 1548 torch/_inductor/debug.py:434] [24/1] model__11_backward_20 debug trace: /content/torch_compile_debug/run_2025_02_18_11_31_15_729245-pid_1548/torchinductor/model__11_backward_20.15\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<IPython.core.display.HTML object>"
            ],
            "text/html": [
              "\n",
              "    <div>\n",
              "      \n",
              "      <progress value='10' max='10' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
              "      [10/10 00:05, Epoch 0/1]\n",
              "    </div>\n",
              "    <table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              " <tr style=\"text-align: left;\">\n",
              "      <th>Step</th>\n",
              "      <th>Training Loss</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <td>1</td>\n",
              "      <td>1.518500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>2</td>\n",
              "      <td>2.392600</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>3</td>\n",
              "      <td>2.503300</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>4</td>\n",
              "      <td>3.532700</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>5</td>\n",
              "      <td>2.138300</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>6</td>\n",
              "      <td>2.978100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>7</td>\n",
              "      <td>2.249500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>8</td>\n",
              "      <td>1.629300</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>9</td>\n",
              "      <td>2.222300</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>10</td>\n",
              "      <td>2.685700</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table><p>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "TrainOutput(global_step=10, training_loss=2.38502836227417, metrics={'train_runtime': 20.22, 'train_samples_per_second': 0.989, 'train_steps_per_second': 0.495, 'total_flos': 10592155496448.0, 'train_loss': 2.38502836227417})"
            ]
          },
          "metadata": {},
          "execution_count": 15
        }
      ],
      "source": [
        "trainer = SFTTrainer(\n",
        "    model = model,\n",
        "    train_dataset = dataset,\n",
        "    processing_class = tokenizer,\n",
        "    args = SFTConfig(\n",
        "        per_device_train_batch_size = 1,\n",
        "        gradient_accumulation_steps = 2,\n",
        "        warmup_steps = 1,\n",
        "        max_steps = 10,\n",
        "        logging_steps = 1,\n",
        "        output_dir = \"outputs\",\n",
        "        seed = 3407,\n",
        "        max_seq_length = max_seq_length,\n",
        "        fp16 = model.get_input_embeddings().weight.dtype == torch.float16,\n",
        "        bf16 = model.get_input_embeddings().weight.dtype == torch.bfloat16,\n",
        "        report_to = \"none\", # For W&B\n",
        "        dataset_num_proc = 4,\n",
        "    ),\n",
        ")\n",
        "trainer.train()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "KPbbwd5uDOL1"
      },
      "source": [
        "Log all your steps for debugging in a Colab (maybe this one). Edward's blog http://blog.ezyang.com/, Horace's blogs https://www.thonking.ai/, Slaying OOMs by Jane & Mark: ttps://www.youtube.com/watch?v=UvRl4ansfCg could be useful."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Wojg8SDjv3fu"
      },
      "source": [
        "## Marking Criteria for C) Max points = 9\n",
        "```python\n",
        "if attemped_C:\n",
        "    C_score = 0\n",
        "    if uses_flex_attention:\n",
        "        if dynamic_sequence_length_works: C_score += 3\n",
        "        else: C_score += 1\n",
        "    if no_torch_compile_BnB: C_score -= 2\n",
        "    elif use_part_A: C_score += 1\n",
        "    elif torch_compile_BnB: C_score += 1\n",
        "\n",
        "    if attention_compiled:\n",
        "        if excessive_recompilation: C_score -= 3\n",
        "        else: C_score += 2\n",
        "    if mlp_compiled:\n",
        "        if excessive_recompilation: C_score -= 3\n",
        "        C_score += 1\n",
        "\n",
        "    if not loss_compiled: C_score -= 1\n",
        "    if not layernorms_compiled: C_score -= 3\n",
        "\n",
        "    if max_autotune_triton_matmul:\n",
        "        if excessive_recompilation: C_score -= 2\n",
        "        else: C_score += 2\n",
        "    \n",
        "    final_score += C_score\n",
        "else:\n",
        "    final_score -= 1\n",
        "```"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cKcvFLCsQLtL"
      },
      "source": [
        "---\n",
        "---\n",
        "---\n",
        "<a name=\"ISSUES\"></a>\n",
        "## D) Help solve 🦥 Unsloth issues! [Difficulty: Varies] [Max points: 12]\n",
        "\n",
        "Head over to https://github.com/unslothai/unsloth, and find some issues which are still left standing / not resolved. The tag **currently fixing** might be useful.\n",
        "\n",
        "Each successfully accepted and solved issue will also have \\$100 to \\$1000 of bounties.\n",
        "\n",
        "It's best to attempt these features:\n",
        "\n",
        "* **<ins>Tool Calling</ins>** [Points = 1] Provide a tool calling Colab notebook and make it work inside of Unsloth. <ins>Bounty: \\$1000</ins>\n",
        "\n",
        "* **<ins>GGUF Vision support</ins>** [Points = 1] Allow exporting vision finetunes to GGUF directly. Llava and Qwen VL must work. <ins>Bounty: \\$500</ins>\n",
        "\n",
        "* **<ins>Refactor Attention</ins>** [Points = 2] Refactor and merge xformers, SDPA, flash-attn, flex-attention into a simpler interface. Must work seamlessly inside of Unsloth. <ins>Bounty: \\$350</ins>\n",
        "\n",
        "* **<ins>Windows support</ins>** [Points = 2] Allow `pip install unsloth` to work in Windows - Triton, Xformers, bitsandbytes should all function. You might need to edit `pyproject.toml`. Confirm it works. <ins>Bounty: \\$300</ins>\n",
        "\n",
        "* **<ins>Support Sequence Classification</ins>** [Points = 1] Create patching functions to patch over AutoModelForSequenceClassification, and allow finetuner to use AutoModelForSequenceClassification. <ins>Bounty: \\$200</ins>\n",
        "\n",
        "* **<ins>VLMs Data Collator</ins>** [Points = 1] Make text & image mixing work efficiently -so some inputs can be text only. Must work on Qwen, Llama, Pixtral. <ins>Bounty: \\$100</ins>\n",
        "\n",
        "* **<ins>VLMs image resizing</ins>** [Points = 1] Allow finetuner to specify maximum image size, or get it from the config.json file. Resize all images to specific size to reduce VRAM. <ins>Bounty: \\$100</ins>\n",
        "\n",
        "* **<ins>Support Flex Attention</ins>** [Points = 2] Allow dynamic sequence lengths without excessive recompilation. Make this work on SWAs and normal causal masks. Also packed sequence masks. <ins>Bounty: \\$100</ins>\n",
        "\n",
        "* **<ins>VLMs train only on completions</ins>** [Points = 1] Edit `train_on_responses_only` to allow it to work on VLMs. <ins>Bounty: \\$100</ins>\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "2VfYZjuMxujG"
      },
      "source": [
        "## Marking Criteria for D) Max points = 12\n",
        "```python\n",
        "if attemped_D:\n",
        "    D_score = 0\n",
        "    for subtask in subtasks:\n",
        "        if sucessfully_completed_subtask:\n",
        "            D_score += score_for_subtask\n",
        "    final_score += D_score\n",
        "```"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "BrJzggfH2YEG"
      },
      "source": [
        "---\n",
        "---\n",
        "---\n",
        "<a name=\"MATH\"></a>\n",
        "## E) Memory Efficient Backprop [Difficulty: Medium to Hard] [Max points: 10]\n",
        "\n",
        "In LLMs, the last layer is a projection matrix to calculate the probabilities of the next token, ie $\\sigma(XW)$. However, if the vocabulary size is very large, say 128K, then the materialization of the logits causes VRAM spikes.\n",
        "\n",
        "For example, if the `bsz = 4, qlen = 4096, hd = 4096, vocab = 128K`, then the memory usage for the logits in bfloat16 would be 4GB. In the worst case, we might even need to upcast logits to float32, so 8GB is needed.\n",
        "\n",
        "In Unsloth, we utilize [Apple's Cut Cross Entropy Loss](https://machinelearning.apple.com/research/cut-your-losses) to reduce VRAM usage, by allowing a Triton kernel to create the logits on the fly to calculate the cross entropy loss. But this does not generalize well to other functions.\n",
        "\n",
        "Our goal is to generalize this ultimately, but directly creating logits on the fly will be hard. Instead, let's take a slightly less complex approach. Let's first review some stuff. We first notice that during the normal case after forming the intermediate logits for 2 batches, we then do a gather function to aggregate the intermediate results into a single column:\n",
        "$$\n",
        "\\begin{align}\n",
        "\\begin{bmatrix} x_1 \\\\ x_2 \\end{bmatrix} \\times W &= \\begin{bmatrix} x_1 W \\\\ x_2 W \\end{bmatrix} \\\\\n",
        "f \\bigg( \\begin{bmatrix} x_1 W \\\\ x_2 W \\end{bmatrix} \\bigg) &= \\begin{pmatrix} y_1 \\\\ y_2 \\end{pmatrix}\n",
        "\\end{align}\n",
        "$$\n",
        "\n",
        "So, if we can somehow skip the materialization of the intermediate logits, and just output the output of `f`, we can save a lot of VRAM!\n",
        "\n",
        "Notice during backpropagation we can use the chain rule:\n",
        "$$\n",
        "\\begin{align}\n",
        "\\frac{dL}{dX} &= \\frac{dL}{dy} \\frac{dy}{dX} ; \\frac{dL}{dW} = \\frac{dL}{dy} \\frac{dy}{dW} \\\\\n",
        "\\frac{dL}{dy} &= \\text{Downstream from backprop} \\\\\n",
        "\\frac{dy}{dX} &= W^T \\\\\n",
        "\\frac{dy}{dW} &= X^T \\\\\n",
        "\\frac{dL}{dX} &= \\frac{dL}{dy} W^T \\\\\n",
        "\\frac{dL}{dW} &= X^T \\frac{dL}{dy} \\\\\n",
        "\\end{align}\n",
        "$$\n",
        "\n",
        "If we simply compute the intermediate tensors on the fly via batches, say we do batch 1, then batch 2, we can reduce VRAM usage from 4GB to 2GB!\n",
        "\n",
        "$$\n",
        "\\begin{align}\n",
        "\\frac{dL}{dX} &= \\begin{bmatrix} \\frac{dL_1}{dy_1} W^T \\\\ \\frac{dL_2}{dy_2} W^T \\end{bmatrix} \\\\\n",
        "\\frac{dL}{dW} &= \\bigg( X_1^T \\frac{dL_1}{dy_1} + X_2^T  \\frac{dL_2}{dy_2} \\bigg)\n",
        "\\end{align}\n",
        "$$\n",
        "\n",
        "1. Your goal is to write a `torch.autograd.Function` with a `forward` and `backward` pass showcasing this memory efficient implementation.\n",
        "\n",
        "2. You must NOT hard code the derivatives - move the transformation function from the logits / intermeditate tensors to a smaller tensor as a separate function which can allow `autograd` to pass through it.\n",
        "\n",
        "3. As a hint, look at `torch.checkpoint` at https://github.com/pytorch/pytorch/blob/main/torch/utils/checkpoint.py. Also, don't forget about the upstream gradients! We need to multiply them to the current gradients!\n",
        "\n",
        "4. Make the Cross Entropy Loss work. You must show other functions working as well."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "Rp-IJIbv90f6"
      },
      "outputs": [],
      "source": [
        "def transformation_function(batch, linear, labels):\n",
        "    x = linear(batch).float() # Up projection to large space\n",
        "    from torch.nn import CrossEntropyLoss\n",
        "    down_projection_function = CrossEntropyLoss(reduction = \"mean\")\n",
        "    # Down projection to small space\n",
        "    loss = down_projection_function(x.view(-1, x.shape[-1]), labels.view(-1))\n",
        "    return loss\n",
        "\n",
        "class MemoryEfficientLinear(torch.autograd.Function):\n",
        "    @staticmethod\n",
        "    def forward(ctx, X, linear, labels, forward_function):\n",
        "        outputs = []\n",
        "        # EDIT THIS FUNCTION\n",
        "        output = forward_function(X, linear, labels)\n",
        "        ctx.save_for_backward(X)\n",
        "        return output\n",
        "\n",
        "    @staticmethod\n",
        "    def backward(ctx, dY):\n",
        "        X = ctx.saved_tensors\n",
        "        # EDIT THIS FUNCTION\n",
        "        return X, None, None, None"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "_lIczyn8-2-o"
      },
      "source": [
        "To test your implementation, it should not OOM for large inputs. Also, check the gradient is actually equivalent via `torch.allclose` in the normal approach."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "gVZ414R2Dk8M"
      },
      "source": [
        "## Marking Criteria for E) Max points = 10\n",
        "```python\n",
        "if attemped_E:\n",
        "    E_score = 0\n",
        "    if VRAM_50_percent_reduction: E_score += 2\n",
        "    if remove_float32_upcast: E_score = 0\n",
        "    if show_ce_loss_works: E_score += 1\n",
        "    if show_other_functions_work: E_score += 1\n",
        "    if hardcoded_gradients: E_score = 0\n",
        "    if allows_dynamic_chunk_sizes: E_score += 1\n",
        "    if llama_1B_training_loss_matches: E_score += 1\n",
        "    else: E_score = 0\n",
        "    if GRPO_memory_efficient_linear_works: E_score += 4\n",
        "    final_score += E_score\n",
        "else:\n",
        "    final_score += 0\n",
        "```"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "kvrVlTmUN8nV"
      },
      "source": [
        "---\n",
        "---\n",
        "---\n",
        "<a name=\"SUBMISSION\"></a>\n",
        "## Submission Steps\n",
        "\n",
        "1. All code should be in a public Github (Apache 2 Licensed)\n",
        "2. Kaggle notebooks and Colab notebooks should be linked in the README, and can be accessible through Colab / Kaggle.\n",
        "3. If attaching notebooks, must attach fully run ones - do not just add a notebook without running it. Kaggle notebook must be public, and run.\n",
        "4. Submit the Github to https://forms.gle/crSYnsGq3t1ck5TB9 If you want to send a private repo, please add me as a Github collaborate @danielhanchen\n",
        "5. Provide screenshots, graphs, plots, etc especially for training loss curves.\n",
        "6. We will comment and respond inside your Github repo. There will get 1 interview as well as a final step!\n",
        "\n",
        "### Clarifications:\n",
        "1. We'll compensate you if we interview you but don't hire you\n",
        "2. \\$100-\\$1000 bounties for Task 4\n",
        "3. Submissions must be Apache-2 licensed\n",
        "4. Task 4 involves solving Github issues for OSS Unsloth\n",
        "5. No time limit: rolling basis\n",
        "6. US based preferred"
      ]
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "gpuType": "T4",
      "provenance": [],
      "include_colab_link": true
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "name": "python"
    },
    "widgets": {
      "application/vnd.jupyter.widget-state+json": {
        "d33171e7f9f7435e9609ebce0a7bae64": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_cb46e9b7a8a540a1a7a09dd64823052b",
              "IPY_MODEL_c402aa198f36471aae5499024f8d6d66",
              "IPY_MODEL_edb68a122c334c5193fe21fde4eedc66"
            ],
            "layout": "IPY_MODEL_6eadec6ada3640e5827d4a69a4b96132"
          }
        },
        "cb46e9b7a8a540a1a7a09dd64823052b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_1f1d6c05ab1547da96a10ca82e003b92",
            "placeholder": "​",
            "style": "IPY_MODEL_14c092ed314c4dc28b17e8c41e3d70f7",
            "value": "config.json: 100%"
          }
        },
        "c402aa198f36471aae5499024f8d6d66": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d4d30920fadb42e688e7d935f5d388de",
            "max": 1532,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_a041a5627ac949068ae137f36a5f4dd0",
            "value": 1532
          }
        },
        "edb68a122c334c5193fe21fde4eedc66": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d8b246969dba462faf712ca1a742ba37",
            "placeholder": "​",
            "style": "IPY_MODEL_5381b6e7723b41a4b6a7f903759a1a7b",
            "value": " 1.53k/1.53k [00:00&lt;00:00, 78.3kB/s]"
          }
        },
        "6eadec6ada3640e5827d4a69a4b96132": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1f1d6c05ab1547da96a10ca82e003b92": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "14c092ed314c4dc28b17e8c41e3d70f7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d4d30920fadb42e688e7d935f5d388de": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a041a5627ac949068ae137f36a5f4dd0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "d8b246969dba462faf712ca1a742ba37": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5381b6e7723b41a4b6a7f903759a1a7b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "02a7355fe4e4487c9f93adc03b0965c2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_d4b583ad5b1841d1b17f7d9e624adb7f",
              "IPY_MODEL_34623fb46fbc43409ecfa76aafde60fb",
              "IPY_MODEL_dccc44fdef36476d9053466e95ef3a03"
            ],
            "layout": "IPY_MODEL_51befa7ea9444beb974cd898fd269c49"
          }
        },
        "d4b583ad5b1841d1b17f7d9e624adb7f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_dd0d238272494a9ebab48d9f9b3cc07f",
            "placeholder": "​",
            "style": "IPY_MODEL_b1ea87cf2c6346db987d9ebe67d970e0",
            "value": "model.safetensors: 100%"
          }
        },
        "34623fb46fbc43409ecfa76aafde60fb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3fec812d653f43aab6daef1ad96b25bb",
            "max": 5702746383,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_6b47182ca29c4efba3d1a985bdd6154b",
            "value": 5702746383
          }
        },
        "dccc44fdef36476d9053466e95ef3a03": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_9217b9e57e134811a71c5689dc10dfb3",
            "placeholder": "​",
            "style": "IPY_MODEL_8393a23d15454a18bbd2daefb7880047",
            "value": " 5.70G/5.70G [02:15&lt;00:00, 42.5MB/s]"
          }
        },
        "51befa7ea9444beb974cd898fd269c49": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "dd0d238272494a9ebab48d9f9b3cc07f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b1ea87cf2c6346db987d9ebe67d970e0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "3fec812d653f43aab6daef1ad96b25bb": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6b47182ca29c4efba3d1a985bdd6154b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "9217b9e57e134811a71c5689dc10dfb3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8393a23d15454a18bbd2daefb7880047": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "60745962f179450ea4d09848cd469a13": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_60d5707fab6b4f1cb693caba407ca242",
              "IPY_MODEL_c63f9a8cfc4347c29716689640b82438",
              "IPY_MODEL_171067bb692449deb203d823aaf354ae"
            ],
            "layout": "IPY_MODEL_4c0e101302144196834f21146ae86a56"
          }
        },
        "60d5707fab6b4f1cb693caba407ca242": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_87a9db0c3e1342718d2a92a3331b931e",
            "placeholder": "​",
            "style": "IPY_MODEL_e5f319c7991844e78f5f191e022352eb",
            "value": "generation_config.json: 100%"
          }
        },
        "c63f9a8cfc4347c29716689640b82438": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_9416cc1dc4d2499aa80ed637ecb2524c",
            "max": 239,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_ca1bf7a5cb9543f3a6e5d597c99da7cf",
            "value": 239
          }
        },
        "171067bb692449deb203d823aaf354ae": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c00c50c3e304452993bc14864fd803e1",
            "placeholder": "​",
            "style": "IPY_MODEL_5c1eea500ca6417e8633e177b7e454f0",
            "value": " 239/239 [00:00&lt;00:00, 11.1kB/s]"
          }
        },
        "4c0e101302144196834f21146ae86a56": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "87a9db0c3e1342718d2a92a3331b931e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e5f319c7991844e78f5f191e022352eb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "9416cc1dc4d2499aa80ed637ecb2524c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ca1bf7a5cb9543f3a6e5d597c99da7cf": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "c00c50c3e304452993bc14864fd803e1": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5c1eea500ca6417e8633e177b7e454f0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "4ca05f7a7f2c4a6b9411d932a581b96f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_557ccd6d1129493390e9de5af5047803",
              "IPY_MODEL_aa8c7b1f23954bcdb6b6b5307231f324",
              "IPY_MODEL_07a37e2cd57c40f291c453252946d7ae"
            ],
            "layout": "IPY_MODEL_44f869ff4bbd4774b870a25f1c5ed7d3"
          }
        },
        "557ccd6d1129493390e9de5af5047803": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_feff1dc3c37440c5a1457c4d6fae2814",
            "placeholder": "​",
            "style": "IPY_MODEL_fb05393aac774c8196da8d2cca207f97",
            "value": "tokenizer_config.json: 100%"
          }
        },
        "aa8c7b1f23954bcdb6b6b5307231f324": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2c2b659c738846818fd669d59ffea530",
            "max": 55493,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_e5e1e6c9f11f460ba59ebe947bd9c36a",
            "value": 55493
          }
        },
        "07a37e2cd57c40f291c453252946d7ae": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_9c85585806d741a88a99732ba74266b8",
            "placeholder": "​",
            "style": "IPY_MODEL_2ff3472c871842eabb81b1963e59fd63",
            "value": " 55.5k/55.5k [00:00&lt;00:00, 2.33MB/s]"
          }
        },
        "44f869ff4bbd4774b870a25f1c5ed7d3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "feff1dc3c37440c5a1457c4d6fae2814": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fb05393aac774c8196da8d2cca207f97": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2c2b659c738846818fd669d59ffea530": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e5e1e6c9f11f460ba59ebe947bd9c36a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "9c85585806d741a88a99732ba74266b8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "2ff3472c871842eabb81b1963e59fd63": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "7bc08a39aa144c3391e9152ab590d345": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_f9d3ca662f2e479a83d0fbbd40cb2cdd",
              "IPY_MODEL_5c9c61b46fd94e8982fef8dc23c8835d",
              "IPY_MODEL_bd012dbe82844efebf286fdfe6698685"
            ],
            "layout": "IPY_MODEL_ecf789c2c2054120a7470a7f1c2de51e"
          }
        },
        "f9d3ca662f2e479a83d0fbbd40cb2cdd": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0875f4cfb3e04b72870389ade4aca0dc",
            "placeholder": "​",
            "style": "IPY_MODEL_4f2247c6f3ab484e93c13ea16407784a",
            "value": "tokenizer.json: 100%"
          }
        },
        "5c9c61b46fd94e8982fef8dc23c8835d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e4d6416795d046a69279025141db9028",
            "max": 17209920,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_8db8ffc5db77427080a6adeff922718d",
            "value": 17209920
          }
        },
        "bd012dbe82844efebf286fdfe6698685": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_66e1a997a07341dc9e433aeee69796a1",
            "placeholder": "​",
            "style": "IPY_MODEL_7e304840b3194b63a35429312f60bbd0",
            "value": " 17.2M/17.2M [00:00&lt;00:00, 45.4MB/s]"
          }
        },
        "ecf789c2c2054120a7470a7f1c2de51e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0875f4cfb3e04b72870389ade4aca0dc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4f2247c6f3ab484e93c13ea16407784a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e4d6416795d046a69279025141db9028": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8db8ffc5db77427080a6adeff922718d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "66e1a997a07341dc9e433aeee69796a1": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7e304840b3194b63a35429312f60bbd0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "8d8e553c2da34ea0b39b8876172feacc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_f68b4512f73047a4a34795c4afb8c02e",
              "IPY_MODEL_cd40dcff85454a668104c90c7f7df805",
              "IPY_MODEL_913472fdbb59469698c710707ab23ef9"
            ],
            "layout": "IPY_MODEL_b5224851afa040f49ad1d627cc1a770c"
          }
        },
        "f68b4512f73047a4a34795c4afb8c02e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0ba82e790b954e78b5807e82c4e97e21",
            "placeholder": "​",
            "style": "IPY_MODEL_7188c0a589c54560ae13f9d438a211d1",
            "value": "special_tokens_map.json: 100%"
          }
        },
        "cd40dcff85454a668104c90c7f7df805": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7a7535c05c394abf80bc1421bf5aaff5",
            "max": 454,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_39763d4b0744409db567dcc5792d6a4d",
            "value": 454
          }
        },
        "913472fdbb59469698c710707ab23ef9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d91a18b3322c47159f971b4fe6101228",
            "placeholder": "​",
            "style": "IPY_MODEL_80b51d6d9e66498b8b830282d5ea678d",
            "value": " 454/454 [00:00&lt;00:00, 31.8kB/s]"
          }
        },
        "b5224851afa040f49ad1d627cc1a770c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0ba82e790b954e78b5807e82c4e97e21": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7188c0a589c54560ae13f9d438a211d1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "7a7535c05c394abf80bc1421bf5aaff5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "39763d4b0744409db567dcc5792d6a4d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "d91a18b3322c47159f971b4fe6101228": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "80b51d6d9e66498b8b830282d5ea678d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b10a9ec495a94fd08076841eb67a9e3e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_306412737a9c4098a27329966f3f364c",
              "IPY_MODEL_51268827e9d44ce5844f2959646355e9",
              "IPY_MODEL_cae52970160a4a52b3d4a52deda0d96d"
            ],
            "layout": "IPY_MODEL_35e697a93d4b4040a5b27d67987a2bb6"
          }
        },
        "306412737a9c4098a27329966f3f364c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_014be59294894ed6bc68f839cf3de5e9",
            "placeholder": "​",
            "style": "IPY_MODEL_7c174a9af7624b8584fd63ecc195fd31",
            "value": "unified_chip2.jsonl: 100%"
          }
        },
        "51268827e9d44ce5844f2959646355e9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3c8ae3592bca4bc0b091b7db4b025c44",
            "max": 95645860,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_60144d2c919744f7b7934c9d523b523a",
            "value": 95645860
          }
        },
        "cae52970160a4a52b3d4a52deda0d96d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c8459c680f4d4e46a156714642178fe4",
            "placeholder": "​",
            "style": "IPY_MODEL_54862b67e81547b197560323e3fedc08",
            "value": " 95.6M/95.6M [00:00&lt;00:00, 224MB/s]"
          }
        },
        "35e697a93d4b4040a5b27d67987a2bb6": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "014be59294894ed6bc68f839cf3de5e9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7c174a9af7624b8584fd63ecc195fd31": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "3c8ae3592bca4bc0b091b7db4b025c44": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "60144d2c919744f7b7934c9d523b523a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "c8459c680f4d4e46a156714642178fe4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "54862b67e81547b197560323e3fedc08": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b0780c6be64c46e99bdc40a6044d518d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_1ba8c5c7ab9e4552907ca55247d510e2",
              "IPY_MODEL_3a213a5a54b94b14a95a439b5950754b",
              "IPY_MODEL_12ef112247ee4464a9af2496afd2ca56"
            ],
            "layout": "IPY_MODEL_66427fa7a07a4cc6befa8f4ddf863487"
          }
        },
        "1ba8c5c7ab9e4552907ca55247d510e2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_22ae3abacb844fe2b30faff45bb5c1ff",
            "placeholder": "​",
            "style": "IPY_MODEL_63a697198d7c4eae8fbe7b304f2f9e21",
            "value": "Generating train split: "
          }
        },
        "3a213a5a54b94b14a95a439b5950754b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6a02115f60154e6e9a5cc85bddba58b9",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_988bc7535aba4886adff9a8aaac8ba55",
            "value": 1
          }
        },
        "12ef112247ee4464a9af2496afd2ca56": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e6c07f50c49f4d6aa3783b535e4c5c06",
            "placeholder": "​",
            "style": "IPY_MODEL_c9f98890e58d4b91a5b10d4acf765b4f",
            "value": " 210289/0 [00:00&lt;00:00, 268879.27 examples/s]"
          }
        },
        "66427fa7a07a4cc6befa8f4ddf863487": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "22ae3abacb844fe2b30faff45bb5c1ff": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "63a697198d7c4eae8fbe7b304f2f9e21": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "6a02115f60154e6e9a5cc85bddba58b9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "20px"
          }
        },
        "988bc7535aba4886adff9a8aaac8ba55": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "e6c07f50c49f4d6aa3783b535e4c5c06": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c9f98890e58d4b91a5b10d4acf765b4f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c78a6c11d9124e5a92920422d122c852": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_287cc5d4be704e70b9590a67725013ad",
              "IPY_MODEL_4cf101f8733e440ca126ed0128581f8e",
              "IPY_MODEL_2788b87a6db64edf987ea456f2d7269a"
            ],
            "layout": "IPY_MODEL_749b7205bc35409196003d174ec44375"
          }
        },
        "287cc5d4be704e70b9590a67725013ad": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_536152188fd9436fbc936f46aed55e83",
            "placeholder": "​",
            "style": "IPY_MODEL_d039da580f404715aca774ea535e9c71",
            "value": "Applying chat template to train dataset (num_proc=4): 100%"
          }
        },
        "4cf101f8733e440ca126ed0128581f8e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2ed9f2257feb45e09d68cd0b96082a1d",
            "max": 21029,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_1b394c083a144afe9f785e48a31cedb3",
            "value": 21029
          }
        },
        "2788b87a6db64edf987ea456f2d7269a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_ad0d75c3655e418fb4dcbafd0a639632",
            "placeholder": "​",
            "style": "IPY_MODEL_c68c4c0fc48c42548e7e399a0f7485f7",
            "value": " 21029/21029 [00:04&lt;00:00, 16271.39 examples/s]"
          }
        },
        "749b7205bc35409196003d174ec44375": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "536152188fd9436fbc936f46aed55e83": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d039da580f404715aca774ea535e9c71": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2ed9f2257feb45e09d68cd0b96082a1d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1b394c083a144afe9f785e48a31cedb3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "ad0d75c3655e418fb4dcbafd0a639632": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c68c4c0fc48c42548e7e399a0f7485f7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "43e589f13119463ab3f25cbab46d10e7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_7954981b42c64509aad1ead118cba61d",
              "IPY_MODEL_9c99c79f2f5e4afbae5c3b1cc342e700",
              "IPY_MODEL_385eb08545164b9f8eb455fc4ef6e097"
            ],
            "layout": "IPY_MODEL_7b22ea5fd5ca444280d8cf8a43136099"
          }
        },
        "7954981b42c64509aad1ead118cba61d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_1023af6301f44ebeab7a8d899eb58522",
            "placeholder": "​",
            "style": "IPY_MODEL_52a6557e482d446ea1e98ffa83441e9b",
            "value": "Tokenizing train dataset (num_proc=4): 100%"
          }
        },
        "9c99c79f2f5e4afbae5c3b1cc342e700": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0cb5711d02dd43218e4955e1be601e54",
            "max": 21029,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_85e9bbf72bb6422591fe9d84e6acd391",
            "value": 21029
          }
        },
        "385eb08545164b9f8eb455fc4ef6e097": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f889097fad314f59ac0f27c097ac28ae",
            "placeholder": "​",
            "style": "IPY_MODEL_57af46dfdba74fa58bcf7db42a378f60",
            "value": " 21029/21029 [00:12&lt;00:00, 2299.60 examples/s]"
          }
        },
        "7b22ea5fd5ca444280d8cf8a43136099": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1023af6301f44ebeab7a8d899eb58522": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "52a6557e482d446ea1e98ffa83441e9b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0cb5711d02dd43218e4955e1be601e54": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "85e9bbf72bb6422591fe9d84e6acd391": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "f889097fad314f59ac0f27c097ac28ae": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "57af46dfdba74fa58bcf7db42a378f60": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "5b8ef0c9583b4879a7f0ae04a60fb39f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ecb68987b074428380ea39a71ea4560c",
              "IPY_MODEL_995a7668bdc74fb8a4fdec8ca802db4d",
              "IPY_MODEL_1c64b2646537410693cf41f077b9f40f"
            ],
            "layout": "IPY_MODEL_ae0ace153e6e42429bc80707effc7c97"
          }
        },
        "ecb68987b074428380ea39a71ea4560c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6630d0e47d2842f7a5261f89e9235ae4",
            "placeholder": "​",
            "style": "IPY_MODEL_996c93f8e21649fea2720ab9cb8e21fc",
            "value": "Tokenizing train dataset (num_proc=4): 100%"
          }
        },
        "995a7668bdc74fb8a4fdec8ca802db4d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f7678cabf31849e493628c4fb260b98e",
            "max": 21029,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_16129167e0be4d77989b5cfb8d840bd3",
            "value": 21029
          }
        },
        "1c64b2646537410693cf41f077b9f40f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_9b7470b87b804d868f5430769c230592",
            "placeholder": "​",
            "style": "IPY_MODEL_b43cf65240104debb35756801cee867b",
            "value": " 21029/21029 [00:04&lt;00:00, 2800.69 examples/s]"
          }
        },
        "ae0ace153e6e42429bc80707effc7c97": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6630d0e47d2842f7a5261f89e9235ae4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "996c93f8e21649fea2720ab9cb8e21fc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "f7678cabf31849e493628c4fb260b98e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "16129167e0be4d77989b5cfb8d840bd3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "9b7470b87b804d868f5430769c230592": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b43cf65240104debb35756801cee867b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2650669091e449f7a12f3ead7d4c20ad": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_3dc8d64196b14f4197cd3339742a34bc",
              "IPY_MODEL_7158ed68d61d4d80b2e3747c390fda80",
              "IPY_MODEL_641623b174014cf1a971e3e09acf9164"
            ],
            "layout": "IPY_MODEL_a2de6c359c5449b19f2f20534b3cddfc"
          }
        },
        "3dc8d64196b14f4197cd3339742a34bc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5fdf71c34276475b9f06d1f0f3df43a0",
            "placeholder": "​",
            "style": "IPY_MODEL_0a3d0e0a03d047a8b90bbe9d98c26f3f",
            "value": "config.json: 100%"
          }
        },
        "7158ed68d61d4d80b2e3747c390fda80": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_09299fa4aa0e41ce87f9b27df73600f1",
            "max": 1520,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_4e7bcee3a16949b3a6ea93bba773e43f",
            "value": 1520
          }
        },
        "641623b174014cf1a971e3e09acf9164": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_92a1f52385ef425eafd685fc7dc351c7",
            "placeholder": "​",
            "style": "IPY_MODEL_e3a2d60dd4c24aacb6425b4bb0ee066e",
            "value": " 1.52k/1.52k [00:00&lt;00:00, 31.3kB/s]"
          }
        },
        "a2de6c359c5449b19f2f20534b3cddfc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5fdf71c34276475b9f06d1f0f3df43a0": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0a3d0e0a03d047a8b90bbe9d98c26f3f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "09299fa4aa0e41ce87f9b27df73600f1": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4e7bcee3a16949b3a6ea93bba773e43f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "92a1f52385ef425eafd685fc7dc351c7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e3a2d60dd4c24aacb6425b4bb0ee066e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "83a069d07e62433fbdeccd446629f933": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_7f598a003c3a46d8b1bc9b9e09961d8f",
              "IPY_MODEL_c8759c84b0cc41d1b26c9ebb8d1c1bd8",
              "IPY_MODEL_6d472692e8ef41568614da4c8524ac90"
            ],
            "layout": "IPY_MODEL_06831f66e5ea482e93837ee00fce9413"
          }
        },
        "7f598a003c3a46d8b1bc9b9e09961d8f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_559908d1ab2247e693e273b9da52c5a7",
            "placeholder": "​",
            "style": "IPY_MODEL_cd3fc5a7061c4ce6b66c3ee70b0dc4ab",
            "value": "model.safetensors: 100%"
          }
        },
        "c8759c84b0cc41d1b26c9ebb8d1c1bd8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_4210ab573d8e4eb586989b74b51c7244",
            "max": 1027676737,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_5da5844a476641679e995289c3e6701c",
            "value": 1027676737
          }
        },
        "6d472692e8ef41568614da4c8524ac90": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7df04b49b6d14d7fb4900c315c1d9369",
            "placeholder": "​",
            "style": "IPY_MODEL_6186d0196b584ebc9debb77ed3835fc3",
            "value": " 1.03G/1.03G [00:24&lt;00:00, 42.3MB/s]"
          }
        },
        "06831f66e5ea482e93837ee00fce9413": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "559908d1ab2247e693e273b9da52c5a7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "cd3fc5a7061c4ce6b66c3ee70b0dc4ab": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "4210ab573d8e4eb586989b74b51c7244": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5da5844a476641679e995289c3e6701c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "7df04b49b6d14d7fb4900c315c1d9369": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6186d0196b584ebc9debb77ed3835fc3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "85cacea45f094105921c3430f0f9ff16": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_4120cf65fc154f7aa0f339a0ca9ccf04",
              "IPY_MODEL_a397ac9ead5644e79e3201669253bbee",
              "IPY_MODEL_a2ab9f82bf8949df8fcec7067153ced0"
            ],
            "layout": "IPY_MODEL_472ff429959940a09c8ba6d08b50991c"
          }
        },
        "4120cf65fc154f7aa0f339a0ca9ccf04": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0c3c7a2269ab4099b8a9232ccd358fd7",
            "placeholder": "​",
            "style": "IPY_MODEL_056f3c7e217140e384b934511108a211",
            "value": "generation_config.json: 100%"
          }
        },
        "a397ac9ead5644e79e3201669253bbee": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2bd03db6056546698822b83c0aae3519",
            "max": 234,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_28eef2874a974ffd887bbed667a44161",
            "value": 234
          }
        },
        "a2ab9f82bf8949df8fcec7067153ced0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a97ff63c9116491284dcc086330a68a9",
            "placeholder": "​",
            "style": "IPY_MODEL_56f84a989c0b4637a5f4695f7e255d03",
            "value": " 234/234 [00:00&lt;00:00, 12.0kB/s]"
          }
        },
        "472ff429959940a09c8ba6d08b50991c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0c3c7a2269ab4099b8a9232ccd358fd7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "056f3c7e217140e384b934511108a211": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2bd03db6056546698822b83c0aae3519": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "28eef2874a974ffd887bbed667a44161": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "a97ff63c9116491284dcc086330a68a9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "56f84a989c0b4637a5f4695f7e255d03": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "9867e25e17a24d59935f0fbed4aed30e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_3edc46c5a96d4e9c9fea69c1e180abd4",
              "IPY_MODEL_1efa9da14cd94d0e9e50d97fa326fe74",
              "IPY_MODEL_86febc74651a47ffb4d02ee4e34340de"
            ],
            "layout": "IPY_MODEL_eeff3f5036cb4642a6cdbf34f1342c07"
          }
        },
        "3edc46c5a96d4e9c9fea69c1e180abd4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d2161b9b632d4c2e9ad5667c189ce7bf",
            "placeholder": "​",
            "style": "IPY_MODEL_52eb5d70f7d540c28ce8e39d7eb3569e",
            "value": "tokenizer_config.json: 100%"
          }
        },
        "1efa9da14cd94d0e9e50d97fa326fe74": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_67ea2cdb7b424448882e76b8f7fa767d",
            "max": 54674,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_6df34bb109bc49909b15b58a76027d04",
            "value": 54674
          }
        },
        "86febc74651a47ffb4d02ee4e34340de": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_fb452d291e9f42c5ba93f4a7a4a17ca7",
            "placeholder": "​",
            "style": "IPY_MODEL_e1cd8b04457b4943b6027cde16089378",
            "value": " 54.7k/54.7k [00:00&lt;00:00, 3.12MB/s]"
          }
        },
        "eeff3f5036cb4642a6cdbf34f1342c07": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d2161b9b632d4c2e9ad5667c189ce7bf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "52eb5d70f7d540c28ce8e39d7eb3569e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "67ea2cdb7b424448882e76b8f7fa767d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6df34bb109bc49909b15b58a76027d04": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "fb452d291e9f42c5ba93f4a7a4a17ca7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e1cd8b04457b4943b6027cde16089378": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "358313f3922d439fa511a83f01faa2db": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_28c1d59998ea4c278f75b9f1fb8f62ca",
              "IPY_MODEL_e730ff355cb4498e83cbc92e5edd7274",
              "IPY_MODEL_1705fd65a03a4e4e9b5d9b5a09691a2f"
            ],
            "layout": "IPY_MODEL_1e9a88491bf6473db41743d92ff3dbe7"
          }
        },
        "28c1d59998ea4c278f75b9f1fb8f62ca": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_4e374cbbaa1849f5856bae0e3023352e",
            "placeholder": "​",
            "style": "IPY_MODEL_c5c42f84490340e78c0f972c3108ed47",
            "value": "tokenizer.json: 100%"
          }
        },
        "e730ff355cb4498e83cbc92e5edd7274": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d6ece92b44074841bda3a29889fa0363",
            "max": 17209920,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_61ec012bc6b242f39b8b67e47db3b6b4",
            "value": 17209920
          }
        },
        "1705fd65a03a4e4e9b5d9b5a09691a2f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_fcf382a7918641ebb174928df69ce161",
            "placeholder": "​",
            "style": "IPY_MODEL_00e10167b3164042bee7a2495181e2f0",
            "value": " 17.2M/17.2M [00:00&lt;00:00, 43.4MB/s]"
          }
        },
        "1e9a88491bf6473db41743d92ff3dbe7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4e374cbbaa1849f5856bae0e3023352e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c5c42f84490340e78c0f972c3108ed47": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d6ece92b44074841bda3a29889fa0363": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "61ec012bc6b242f39b8b67e47db3b6b4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "fcf382a7918641ebb174928df69ce161": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "00e10167b3164042bee7a2495181e2f0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "f9d5827a6d9648fd812228e9af59495b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_f9aa215287dd4b6aa89530e7454be6e0",
              "IPY_MODEL_713ff98c8a4e4703a843ebf5fdcf7bc7",
              "IPY_MODEL_1e7e6d5390804c12a0d14481686fdaec"
            ],
            "layout": "IPY_MODEL_9045d8eca08b4889a8706893de6702b9"
          }
        },
        "f9aa215287dd4b6aa89530e7454be6e0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_201b0ed743184b73ae61038d5552c233",
            "placeholder": "​",
            "style": "IPY_MODEL_221f4d520dc7498fad01f741688e7606",
            "value": "special_tokens_map.json: 100%"
          }
        },
        "713ff98c8a4e4703a843ebf5fdcf7bc7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_8654cb9bfe994d0fa53a3dbde9a2e38e",
            "max": 454,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_ec1df11660394fc69591c3f1c946b406",
            "value": 454
          }
        },
        "1e7e6d5390804c12a0d14481686fdaec": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_369110b87c79404b9e4e9dea18d3ab99",
            "placeholder": "​",
            "style": "IPY_MODEL_42abe8c63c4d46bdbc7077f0d546f2d8",
            "value": " 454/454 [00:00&lt;00:00, 29.6kB/s]"
          }
        },
        "9045d8eca08b4889a8706893de6702b9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "201b0ed743184b73ae61038d5552c233": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "221f4d520dc7498fad01f741688e7606": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "8654cb9bfe994d0fa53a3dbde9a2e38e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ec1df11660394fc69591c3f1c946b406": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "369110b87c79404b9e4e9dea18d3ab99": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "42abe8c63c4d46bdbc7077f0d546f2d8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c569982bf1e1461d8420942006eddd7e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ad0a04a22dd04eabaeae0375b424ac94",
              "IPY_MODEL_e9c7b3bd81f34747b3b6cf8189788cb4",
              "IPY_MODEL_a6552b94ea344a7fa53a35352c1743ef"
            ],
            "layout": "IPY_MODEL_088c6c53f266406bba3f1614492793bc"
          }
        },
        "ad0a04a22dd04eabaeae0375b424ac94": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_1342101e639f42bba05a1ecdee4ae5b0",
            "placeholder": "​",
            "style": "IPY_MODEL_a5f0590c337143f18de2cae6220438c0",
            "value": "Applying chat template to train dataset (num_proc=4): 100%"
          }
        },
        "e9c7b3bd81f34747b3b6cf8189788cb4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2f6e799457e241e6803979f9d63126fe",
            "max": 21029,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_6116da2861ec4bb9ab7f3dc3dd062828",
            "value": 21029
          }
        },
        "a6552b94ea344a7fa53a35352c1743ef": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6d137f63d0f14053be7df4a557587e7b",
            "placeholder": "​",
            "style": "IPY_MODEL_bd35c05cb1c24645a8379085af5c5087",
            "value": " 21029/21029 [00:04&lt;00:00, 13699.16 examples/s]"
          }
        },
        "088c6c53f266406bba3f1614492793bc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1342101e639f42bba05a1ecdee4ae5b0": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a5f0590c337143f18de2cae6220438c0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2f6e799457e241e6803979f9d63126fe": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6116da2861ec4bb9ab7f3dc3dd062828": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "6d137f63d0f14053be7df4a557587e7b": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "bd35c05cb1c24645a8379085af5c5087": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "899129dc4b1a440189ad260c70719e9e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_63819eb6a68a4bbcb86097deca94fad2",
              "IPY_MODEL_4c9e79a8ca6246c19abfc0136bc6c9ef",
              "IPY_MODEL_3d9be9df29a24dc39da2790c62022c3e"
            ],
            "layout": "IPY_MODEL_102f47d56b884467aac72e6c92410945"
          }
        },
        "63819eb6a68a4bbcb86097deca94fad2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5bcf49bfcc9f4bd98aefec9914362d67",
            "placeholder": "​",
            "style": "IPY_MODEL_27f1aef7f00749a49429b62ea8e24c77",
            "value": "Tokenizing train dataset (num_proc=4): 100%"
          }
        },
        "4c9e79a8ca6246c19abfc0136bc6c9ef": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_68b99acc74a043f4a3c8863deef2b38e",
            "max": 21029,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_e44f6f098c554a268849d0e9854da9ab",
            "value": 21029
          }
        },
        "3d9be9df29a24dc39da2790c62022c3e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5584dee86489456fa5081d28cf3ae894",
            "placeholder": "​",
            "style": "IPY_MODEL_d72981c7760e492bb99010baef06488e",
            "value": " 21029/21029 [00:12&lt;00:00, 2211.90 examples/s]"
          }
        },
        "102f47d56b884467aac72e6c92410945": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5bcf49bfcc9f4bd98aefec9914362d67": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "27f1aef7f00749a49429b62ea8e24c77": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "68b99acc74a043f4a3c8863deef2b38e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e44f6f098c554a268849d0e9854da9ab": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "5584dee86489456fa5081d28cf3ae894": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d72981c7760e492bb99010baef06488e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "aa58e4a7a57c4f9a810d8e6bd6f8d8ef": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_99545b5498674edb9e06f9b71f8eb860",
              "IPY_MODEL_9b59528418774c1586b3fd637af6d730",
              "IPY_MODEL_cb79e36afe3f484198b0215bd0180260"
            ],
            "layout": "IPY_MODEL_d3e11401c1e34bd3a1e283f68e566180"
          }
        },
        "99545b5498674edb9e06f9b71f8eb860": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e5b705fdc1584bd1978b9dd83a63f356",
            "placeholder": "​",
            "style": "IPY_MODEL_e057e275c41d4d3590450cb0696b5768",
            "value": "Tokenizing train dataset (num_proc=4): 100%"
          }
        },
        "9b59528418774c1586b3fd637af6d730": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_890f8f47485f43f1903fd7d382c6f5db",
            "max": 21029,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_2c4f42c69e9946eebb9d17b0968e4550",
            "value": 21029
          }
        },
        "cb79e36afe3f484198b0215bd0180260": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_1246631ec02242d9a8ce291332dc2bb5",
            "placeholder": "​",
            "style": "IPY_MODEL_fc51618d304c4eb0820a1a443223e654",
            "value": " 21029/21029 [00:04&lt;00:00, 3016.69 examples/s]"
          }
        },
        "d3e11401c1e34bd3a1e283f68e566180": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e5b705fdc1584bd1978b9dd83a63f356": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e057e275c41d4d3590450cb0696b5768": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "890f8f47485f43f1903fd7d382c6f5db": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "2c4f42c69e9946eebb9d17b0968e4550": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "1246631ec02242d9a8ce291332dc2bb5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fc51618d304c4eb0820a1a443223e654": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        }
      }
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}