monkey patch not working after update

[caterpillarpants]

Describe the bug

Hello everyone,

I have been using the oobabooga text-generation-webui for about a year since last install and recently encountered an issue after updating the software. Specifically, 4-bit training is no longer working, and I receive an error indicating that "monkey-patch" is not installed.

Despite multiple attempts to resolve this, I have been unable to find a consistent solution. I understand that this issue has been known for some time, and I appreciate the efforts of the maintainers and community in addressing various challenges. I was able to get it working last time I installed, but I remember it was a headache and the methods I used then are no longer in the docs; appear to be very different now.

I have tried searching around and even had perplexity and copilot try to help, but we couldn't figure it out. Could anyone please provide guidance on how to properly install "monkey-patch" or suggest any steps I might have missed to get 4-bit training working again? Any help would be greatly appreciated.

Alternatively, if a hash of a working version can be provided, that might work.

Thank you for your time and assistance.

Love the project!

Is there an existing issue for this?

• I have searched the existing issues

Reproduction

fresh install of text-gen
load model in 4 bit
I activate "training pro"
start training

cloning john's alpaca 4bit does not work.
editing system.py to import monkey-patch does not work.
starting with --monkey-patch flag does not work.

This is what I have tried this time.

Screenshot

AttributeError: 'Namespace' object has no attribute 'monkey_patch'

Logs

Traceback (most recent call last):
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/gradio/queueing.py", line 527, in process_events
    response = await route_utils.call_process_api(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/gradio/route_utils.py", line 261, in call_process_api
    output = await app.get_blocks().process_api(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/gradio/blocks.py", line 1786, in process_api
    result = await self.call_function(
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/gradio/blocks.py", line 1350, in call_function
    prediction = await utils.async_iteration(iterator)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/gradio/utils.py", line 583, in async_iteration
    return await iterator.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/gradio/utils.py", line 576, in __anext__
    return await anyio.to_thread.run_sync(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
           ^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
             ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/gradio/utils.py", line 559, in run_sync_iterator_async
    return next(iterator)
           ^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/gradio/utils.py", line 742, in gen_wrapper
    response = next(iterator)
               ^^^^^^^^^^^^^^
  File "/home/ana/text-generation-webui-main/extensions/Training_PRO/script.py", line 560, in do_train
    if shared.args.monkey_patch:
       ^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'Namespace' object has no attribute 'monkey_patch'

System Info

linux, nvidia 2070

[caterpillarpants]

Well, I broke my text-generation-webui trying to get monkey patch working so I have deleted it and done a fresh install. I am now hoping someone can point me to the current directions to install the monkey patch so I can train and infer in 4bit. Any help is much appreciated.

Thanks in advance!