Merge pull request #176 from microsoft/pre-release

New release for 1.2.1

.gitignore

@@ -4,6 +4,7 @@
 # Ignore Jupyter Notebook checkpoints
 .ipynb_checkpoints
 /test/*
+/testing/*
 /deprecated/*
 /test/*.ipynb
 /logs/*
@@ -38,4 +39,7 @@ scripts/*
 .vscode
 
 # Ignore the record files
-tasks_status.json
+tasks_status.json
+datas
+_datas
+datasUFO

README.md

@@ -35,6 +35,9 @@ Both agents leverage the multi-modal capabilities of GPT-4V(o) to comprehend the
 
 
 ## 📢 News
+- 📅 2025-01-21: Version **v1.2.1** Released! We’re excited to announce the release of **v1.2.1**! 🎉 This update includes:
+    1. **Bug Fixes**: Resolved issues in `requirements.txt` for smoother setup.
+    2. **Multi-Action Mode**: Introducing a powerful new feature to execute **multiple actions** in a single inference step! Enable this mode by setting `ACTION_SEQUENCE=True` in `config_dev.yaml` and enjoy a more efficient workflow.
 - 📅 2024-12-13: We have a **New Release for v1.2.0!**! Checkout our new features and improvements:
     1. **Large Action Model (LAM) Data Collection:** We have released the code and sample data for Large Action Model (LAM) data collection with UFO! Please checkout our [new paper](https://arxiv.org/abs/2412.10047), [code](dataflow/README.md) and [documentation](https://microsoft.github.io/UFO/dataflow/overview/) for more details.    
     2. **Bash Command Support:** HostAgent also support bash command now!

dataflow/.gitignore

@@ -2,4 +2,10 @@
 cache/
 controls_cache/
 controller/utils/
-config/config.yaml
+config/config.yaml
+tasks/
+logs/
+results/
+_logs
+_results/
+*.zip

dataflow/README.md

@@ -189,21 +189,23 @@ Also, you can choose to use `instantiation` / `execution` sections individually,
 
 The default task hub is set to be `"TASKS_HUB"` in `dataflow/config_dev.yaml`.
 
-1. Dataflow Task:
+You can use `"TEMPLATE_METHOD"` in `dataflow/config_dev.yaml` to choose `LLM` or `SemanticSimilarity` as the backend for the template selection function. If you choose `LLM`, since the visual version is being used, you need to manually generate screenshots in the `templates/"YOUR_APP"/images` directory, and the filenames should match the template name and the screenshots should in `PNG` format.
 
-- ```bash
-  python -m dataflow -dataflow --task_path path_to_task_file
+* Dataflow Task:
+
+  ```bash
+  python -m dataflow --dataflow --task_path path_to_task_file
   ```
 
 * Instantiation Task:
 
   ```bash
-  python -m dataflow -instantiation --task_path path_to_task_file
+  python -m dataflow --instantiation --task_path path_to_task_file
   ```
 * Execution Task:
 
   ```bash
-  python -m dataflow -execution --task_path path_to_task_file
+  python -m dataflow --execution --task_path path_to_task_file
   ```
 
 ## Workflow
@@ -221,6 +223,7 @@ Given the initial task, the dataflow first choose a template (`Phase 1`), the pr
 <h1 align="center">
     <img src="../assets/dataflow/instantiation.png"/> 
 </h1>
+
 #### 1. Choose Template File
 
 Templates for your app must be defined and described in `dataflow/templates/app`. For instance, if you want to instantiate tasks for the Word application, place the relevant `.docx` files in dataflow `/templates/word `, along with a `description.json` file.

dataflow/config/config_dev.yaml

@@ -11,6 +11,14 @@ FILTER_PROMPT: "dataflow/prompts/instantiation/{mode}/filter.yaml"  # The prompt
 PREFILL_EXAMPLE_PROMPT: "dataflow/prompts/instantiation/{mode}/prefill_example.yaml"  # The prompt for the action prefill example
 API_PROMPT: "ufo/prompts/share/lite/api.yaml"  # The prompt for the API
 
+# Template Configuration
+TEMPLATE_METHOD: "LLM"  # The method for the template, support 'SemanticSimilarity', 'LLM'.
+TEMPLATE_PROMPT: "dataflow/prompts/instantiation/{mode}/template.yaml"  # The prompt for the template
+
+# Reformat Configuration
+REFORMAT_TO_BATCH: True # Whether to reformat the result of dataflow to the format of the UFO batch mode
+REFORMAT_TO_BATCH_HUB: "datasUFO"  # The reformat result path
+
 # Default Task Configuration
 TASKS_HUB: "dataflow/tasks/prefill"  # The default tasks hub for batch dataflow
 TEMPLATE_PATH: "dataflow/templates"  # The template path for the exploration