[trace][devkit] Support new design of collection in trace experience

[zhengfeiwang]

Description

This PR targets to support new design of collection in trace.

SDK experience with start_trace

• if user specifies collection, we will honor it, until next time user specifies
• if not specify, will use current working directory
• when not specify and flow test or batch run, will use flow path folder name

CLI experience to specify collection

Support pf flow test ... --collection <collection> to specify collection, similar experience as start_trace in CLI

Local to cloud experience

Update urls for portal trace ui, will distinguish Azure ML workspace and AI project, flow test and batch run.

Minor: new session id concept support

Will set session_id in span attributes now, which serves for chat-windows experience.

Copilot-generated description

New Collection Parameter:

• src/promptflow-devkit/promptflow/_cli/_pf/_flow.py: The add_parser_test_flow function now includes a new collection parameter. This parameter is also passed to the _test_flow_interactive, _test_flow_standard, and _test_flow_experiment functions. [1] [2] [3] [4] [5]

• src/promptflow-devkit/promptflow/_sdk/_orchestrator/run_submitter.py: The _run_bulk function now imports is_collection_writeable and uses it to determine whether to use the flow name as the collection.

• src/promptflow-devkit/promptflow/_sdk/_orchestrator/test_submitter.py: The init function now accepts a collection parameter. This parameter is then used to determine whether to use the user-specified collection or the flow name as the collection. [1] [2] [3] [4]

Refactoring and Logging Improvements:

• src/promptflow-devkit/promptflow/_sdk/_tracing.py: Several functions in this file have been refactored for better clarity and organization. Additionally, logging statements have been added or improved for better debugging. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10]

All Promptflow Contribution checklist:

• The pull request does not introduce [breaking changes].
• CHANGELOG is updated for new features, bug fixes or other significant changes.
• I have read the contribution guidelines.
• Create an issue and link to the pull request to get dedicated review from promptflow team. Learn more: suggested workflow.

General Guidelines and Best Practices

• Title of the pull request is clear and informative.
• There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

• Pull request includes test coverage for the included changes.

[github-actions]

promptflow-tracing test result

 12 files   12 suites   11s ⏱️
 55 tests  55 ✅ 0 💤 0 ❌
660 runs  660 ✅ 0 💤 0 ❌

Results for commit 03ae26f.

♻️ This comment has been updated with latest results.

[github-actions]

promptflow SDK CLI Azure E2E Test Result zhengfei/feature/trace-collection

  4 files    4 suites   4m 44s ⏱️
213 tests 193 ✅ 20 💤 0 ❌
852 runs  772 ✅ 80 💤 0 ❌

Results for commit 03ae26f.

♻️ This comment has been updated with latest results.

[github-actions]

Executor Unit Test Result zhengfei/feature/trace-collection

778 tests   778 ✅  3m 41s ⏱️
  1 suites    0 💤
  1 files      0 ❌

Results for commit 03ae26f.

♻️ This comment has been updated with latest results.

[github-actions]

Executor E2E Test Result zhengfei/feature/trace-collection

238 tests   236 ✅  8m 0s ⏱️
  1 suites    2 💤
  1 files      0 ❌

Results for commit 03ae26f.

♻️ This comment has been updated with latest results.

[github-actions]

SDK CLI Test Result zhengfei/feature/trace-collection

    4 files      4 suites   44m 59s ⏱️
  579 tests   558 ✅ 21 💤 0 ❌
2 316 runs  2 232 ✅ 84 💤 0 ❌

Results for commit 03ae26f.

♻️ This comment has been updated with latest results.