Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YUV 4:4:4 lag/input lag/frame drops on FPS up leap #3507

Closed
2 tasks done
Sheynar opened this issue Jan 2, 2025 · 1 comment
Closed
2 tasks done

YUV 4:4:4 lag/input lag/frame drops on FPS up leap #3507

Sheynar opened this issue Jan 2, 2025 · 1 comment

Comments

@Sheynar
Copy link

Sheynar commented Jan 2, 2025

Is there an existing issue for this?

  • I have searched the existing issues

Is your issue described in the documentation?

  • I have read the documentation

Is your issue present in the latest beta/pre-release?

This issue is present in the latest pre-release

Describe the Bug

Using yuv 4:4:4 1920x1200/2560x1440 144fps windows 10 and 11, wired 1gb connection, when still on desktop it goes down to 7-9 fps, when you drag mouse fps jumps up to 144 fps with noticable slow movement on start of motion. If game provide consistant FPS - all is smooth as expected, On 144fps is buttery smooth.

Expected Behavior

More or less consistant feeling, tried out all same settings and moves in yuv 4:2:0 harware, and there is no such wierd behavior,

Additional Context

YUV 4:4:4 encription and decription is hardware

I've used bitrate 30mb and 500mb, on 500mb it get some time frame drops by network connection 25%+ and more. First noticed when work in blender (still image drop FPS to 7 and on move get back to 144), then found it on WorldOfTanks (on menu fps capped on 60, but when you move mouse, it renders it on 144 fps) and GenshinImpact (game cap 60fps, when use cursor it gets 144), this bug behavior feels like engaged brake on start movement.

Easy way to feel - get windows desktop, wait it still until fps drops to lowest and some seconds after, then move mouse in circles, start feels wierd.

Used Sunshine machines with 2070super win 10, 3070 win 11
moonlight client with 1650, 2070super and 3070, win 10 and 11

Sunshine machines were used with hardware monitor capable 144hz and software monitor emulation with 144hz
Moonlight machines were used with one with hardware monitor capable 144, and two other machines were capable only 60hz out (on this machines i've used 144hz stream and 60hz out, this provide better input output latency)

Described behavior exists In all cases.

Host Operating System

Windows

Operating System Version

Windows 10 22H2

Architecture

amd64/x86_64

Sunshine commit or version

v2025.102.32311

Package

Windows - installer (recommended)

GPU Type

NVIDIA

GPU Model

NVIDIA geforce RTX 2070 super

GPU Driver/Mesa Version

566.14

Capture Method

Desktop Duplication API (Windows)

Config

address_family = both
encoder = nvenc
resolutions = [
    352x240,
    480x360,
    858x480,
    1280x720,
    1920x1080,
    2560x1080,
    3440x1440,
    1920x1200,
    3840x2160,
    3840x1600,
    2560x1440
]
fps = [10,30,60,90,120,144]
min_fps_factor = 0
notify_pre_releases = enabled

Apps

Relevant log output

[2025-01-02 14:13:20.345]: Info: Sunshine version: v2025.102.32311
[2025-01-02 14:13:20.345]: Info: Package Publisher: LizardByte
[2025-01-02 14:13:20.345]: Info: Publisher Website: https://app.lizardbyte.dev
[2025-01-02 14:13:20.345]: Info: Get support: https://app.lizardbyte.dev/support
[2025-01-02 14:13:20.345]: Info: Provided workaround settings for SettingsManager:
{
  "hdr_blank_delay": null
}
[2025-01-02 14:13:20.347]: Info: Currently available display devices:
[
  {
    "device_id": "{8cfe1004-6202-59f4-8ae7-040525ffaecc}",
    "display_name": "\\\\.\\DISPLAY5",
    "friendly_name": "Linux FHD",
    "info": {
      "hdr_state": null,
      "origin_point": {
        "x": 0,
        "y": 0
      },
      "primary": true,
      "refresh_rate": {
        "type": "rational",
        "value": {
          "denominator": 1,
          "numerator": 144
        }
      },
      "resolution": {
        "height": 1200,
        "width": 1920
      },
      "resolution_scale": {
        "type": "rational",
        "value": {
          "denominator": 100,
          "numerator": 100
        }
      }
    }
  }
]
[2025-01-02 14:13:20.516]: Info: nvprefs: No need to modify application profile settings
[2025-01-02 14:13:20.516]: Info: nvprefs: Changed OGL_CPL_PREFER_DXPRESENT to OGL_CPL_PREFER_DXPRESENT_PREFER_ENABLED for base profile
[2025-01-02 14:13:20.557]: Info: Compiling shaders...
[2025-01-02 14:13:20.578]: Info: System tray created
[2025-01-02 14:13:20.652]: Info: Compiled shaders
[2025-01-02 14:13:20.659]: Info: Trying encoder [nvenc]
[2025-01-02 14:13:20.840]: Info: ddprobe.exe 1  --verify-frame-capture returned 0x00000000
[2025-01-02 14:13:20.840]: Info: Set GPU preference: 1
[2025-01-02 14:13:21.086]: Info: 
Device Description : NVIDIA GeForce RTX 2070 SUPER
Device Vendor ID   : 0x000010DE
Device Device ID   : 0x00001E84
Device Video Mem   : 7989 MiB
Device Sys Mem     : 0 MiB
Share Sys Mem      : 16338 MiB
Feature Level      : 0x0000B100
Capture size       : 1920x1200
Offset             : 0x0
Virtual Desktop    : 1920x1200
[2025-01-02 14:13:21.087]: Info: Active GPU has HAGS disabled
[2025-01-02 14:13:21.087]: Info: Using realtime GPU priority
[2025-01-02 14:13:21.087]: Info: 
Colorspace         : DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P709
Bits Per Color     : 8
Red Primary        : [0.639648,0.330078]
Green Primary      : [0.299805,0.599609]
Blue Primary       : [0.149414,0.0595703]
White Point        : [0.3125,0.329102]
Min Luminance      : 0.5 nits
Max Luminance      : 270 nits
Max Full Luminance : 270 nits
[2025-01-02 14:13:21.087]: Info: Desktop resolution [1920x1200]
[2025-01-02 14:13:21.087]: Info: Desktop format [DXGI_FORMAT_B8G8R8A8_UNORM]
[2025-01-02 14:13:21.087]: Info: Display refresh rate [144Hz]
[2025-01-02 14:13:21.087]: Info: Requested frame rate [60fps]
[2025-01-02 14:13:21.090]: Info: Creating encoder [h264_nvenc]
[2025-01-02 14:13:21.090]: Info: Color coding: SDR (Rec. 601)
[2025-01-02 14:13:21.090]: Info: Color depth: 8-bit
[2025-01-02 14:13:21.090]: Info: Color range: JPEG
[2025-01-02 14:13:21.154]: Info: NvEnc: created encoder H.264 P1 two-pass rfi
[2025-01-02 14:13:21.182]: Info: Creating encoder [hevc_nvenc]
[2025-01-02 14:13:21.182]: Info: Color coding: SDR (Rec. 601)
[2025-01-02 14:13:21.182]: Info: Color depth: 8-bit
[2025-01-02 14:13:21.182]: Info: Color range: JPEG
[2025-01-02 14:13:21.243]: Info: NvEnc: created encoder HEVC P1 two-pass rfi
[2025-01-02 14:13:21.271]: Info: Creating encoder [av1_nvenc]
[2025-01-02 14:13:21.271]: Info: Color coding: SDR (Rec. 601)
[2025-01-02 14:13:21.271]: Info: Color depth: 8-bit
[2025-01-02 14:13:21.271]: Info: Color range: JPEG
[2025-01-02 14:13:21.299]: Error: NvEnc: encoding format is not supported by the gpu
[2025-01-02 14:13:21.306]: Info: Creating encoder [h264_nvenc]
[2025-01-02 14:13:21.306]: Info: Color coding: SDR (Rec. 601)
[2025-01-02 14:13:21.306]: Info: Color depth: 8-bit
[2025-01-02 14:13:21.306]: Info: Color range: JPEG
[2025-01-02 14:13:21.367]: Info: NvEnc: created encoder H.264 P1 yuv444 two-pass rfi
[2025-01-02 14:13:21.619]: Info: 
Device Description : NVIDIA GeForce RTX 2070 SUPER
Device Vendor ID   : 0x000010DE
Device Device ID   : 0x00001E84
Device Video Mem   : 7989 MiB
Device Sys Mem     : 0 MiB
Share Sys Mem      : 16338 MiB
Feature Level      : 0x0000B100
Capture size       : 1920x1200
Offset             : 0x0
Virtual Desktop    : 1920x1200
[2025-01-02 14:13:21.619]: Info: Active GPU has HAGS disabled
[2025-01-02 14:13:21.619]: Info: Using realtime GPU priority
[2025-01-02 14:13:21.619]: Info: 
Colorspace         : DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P709
Bits Per Color     : 8
Red Primary        : [0.639648,0.330078]
Green Primary      : [0.299805,0.599609]
Blue Primary       : [0.149414,0.0595703]
White Point        : [0.3125,0.329102]
Min Luminance      : 0.5 nits
Max Luminance      : 270 nits
Max Full Luminance : 270 nits
[2025-01-02 14:13:21.619]: Info: Desktop resolution [1920x1200]
[2025-01-02 14:13:21.619]: Info: Desktop format [DXGI_FORMAT_B8G8R8A8_UNORM]
[2025-01-02 14:13:21.619]: Info: Display refresh rate [144Hz]
[2025-01-02 14:13:21.620]: Info: Requested frame rate [60fps]
[2025-01-02 14:13:21.622]: Info: Creating encoder [hevc_nvenc]
[2025-01-02 14:13:21.622]: Info: Color coding: SDR (Rec. 709)
[2025-01-02 14:13:21.622]: Info: Color depth: 10-bit
[2025-01-02 14:13:21.622]: Info: Color range: JPEG
[2025-01-02 14:13:21.813]: Info: NvEnc: created encoder HEVC P1 yuv444 10-bit two-pass rfi
[2025-01-02 14:13:21.865]: Info: // Testing for available encoders, this may generate errors. You can safely ignore those errors. //
[2025-01-02 14:13:21.865]: Info: 
[2025-01-02 14:13:21.865]: Info: // Ignore any errors mentioned above, they are not relevant. //
[2025-01-02 14:13:21.865]: Info: 
[2025-01-02 14:13:21.865]: Info: Found H.264 encoder: h264_nvenc [nvenc]
[2025-01-02 14:13:21.865]: Info: Found HEVC encoder: hevc_nvenc [nvenc]
[2025-01-02 14:13:21.869]: Info: Configuration UI available at [https://localhost:47990]
[2025-01-02 14:13:22.631]: Info: Registered Sunshine mDNS service
[2025-01-02 14:13:39.391]: Info: Encoder reenumeration is required
[2025-01-02 14:13:39.391]: Info: Trying encoder [nvenc]
[2025-01-02 14:13:39.627]: Info: 
Device Description : NVIDIA GeForce RTX 2070 SUPER
Device Vendor ID   : 0x000010DE
Device Device ID   : 0x00001E84
Device Video Mem   : 7989 MiB
Device Sys Mem     : 0 MiB
Share Sys Mem      : 16338 MiB
Feature Level      : 0x0000B100
Capture size       : 1920x1200
Offset             : 0x0
Virtual Desktop    : 1920x1200
[2025-01-02 14:13:39.627]: Info: Active GPU has HAGS disabled
[2025-01-02 14:13:39.627]: Info: Using realtime GPU priority
[2025-01-02 14:13:39.627]: Info: 
Colorspace         : DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P709
Bits Per Color     : 8
Red Primary        : [0.639648,0.330078]
Green Primary      : [0.299805,0.599609]
Blue Primary       : [0.149414,0.0595703]
White Point        : [0.3125,0.329102]
Min Luminance      : 0.5 nits
Max Luminance      : 270 nits
Max Full Luminance : 270 nits
[2025-01-02 14:13:39.628]: Info: Desktop resolution [1920x1200]
[2025-01-02 14:13:39.628]: Info: Desktop format [DXGI_FORMAT_B8G8R8A8_UNORM]
[2025-01-02 14:13:39.628]: Info: Display refresh rate [144Hz]
[2025-01-02 14:13:39.628]: Info: Requested frame rate [60fps]
[2025-01-02 14:13:39.631]: Info: Creating encoder [h264_nvenc]
[2025-01-02 14:13:39.631]: Info: Color coding: SDR (Rec. 601)
[2025-01-02 14:13:39.631]: Info: Color depth: 8-bit
[2025-01-02 14:13:39.631]: Info: Color range: JPEG
[2025-01-02 14:13:39.704]: Info: NvEnc: created encoder H.264 P1 two-pass rfi
[2025-01-02 14:13:39.731]: Info: Creating encoder [hevc_nvenc]
[2025-01-02 14:13:39.731]: Info: Color coding: SDR (Rec. 601)
[2025-01-02 14:13:39.731]: Info: Color depth: 8-bit
[2025-01-02 14:13:39.731]: Info: Color range: JPEG
[2025-01-02 14:13:39.795]: Info: NvEnc: created encoder HEVC P1 two-pass rfi
[2025-01-02 14:13:39.823]: Info: Creating encoder [av1_nvenc]
[2025-01-02 14:13:39.823]: Info: Color coding: SDR (Rec. 601)
[2025-01-02 14:13:39.823]: Info: Color depth: 8-bit
[2025-01-02 14:13:39.823]: Info: Color range: JPEG
[2025-01-02 14:13:39.848]: Error: NvEnc: encoding format is not supported by the gpu
[2025-01-02 14:13:39.855]: Info: Creating encoder [h264_nvenc]
[2025-01-02 14:13:39.855]: Info: Color coding: SDR (Rec. 601)
[2025-01-02 14:13:39.855]: Info: Color depth: 8-bit
[2025-01-02 14:13:39.855]: Info: Color range: JPEG
[2025-01-02 14:13:39.915]: Info: NvEnc: created encoder H.264 P1 yuv444 two-pass rfi
[2025-01-02 14:13:40.174]: Info: 
Device Description : NVIDIA GeForce RTX 2070 SUPER
Device Vendor ID   : 0x000010DE
Device Device ID   : 0x00001E84
Device Video Mem   : 7989 MiB
Device Sys Mem     : 0 MiB
Share Sys Mem      : 16338 MiB
Feature Level      : 0x0000B100
Capture size       : 1920x1200
Offset             : 0x0
Virtual Desktop    : 1920x1200
[2025-01-02 14:13:40.174]: Info: Active GPU has HAGS disabled
[2025-01-02 14:13:40.174]: Info: Using realtime GPU priority
[2025-01-02 14:13:40.174]: Info: 
Colorspace         : DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P709
Bits Per Color     : 8
Red Primary        : [0.639648,0.330078]
Green Primary      : [0.299805,0.599609]
Blue Primary       : [0.149414,0.0595703]
White Point        : [0.3125,0.329102]
Min Luminance      : 0.5 nits
Max Luminance      : 270 nits
Max Full Luminance : 270 nits
[2025-01-02 14:13:40.175]: Info: Desktop resolution [1920x1200]
[2025-01-02 14:13:40.175]: Info: Desktop format [DXGI_FORMAT_B8G8R8A8_UNORM]
[2025-01-02 14:13:40.175]: Info: Display refresh rate [144Hz]
[2025-01-02 14:13:40.175]: Info: Requested frame rate [60fps]
[2025-01-02 14:13:40.178]: Info: Creating encoder [hevc_nvenc]
[2025-01-02 14:13:40.178]: Info: Color coding: SDR (Rec. 709)
[2025-01-02 14:13:40.178]: Info: Color depth: 10-bit
[2025-01-02 14:13:40.178]: Info: Color range: JPEG
[2025-01-02 14:13:40.306]: Info: NvEnc: created encoder HEVC P1 yuv444 10-bit two-pass rfi
[2025-01-02 14:13:40.361]: Info: // Testing for available encoders, this may generate errors. You can safely ignore those errors. //
[2025-01-02 14:13:40.361]: Info: 
[2025-01-02 14:13:40.361]: Info: // Ignore any errors mentioned above, they are not relevant. //
[2025-01-02 14:13:40.361]: Info: 
[2025-01-02 14:13:40.361]: Info: Found H.264 encoder: h264_nvenc [nvenc]
[2025-01-02 14:13:40.361]: Info: Found HEVC encoder: hevc_nvenc [nvenc]
[2025-01-02 14:13:40.361]: Info: Executing [Desktop]
[2025-01-02 14:13:40.434]: Info: New streaming session started [active sessions: 1]
[2025-01-02 14:13:40.611]: Info: nvprefs: No need to modify application profile settings
[2025-01-02 14:13:40.611]: Info: nvprefs: No need to modify global profile settings
[2025-01-02 14:13:40.643]: Info: CLIENT CONNECTED
[2025-01-02 14:13:40.936]: Info: Changed virtual audio sink format to [S24 48000 2.0]
[2025-01-02 14:13:41.012]: Info: 
Device Description : NVIDIA GeForce RTX 2070 SUPER
Device Vendor ID   : 0x000010DE
Device Device ID   : 0x00001E84
Device Video Mem   : 7989 MiB
Device Sys Mem     : 0 MiB
Share Sys Mem      : 16338 MiB
Feature Level      : 0x0000B100
Capture size       : 1920x1200
Offset             : 0x0
Virtual Desktop    : 1920x1200
[2025-01-02 14:13:41.012]: Info: Active GPU has HAGS disabled
[2025-01-02 14:13:41.012]: Info: Using realtime GPU priority
[2025-01-02 14:13:41.012]: Info: 
Colorspace         : DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P709
Bits Per Color     : 8
Red Primary        : [0.639648,0.330078]
Green Primary      : [0.299805,0.599609]
Blue Primary       : [0.149414,0.0595703]
White Point        : [0.3125,0.329102]
Min Luminance      : 0.5 nits
Max Luminance      : 270 nits
Max Full Luminance : 270 nits
[2025-01-02 14:13:41.013]: Info: Desktop resolution [1920x1200]
[2025-01-02 14:13:41.013]: Info: Desktop format [DXGI_FORMAT_B8G8R8A8_UNORM]
[2025-01-02 14:13:41.013]: Info: Display refresh rate [144Hz]
[2025-01-02 14:13:41.013]: Info: Requested frame rate [144fps]
[2025-01-02 14:13:41.017]: Info: Creating encoder [hevc_nvenc]
[2025-01-02 14:13:41.017]: Info: Color coding: SDR (Rec. 709)
[2025-01-02 14:13:41.017]: Info: Color depth: 8-bit
[2025-01-02 14:13:41.017]: Info: Color range: JPEG
[2025-01-02 14:13:41.020]: Info: Capture format [DXGI_FORMAT_B8G8R8A8_UNORM]
[2025-01-02 14:13:41.025]: Info: Audio capture format is [F32 48000 2.0]
[2025-01-02 14:13:41.028]: Info: Opus initialized: 48 kHz, 2 channels, 512 kbps (total), LOWDELAY
[2025-01-02 14:13:41.088]: Info: NvEnc: created encoder HEVC P1 yuv444 two-pass rfi
[2025-01-02 14:14:29.784]: Info: CLIENT DISCONNECTED
@Sheynar
Copy link
Author

Sheynar commented Jan 2, 2025

It's related to #3419, but frame rate goes down related to FPS rendering on server pc.

This issie is about laggy work of Sunshine on server FPS going UP from low fps to high and only on YUV 4:4:4 (as it on 4:2:0 works realy good), and some times it gets drop frames on this leaps on YUV 4:4:4.

Or i need to post information about this behavior as comment on #3419?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants