Visual Studio fails to connect to a remote Linux machine to debug a .NET 6 application

Question

I am facing the issue while remote debugging on Raspberry Pi Zero 2 (Raspberry OS Wornbook). I have a .NET 6.0 C# based console application that I want to attach to in the Linux machine.

I can connect through SSH and everything works from an SSH point of view (I copy the results though SSH with SCP on Publish, etc).

When I try to attach to the process (I see it in the list of processes) it fails and the console always show:

Command "/bin/sh "/home/s0m0s/.vs-debugger/GetVsDbg.sh" -v vs2022 -u -l "/home/s0m0s/.vs-debugger/vs2022" -d vscode -a "/remote_debugger"" finished with exit code -1 after 5148,7737ms

If I take that line and execute it manually with SSH it works:

Anyway it is not like VS detects it running so if I try to connect to the process again I get the same message.

Any idea on how to make this work? I am kind of blocked here.