Docker compose up and down issue when dealing with multiple forks of a repo

Question

Lets say I have a original project locally at /path/to/org/project which uses docker compose.

I also have its fork at /path/to/user/project. Both are in same state.

I start Docker containers in original project:

user@host:/path/to/org/project$ docker compose up -d

Now in fork when I try to run:

user@host:/path/to/user/project$ docker compose down --remove-orphans

it removes container created by original repo.

Why so?