I thought if a player took a world belonging to someone else if would just look like a regular world. Not sure why the HW marker would move.

It is very weird.