Okay, after trying to download Xcode from AppStore, I decided to cancel and extract the .xip file directly downloaded,
I made a copy to an external SSD, the issue was I discovered that the version was not compatible with my current macOS version, so I decided to cancel the copy.
That was the mistake. I downloaded again but now, the compatible version. I extracted and moved the app to the external SSD.
After hours trying to understand why after moving the app my storage was drastically down from 78GB to 40GB found the AppStore download was not deleted. Plus the "cancelled" copy was also not successfully cleaned up.
open $TMPDIR/..
Then I previewed all 5 dirs and discovered ~35GB in use. That finally resolved the abrupt change of storage. Hope it helps someone.