I just solved this issue for my ipad last night. I had 120gb of used space on my ipad and my apple music was displaying on ipad storage that it was using 4gb of data but when I uninstalled apple music, my storage went down to 74 gb used. Thats almost 50gb just from apple music even though I didn't download one single song. It was all hidden cache.