Importing an external framework in Swift playground

I have tried everything to import a framework in a playground. I think I have set the target correctly and my framework compiles correctly. I even have a .swift file for the playground to reference the framework

Here is the hierarchy

SwiftProjWorkspace

- SwiftProjPlayground

- SwiftProjFramework

-SwiftProjPlayground.swift --> This is a dummy swift file

error: SwiftPlayground.playground:4:8: error: no such module 'SwiftFramework'

import SwiftFramework

I am compiling on actual device target. Since I am using REalityKit, I need an actual device.

Any help would be appreciated.