Hello.
What you need currently exists only on macOS with Xcode by using Create ML framework.
You can find documentation
here.
You can't use Create ML framework today in your apps. Only available into scripts and playgrounds.
But you can easily create Core ML models on servers using
Turi Create.
It works fine with
Tabular data.
My suggestion if you want to ensure privacy for your users:
use encryption with server (end-to-end encryption is the best)
upload real data with a UUID and append fake data with random UUID (ie. 1 good sample, 3 fake samples)
store the "good" UUID locally
download results later by sending UUID (ie. 1 good UUID, 3 fake UUID)
server will return good result + random results
use local UUID to identify good result.
If your model is public and can be used by any user, you can use distribute it by using
model deployment presented this year.
And, once Create ML will be available for apps, you will be able to make it available for your users.