ANE not support flexible input shape

Question

Created Jan ’21

Replies 2

Boosts 1

Participants 2

I have tried both ImageType and TensorType as my input, Flexible input shape can NOT use ANE even with MLComputeUnitsAll, use GPU instead when default shape set, use CPU ONLY without default shape

Boost

Answer 1

flyingmadden OP

Jan ’21

can you post an example?

0

Answer 2

masquerader OP

Jan ’21

Code Block python    image_input = ct.TensorType(name="input", shape=(1, 3, ct.RangeDim(default=720), ct.RangeDim(default=720)))
    mlmodel = ct.convert(trace, inputs=[image_input], source='pytorch', convert_to='nn_proto')

GPU support, ANE not working

Code Block python    image_input = ct.TensorType(name="input", shape=(1, 3, ct.RangeDim(), ct.RangeDim()))
    mlmodel = ct.convert(trace, inputs=[image_input], source='pytorch', convert_to='nn_proto')

CPU ONLY

How to make ANE working with flexible input shape?

0