CODEWITHSUNDEEP
tensorflow-litennapi
Di Wang
Di Wang

Reputation: 481

"Tensorflow + NNAPI" runs very slow on Samsung Galaxy S21

Samsung Galaxy S21 is the only device runs slow when using tensor-flow lite and NNAPI together. Did anyone encounter this issue before?

Background

I used tensor-flow lite and NNAPI and built my app on different Android devices. Samsung Galaxy S21 is VERY slow (0.5 fps); All other devices (including Samsung Galaxy S20) is fast (12-20 fps).

Without using NNAPI, using GPU/CPU delegates, Samsung Galaxy S21 can run at (9-10 fps).

Implementation:

I set interpreter to use NNAPI:

TfLiteInterpreterOptionsSetUseNNAPI(m_options, true);

and then invoke interpreter using:

TfLiteInterpreterInvoke(m_interpreter);

Result:

I time stamped TfLiteInterpreterInvoke() method on different Android devices. Here are the results:

Profiled Trace

Then I used Android Profiler to trace the CPU usage in Samsung Galaxy S21:

ANeuralNetworksExecution_compute()                    --- 851 ms
    compute()                                         --- 851 ms
       ...
          [kernel.kallsysms]+ 0xffffffc---------().   --- 851 ms 
          [kernel.kallsysms]+ 0xffffffc---------().   --- 851 ms 
          [kernel.kallsysms]+ 0xffffffc---------().   --- 851 ms
          .....

It looks like the majority of the time is spent on the GPU kernels. Does this mean S21 GPU is not compatible with NNAPI and tensorflow?

Upvotes: 2

Views: 515

Answers (1)

Miao Wang
Miao Wang

Reputation: 1130

Could you try adb shell setprop debug.nn.vlog 1, rerun the test and share the logcat?

Upvotes: 0

Related Questions