Build fingerprint: 'Xiaomi/libra/libra:5.1.1/LMY47V/5.11.1:user/release-keys' Revision: '0' ABI: 'arm' pid: 10250, tid: 10273, name: ImageListener >>> org.tensorflow.tensorflowdemo <<< signal 6 (SIGABRT), code -6 (SI_TKILL), fault addr -------- Abort message: 'jni_utils.cc:92 'asset' Must be non NULL' r0 00000000 r1 00002821 r2 00000006 r3 00000000 r4 e29c4dd8 r5 00000006 r6 00000000 r7 0000010c r8 e29c3ad4 r9 e29c39d8 sl 00000000 fp 00000000 ip 00002821 sp e29c3980 lr f7072e89 pc f709972c cpsr 600f0010

backtrace: #00 pc 0003a72c /system/lib/libc.so (tgkill+12) #01 pc 00013e85 /system/lib/libc.so (pthread_kill+52) #02 pc 00014aa3 /system/lib/libc.so (raise+10) #03 pc 0001131d /system/lib/libc.so (__libc_android_abort+36) #04 pc 0000f54c /system/lib/libc.so (abort+4) #05 pc 0053d03c /data/app/org.tensorflow.tensorflowdemo-1/lib/arm/libtensorflow_demo.so #06 pc 0053d1bc /data/app/org.tensorflow.tensorflowdemo-1/lib/arm/libtensorflow_demo.so #07 pc 0053d1d8 /data/app/org.tensorflow.tensorflowdemo-1/lib/arm/libtensorflow_demo.so #08 pc 000746b4 /data/app/org.tensorflow.tensorflowdemo-1/lib/arm/libtensorflow_demo.so #09 pc 00075594 /data/app/org.tensorflow.tensorflowdemo-1/lib/arm/libtensorflow_demo.so (ReadFileToProto(AAssetManager*, char const*, google::protobuf::MessageLite*)+1144) #10 pc 00077bdc /data/app/org.tensorflow.tensorflowdemo-1/lib/arm/libtensorflow_demo.so (Java_org_tensorflow_demo_TensorFlowClassifier_initializeTensorFlow+1084) #11 pc 000a2511 /system/lib/libart.so (art_quick_generic_jni_trampoline+32) #12 pc 00136c1c /dev/ashmem/dalvik-main space (deleted)

Very usefully app, I want to include my own training model to the app to be able to detect different objects or features. Any suggestion where to start?, thank you!

Hello! Thank you for your nice implementation.

I would like to know how to make ".pb" file form output of darknet. Did you use this ( https://github.com/thtrieu/darkflow ) ?

I am really glad if you help me!

Hi,

I believe the pb file you derived is for yolo-voc, however, I would like to have a pb file for YOLOv2 608x608 ( https://pjreddie.com/darknet/yolo/).

Use darkflow (https://github.com/thtrieu/darkflow) I was able to create a pb file using yolo.cfg and yolo.weights.

I copied the yolo.pb file into the assets folder and when I try to install the apk, I get the following error:

03-31 16:08:26.398 19432-19652/org.tensorflow.tensorflowdemo I/tensorflow: CameraConnectionFragment: Opening camera preview: 480x640 03-31 16:08:26.402 19432-19432/org.tensorflow.tensorflowdemo V/BoundingBox: width: 1080.0 height: 1794.0 03-31 16:08:26.415 19432-19652/org.tensorflow.tensorflowdemo I/tensorflow: CameraConnectionFragment: Getting assets. 03-31 16:08:26.415 19432-19652/org.tensorflow.tensorflowdemo I/native: tensorflow_jni.cc:115 Loading TensorFlow. 03-31 16:08:26.415 19432-19652/org.tensorflow.tensorflowdemo I/native: tensorflow_jni.cc:117 Making new SessionOptions. 03-31 16:08:26.415 19432-19652/org.tensorflow.tensorflowdemo I/native: tensorflow_jni.cc:120 Got config, 0 devices 03-31 16:08:26.417 19432-19652/org.tensorflow.tensorflowdemo I/native: tensorflow_jni.cc:123 Session created. 03-31 16:08:26.417 19432-19652/org.tensorflow.tensorflowdemo I/native: tensorflow_jni.cc:126 Graph created. 03-31 16:08:26.417 19432-19652/org.tensorflow.tensorflowdemo I/native: tensorflow_jni.cc:130 Acquired AssetManager. 03-31 16:08:26.417 19432-19652/org.tensorflow.tensorflowdemo I/native: tensorflow_jni.cc:132 Reading file to proto: file:///android_asset/yolo.pb 03-31 16:08:26.797 19432-19652/org.tensorflow.tensorflowdemo I/native: stat_summarizer.cc:33 StatSummarizer found 349 nodes 03-31 16:08:26.798 19432-19652/org.tensorflow.tensorflowdemo I/native: tensorflow_jni.cc:137 Creating session. 03-31 16:08:26.827 19432-19652/org.tensorflow.tensorflowdemo A/native: tensorflow_jni.cc:140 Could not create TensorFlow Graph: Not found: Op type not registered 'RealDiv' 03-31 16:08:26.834 19432-19652/org.tensorflow.tensorflowdemo A/libc: Fatal signal 6 (SIGABRT), code -6 in tid 19652 (ImageListener) 03-31 16:08:26.834 368: 368 W/ ] debuggerd: handling request: pid=19432 uid=10094 gid=10094 tid=19652

@hashimshafiq @natanielruiz Hi can u pls guide what all parameters to be changed if we change the model file trained for custom object detection. I have converted my model file using darkflow to .pb format i have to modify the current android yolo to detect other objects

Hi @natanielruiz - thanks for the library. Building on OS X 10.11.6 (El Capitan) using latest NDK (14.0.3770861) gives the following during ndk-build -

[armeabi-v7a] Compile++ arm : tensorflow_demo <= tensorflow_jni.cc jni/./tensorflow_jni.cc: In function 'std::string ClassifyImage(const {anonymous}::RGBA*)': jni/./tensorflow_jni.cc:318:33: error: 'output' cannot be used as a function const float value = output(i); ^ jni/./tensorflow_jni.cc:319:16: error: base operand of '->' has non-pointer type 'std::vector' top_results->push_back(value); ^ jni/./tensorflow_jni.cc:321:27: error: base operand of '->' has non-pointer type 'std::vector' std::reverse(top_results->begin(), top_results->end()); ^ jni/./tensorflow_jni.cc:321:49: error: base operand of '->' has non-pointer type 'std::vector' std::reverse(top_results->begin(), top_results->end()); ^ jni/./tensorflow_jni.cc: At global scope: jni/./tensorflow_jni.cc:171:13: warning: 'void GetTopN(const Eigen::TensorMap<Eigen::Tensor<float, 1, 1, int>, 16>&, int, float, std::vector<std::pair<float, int> >*)' defined but not used [-Wunused-function] static void GetTopN( ^ make[1]: *** [obj/local/armeabi-v7a/objs/tensorflow_demo/./tensorflow_jni.o] Error 1

output is a pointer to a tensor not a function - not sure how this compiles?

Hi,

Thanks for your good work. Can you guide me, I want to replace the default MODEL_FILE with inception resnet v2. It would be really helpful for me if you provide detailed answer. Thanks

Hello, this project is very good when i test, but when I use darkflow tool to convert my weight and cfg file to new android_graph.pb, then replace old one, and change the class_labels[] in java file, then got new apk, but test got crash message as below, Is it anything wrong in my step? anybody can helo me?

... I/native: stat_summarizer.cc:33 StatSummarizer found 349 nodes tensorflow_jni.cc:137 Creating session. A/native: tensorflow_jni.cc:140 Could not create TensorFlow Graph: Not found: Op type not registered 'RealDiv' A/libc: Fatal signal 6 (SIGABRT), code -6 in tid 3109 (ImageListener) Application terminated.

I am getting: "Android YOLO keeps stopping"

jni_utils.cc:92 'asset' Must be non NULL

Fatal signal 6 (SIGABRT), code -6 in tid 9860 (ImageListener) [ 05-03 22:49:05.003 604: 604 W/ ] debuggerd: handling request: pid=9839 uid=10357 gid=10357 tid=9860

Hello sir, I had custom pb file which I trained using tiny-yolo-voc with Darknet and then convert it using darkflow command ./flow --model cfg/tiny-yolo-voc.cfg --load bin/tiny-yolo-voc.weights --savepb --verbalise My dataset is very simple which has only 1 class (cat) so the cfg I am using is changed at the final numer of filter `[convolutional] size=1 stride=1 pad=1 filters=30 activation=linear

[region] anchors = 1.08,1.19, 3.42,4.41, 6.63,11.38, 9.42,5.11, 16.62,10.52 bias_match=1 classes=1 coords=4 num=5 softmax=1 jitter=.2 rescore=1` As you said from the readme file, you hardcoded your code with voc dataset with 20 classes. So i would like to ask just in my case when I only have 1 class then what changes should I made or would you give brief explanation to help me ? Thank you so much !

@natanielruiz i thanks for sharing the implementation ,wonderful work . I have couple of questions

1. Where can add/delete the labels
2. Can i use weights trained on darknet having .weight file format

Patching CVE-2007-4559

Hi, we are security researchers from the Advanced Research Center at Trellix. We have began a campaign to patch a widespread bug named CVE-2007-4559. CVE-2007-4559 is a 15 year old bug in the Python tarfile package. By using extract() or extractall() on a tarfile object without sanitizing input, a maliciously crafted .tar file could perform a directory path traversal attack. We found at least one unsantized extractall() in your codebase and are providing a patch for you via pull request. The patch essentially checks to see if all tarfile members will be extracted safely and throws an exception otherwise. We encourage you to use this patch or your own solution to secure against CVE-2007-4559. Further technical information about the vulnerability can be found in this blog.

If you have further questions you may contact us through this projects lead researcher Kasimir Schulz.

java.lang.UnsatisfiedLinkError: dalvik.system.PathClassLoader[DexPathList[[zip file "/system/framework/org.apache.http.legacy.boot.jar", zip file "/data/app/org.tensorflow.tensorflowdemo-FebBpWvV3iIxT9KrXSaTRw==/base.apk"],nativeLibraryDirectories=[/data/app/org.tensorflow.tensorflowdemo-FebBpWvV3iIxT9KrXSaTRw==/lib/arm64, /system/lib64]]] couldn't find "libtensorflow_demo.so"

Since I noticed that your project used .pb file for graph, how you get that? We tried several projects, and got errors like Op type not registered 'LeakyRelu' in binary running on xxx. Make sure the Op and Kernel are registered in the binary running in this process. How you get a proper .pb file?

What is the output of the model? How can I capture the output for further processing? Can it be made to detect custom objects and send notification emails?

[armeabi-v7a] Compile++ arm : tensorflow_demo <= tensorflow_jni.cc jni/./tensorflow_jni.cc: In function 'std::string ClassifyImage(const {anonymous}::RGBA*)': jni/./tensorflow_jni.cc:319:33: error: 'output' cannot be used as a function const float value = output(i); ^ jni/./tensorflow_jni.cc:320:16: error: base operand of '->' has non-pointer type 'std::vector' top_results->push_back(value); ^ jni/./tensorflow_jni.cc:322:27: error: base operand of '->' has non-pointer type 'std::vector' std::reverse(top_results->begin(), top_results->end()); ^ jni/./tensorflow_jni.cc:322:49: error: base operand of '->' has non-pointer type 'std::vector' std::reverse(top_results->begin(), top_results->end()); ^ jni/./tensorflow_jni.cc: At global scope: jni/./tensorflow_jni.cc:172:13: warning: 'void GetTopN(const Eigen::TensorMap<Eigen::Tensor<float, 1, 1, int>, 16>&, int, float, std::vector<std::pair<float, int>

*)' defined but not used [-Wunused-function] static void GetTopN( ^ make: *** [obj/local/armeabi-v7a/objs/tensorflow_demo/./tensorflow_jni.o] Error 1