|
| |
|
|
|
|
Who is the WEAVER?
The WEAVER is a new deep learning inference engine that comes with Adaptive Vision Studio 4.12. He is user friendly, cares greatly about performance and reliability. This newsletter will help you to get to know him better. |
|
1. Performance
Deep learning networks are typically created with frameworks like TensorFlow, PyTorch or Caffe. These are great environments for research. However, to achieve the highest possible performance you will also need an inference engine dedicated to your hardware platform. Our experiments have shown that relatively mature and usable choices are: TensorRT (GPU), OpenVINO (CPU), MXNET (GPU), PlaidML (GPU) and ONNX Runtime (CPU). WEAVER is a new option. He works best in machine vision applications and provides state of the art performance on both GPU and CPU. |
|
| Below you can see how WEAVER's performance looks like on our most popular neural network, Feature Detection (supervised pixelwise labeling, Thread Inspection official example): |
|
| On nVidia RTX 2060, it gets even more interesting. TensorRT can go faster when numeric precision is reduced to 16 bits, while WEAVER still works with full 32-bit precision: |
|
| On the Intel CPU platform we compare WEAVER against OpenVINO and ONNX: |
|
| DISCLAIMER: The WEAVER inference engine was specifically optimized for neural network we use, including Feature Detection. Performance for other neural network architectures may be different. |
|
2. Reliability
The fast pace of development in the field of deep learning is not particularly helpful in developing real-world systems. Most of our customers require long-term support and stable availability of the components they use. WEAVER solves that. He is independent of the open-source frameworks, eliminates Python code and provides long-term support for commercial projects. |
|
3. Ease of use
Most of the other inference engines require you to do the Python programming and tweak many things. WEAVER is different. He only does two things: (1) model optimization, (2) execution. All you need to deliver is your H5 network file (Keras output). Moreover, when you create your solution with Adaptive Vision Studio, WEAVER is already employed in three ready-to-use deep learning tools: Feature Detection, Point Location and Object Classification. |
|
| BONUS: If you use WEAVER as a certified machine builder or system integrator, Adaptive Vision grants you the right to use "This product employs WEAVER" co-branding on your products (download). |
|
|
|
|
| |
|
