Page History

...

1. Stop the server (see Starting and stopping the Axxon One Server in Linux OS).
   

   Note
   title Attention!
   If the system has the software running on GPU, you must stop its operation.

2. Login as ngp superuser:

   1. In the command prompt, run the command:

      Code Block
      language bash
      sudo su ngp

   2. Enter the password for the root superuser.

3. Create a folder with a custom name to store the cache. For example:

   Code Block
   language bash
   mkdir /opt/AxxonSoft/AxxonOne/gpucache

4. Change folder permissions:
   

   Code Block
   language bash
   chmod -R 777 /opt/AxxonSoft/AxxonOne/gpucache

5. Go to the /opt/AxxonSoft/AxxonOne folder:
   

   Code Block
   language bash
   cd /opt/AxxonSoft/AxxonOne

6. Open the server configuration file for editing:
   

   Code Block
   language bash
   sudo nano instance.conf

   Note
   title Attention!
   When you use the server in failover mode, you should: Open the /etc/AxxonSoft folder: Code Block language bash cd /etc/AxxonSoft Open the server configuration file for editing: Code Block language bash sudo nano axxon-one.conf Info title Attention! Before you make changes to the axxon-one.conf file, we recommend reading the instructions on the page Creating system variables for the Axxon One server in the failover mode in Linux OS. Add the GPU_CACHE_DIR system variable in the configuration file, wherethevaluewillspecify the pathto the cachelocationfolder: Code Block language bash export GPU_CACHE_DIR="/opt/AxxonSoft/AxxonOne/gpucache" Save the changes in the server configuration file. Add the GPU_CACHE_DIR system variable in the /etc/profile file: Code Block language bash export GPU_CACHE_DIR="/opt/AxxonSoft/AxxonOne/gpucache" Run the command: Code Block language bash source /etc/profile

7. Add the GPU_CACHE_DIR system variable,wherethevaluewillspecify the pathto the cachelocationfolder. For example:

   Code Block
   language bash
   export GPU_CACHE_DIR="/opt/AxxonSoft/AxxonOne/gpucache"

8. Save the server configuration file using the Ctrl+O keyboard shortcut.

9. Exit file editing mode using the Ctrl+X keyboard shortcut.
   

   Note
   title Attention!
   When you change the server configuration (see Changing the configuration of the Axxon One Server in Linux OS) or update to the new Axxon One version, the system variables previously added to the instance.conf configuration file will be deleted (see Creating system variables for the Axxon One server in Linux OS).

10. In the command prompt, run the command that was usedtoadd the systemvariablewiththepathto the cache location folder. For example:
    

    Code Block
    language bash
    export GPU_CACHE_DIR="/opt/AxxonSoft/AxxonOne/gpucache"

11. Go to the /opt/AxxonSoft/DetectorPack/ folder:

    Code Block
    language bash
    cd /opt/AxxonSoft/DetectorPack

12. Run the following command:

    Code Block
    language bash
    ./NeuroPackGpuCacheGenerator

    Note
    title Attention!
    If more than one Nvidia GPU is available, you will be able to select one. To do this, specify a number from 0 to 3, which corresponds to the required device in the list.

Optimizing the operation of the neural analytics on GPU is complete. The utility will create the caches of four neural networks included in the Neuro Pack add-ons:

• GeneralNMHuman_v1.0GPU_onnx.ann (or GeneralNMHuman_v1.0_onnx.ann, starting with Detector Pack 3.16)—person;
• smokeScanned_v1_onnx.ann (or bestSmoke_v1.ann starting with Detector Pack 3.14)—smoke detection;
• fireScanned_v1_onnx.ann (or bestFire_v1.ann starting with Detector Pack 3.14)—fire detection;
• reid_15_0_256__osnetfpn_segmentation_noise_20_common_29_onnx.ann—search for the similar in the Neural tracker (see Similitude search).
  

Creating GPU neural network caches using parameters

1. -p is a parameter to create a cache for a particular neural network.
   Command exampleExample of a command:
   

   Code Block
   ./NeuroPackGpuCacheGenerator -p /opt/AxxonSoft/DetectorPack/NeuroSDK/GeneralNMHumanAndVehicle_Nano_v1.0_GPU_onnx.ann

2. -v is a parameter to output the procedure log to the console during cache generation.
   Command example Example of a command to automatically create caches of four neural networks included in the Neuro Pack add-ons with log output:
   

   Code Block
   ./NeuroPackGpuCacheGenerator -v

3. --int8=1 is a parameter to create a quantized version of the cache for those neural networks for which quantization is available. By default, the --int8=0 parameter is disabled.
   Command exampleExample of a command:
   

   Code Block
   ./NeuroPackGpuCacheGenerator -p /opt/AxxonSoft/DetectorPack/NeuroSDK/GeneralNMHumanAndVehicle_Nano_v1.0_GPU_onnx.ann --int8=1

   Note
   title Attention!
   The neural networks for which the quantization mode is available are included in the Neuro Pack add-ons together with the *.info file.

4. -f is a parameter to save logs of the caching procedure to files. It is available starting with DetectorPack 3.15. When you use the -v and -f parameters together, logs for each created cache are saved to: <Path to the cache folder created for the GPU_CACHE_DIR system variable>\caching-utility-log. A separate log file is created for each neural network. Log files created during previous runs of the utility are deleted.
   Example of a command for creating a cache with detailed logging to the console and saving logs to files:
   

   Code Block
   language shell
   ./NeuroPackGpuCacheGenerator -v -f

The neural networks for which the quantization mode is available (see Neural tracker, Stopped object detector, Neural counter):

• GeneralNMCar_v1.0GPU_onnx.ann (or GeneralNMCar_v1.0_onnx.ann,starting with Detector Pack 3.16)—Vehicle.
• GeneralNMHuman_v1.0GPU_onnx.ann (or GeneralNMHuman_v1.0_onnx.ann,starting with Detector Pack 3.16)—Person.
• GeneralNMHumanTopView_v0.8GPU_onnx.ann (or GeneralNMHumanTopView_v0.8_onnx.ann, starting with Detector Pack 3.16)—Person (top-down view).

Starting with DetectorPack 3.11, the following neural networks were added:

...