Hardware requirements
Necessary condition
At present, private deployment needs to be based on the K8S deployment, so the hardware requirements are higher than before.
Hardware requirements vary due to demand module, request volume, data volume and other factors, resulting in inconsistent hardware configuration requirements.
tip
If multiple products are deployed together, the disk space does not overlap, and the maximum value is enough
Disk space depends on:
- Data retention policy (data retention period)
- Log Retention Policy
- Data size
- It is not recommended to use NAS, NFS and other networks to mount disks unnecessarily, unless you can ensure that the network transmission between the server and the network disk is very stable
- It is strongly recommended that SSDs or HDDs with good performance be used for disks
The disk size resources can be appropriately increased or reduced according to the actual business volume and demand module. Data reference is as follows:
MinIO: 1 worker generates 60-70MB screen recording files every 2 minutes when the resolution is 1920 * 1080
MySQL: One worker generates about 1GB every year. 100 Task per day, 50 records per Task, 0.5KB per record
Hardware performance requirements
- Disk performance: the read speed is not less than 200M/s, and the write speed is not less than 200M/s Inspection method
- Network performance: the transmission speed of the intranet shall not be lower than 512k/s
- CPU instruction set: If the product you purchased includes OCR recognition capability (CPU version), you need the instruction set to include fma, avx, avx2 instructions
caution
If the product you purchased includes OCR recognition capability (GPU version), please ensure that your server has a GPU graphics card and the driver is installed.
The recommended video card model is Nvidia [v100, p100, p40, t4]
Single node deployment
You can refer to the following table to count the hardware resources you need:
| Product | CPU Cores | RAM(GB) | HDD(GB) | GPU(GB) | remarks |
|---|---|---|---|---|---|
| Laiye Automation Commander | 8 | 16 | 500 | - | - |
| Laiye Intelligent Document Processing | 8 | 16 | 300 | - | All AI Capability need to be added with the Laiye Intelligent Document Processing first, which is unnecessary if it has been deployed before, and the added modules can be connected with the Laiye Intelligent Document Processing deployed in advance |
| Conversational AI Platform | 16 | 32 | 300 | - | - |
| The Hub | 4 | 8 | - | - | - |
| data service | 2 | 2 | - | - | - |
| Self developed ocr go service | 8 | 16 | - | - | When using the following functions, you need to add the configuration of this service (if there are multiple capabilities, you need to add this module only once) Text Recognition, Form Recognition, Universal Card\&Certificate Recognition, Universal Bill Recognition, Seal Recognition, Captcha Recognition, QR code Recognition, Layout Analysis |
| Text Recognition - Standard GPU | 4 | 8 | - | 8 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| Form Recognition - Standard GPU | 4 | 4 | - | 8 | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Universal Multi Ticket Identification - Standard GPU | 10 | 64 | - | 11 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| General Card\&Certificate Recognition Standard Edition - ID Card GPU | 4 | 8 | - | 8 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| General Card\&Certificate Recognition Standard Edition - ID Card CPU | 8 | 16 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| General Card\&Certificate Recognition Standard Version - Business License GPU | 4 | 8 | - | 8 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| General Card\&Certificate Recognition Standard Version - Business License CPU | 8 | 16 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| General Card\&Certificate Recognition standard version - driver's license driver's license GPU | 4 | 8 | - | 8 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| Universal Card\&Certificate Recognition standard version - driver's license driver's license CPU | 8 | 16 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| Captcha Recognition | 1 | 2 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| Seal identification | 4 | 8 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| layout analysis | 4 | 8 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Document Category | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Document Extraction | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Information Extraction | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Text Classification | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Document self training extraction | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Document comparison | 8 | 16 | - | - | It needs to add the configuration of Laiye Intelligent Document Processing+universal character recognition |
| Custom template recognition | 1 | 2 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
Multi node deployment
caution
For multi node deployment, three or more nodes are required. You need to create a load balancer (lb) as an access portal, and use multiple nodes as back-end servers.
If you cannot provide a load balancing (lb) address, you can provide us with an idle IP address, and we will use software to meet your needs.
(However, as far as I know, third-party ECS providers such as Aliyuns do not support this approach.)
Three nodes
The following is the configuration information of each node
| Product | CPU Cores | RAM(GB) | HDD(GB) | GPU(GB) | remarks |
|---|---|---|---|---|---|
| Laiye Automation Commander | 8 | 16 | 500 | - | - |
| Laiye Intelligent Document Processing | 8 | 16 | 300 | - | All AI Capability need to be added with the Laiye Intelligent Document Processing first, which is unnecessary if it has been deployed before, and the added modules can be connected with the Laiye Intelligent Document Processing deployed in advance |
| Conversational AI Platform | 16 | 32 | 300 | - | - |
| The Hub | 4 | 8 | - | - | - |
| data service | 2 | 2 | - | - | - |
| Self developed ocr go service | 8 | 16 | - | - | When using the following functions, you need to add the configuration of this service (if there are multiple capabilities, you need to add this module only once) Text Recognition, Form Recognition, Universal Card\&Certificate Recognition, Universal Bill Recognition, Seal Recognition, Captcha Recognition, QR code Recognition, Layout Analysis |
| Text Recognition - Standard GPU | 4 | 8 | - | 8 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| Form Recognition - Standard GPU | 4 | 4 | - | 8 | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Universal Multi Ticket Identification - Standard GPU | 10 | 64 | - | 16 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| General Card\&Certificate Recognition Standard Edition - ID Card GPU | 4 | 8 | - | 8 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| General Card\&Certificate Recognition Standard Edition - ID Card CPU | 8 | 16 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| General Card\&Certificate Recognition Standard Edition - Business License | 4 | 8 | - | 8 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| General Card\&Certificate Recognition Standard Edition - Driver's License Driver's License | 4 | 8 | - | 8 | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| Captcha Recognition | 1 | 2 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| Seal identification | 4 | 8 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
| layout analysis | 4 | 8 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Document Category | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Document Extraction | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Information Extraction | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Text Classification | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Document self training extraction | 2 | 4 | - | - | The configuration of Text Recognition+(Laiye Intelligent Document Processing or OCR) needs to be added |
| Document comparison | 8 | 16 | - | - | It needs to add the configuration of Laiye Intelligent Document Processing+universal character recognition |
| Custom template recognition | 1 | 2 | - | - | The configuration of Laiye Intelligent Document Processing or OCR needs to be added |
More than three nodes
For installations with more than three nodes, master and node modes will be used to plan the hardware configuration
master:Deploy k8S basic services, such as:apiserver, Kube controller, kube scheduler and middleware servicesnode:The node where the service module is actually running
It can be roughly divided into the following two situations:
3 < nodes < 6: Master=3, node=number of nodes (master is also node)
6 =< nodes: Master=3, node=number of nodes master (master is only master)
Assuming that the number of nodes provided is 4, the number of master roles is 3 and the number of node roles is 4.