Product Requirements, Cluster Sizing and Tested Scaling Limits
Minimum VM Specifications
- Read and write latency average latency per vm < 20 ms
- ecactl cluster exec iostat -xyz -d 3
- 4 x vCPU per vm
- See how much disk space to add in the examples below, match to the closest largest matched configuration.
- * Note this is starting disk size, content indexing and metadata indexing will require adding more storage as more files are indexed. If disk space utilization reaches 70% all indexing will stop automatically. The above are only starting disk space requirements. Additional RAM is required as per below
- *** Indexing rate is directly dependent on read latency first and then write latency 2nd. If read latency is above specified values, indexing rate will drop as a factor of the read latency to the disks in the VM.
Sample configurations based on file count
NOTE: These are guidelines only and not a guarantee disk space requirement.
If you do not see a match to your use case contact sales@superna.net
Configuration | VM count | Total Disk Space | HA Mode | RAM per VM |
250 Million files Meta data reporting | 4 | 430 GB per VM = 1720 GB (base OVA disk space) | If HA mode is disabled divide the disk space requirement by 50% | 16GB (base OVA RAM ) |
500 Million files Meta data reporting | 4 | 430 GB per VM = 1720 GB (base OVA disk space) | If HA mode is disabled divide the disk space requirement by 50% | 24GB (Add 8GB RAM VM 2-4 ) |
750 Million files Meta data reporting | 7 | 630 GB per VM = 4210 GB (Add 200 GB to VM 2-7) | If HA mode is disabled divide the disk space requirement by 50% | 24GB (Add 8GB RAM VM 2-7 ) |
1B files Meta data reporting | 7 | 830 GB per VM = 5410 GB (Add 400 GB to VM 2-7) | If HA mode is disabled divide the disk space requirement by 50% | 30GB (Add 14GB RAM VM 2-7 ) |
2B files Meta data reporting | 7 | 1230 GB per VM = 7810 GB (Add 800 GB to VM 2-7) | If HA mode is disabled divide the disk space requirement by 50% | 36GB (Add 20GB RAM VM 2-7 ) |
3B files Meta data reporting | 7 | 1730 GB per VM = 12110 GB (Add 1300 GB to VM 2-7) | If HA mode is disabled divide the disk space requirement by 50% | 40GB (Add 24GB RAM VM 2-7 ) |
4B + files Meta data reporting | 10 | 1730 GB per VM = 13840 GB (Add 1300 GB to VM 2-10) | If HA mode is disabled divide the disk space requirement by 50% | 40GB (Add 24GB RAM VM 2-10 ) |
Feature Tested Limits
The following are tested limits. These do not represent actual limits. These numbers will be updated with future releases.
Scaling Limit Item | Tested Value |
Number of files or directories meta data only index (requires 7-9 VM configuration) | 12 billion |
Number of files in a directory | 1 Million |
Number of subdirectories in a path | 1 Million |
Number of paths added for indexing | 25 |
Number of clusters added to single appliance for indexing | 2 |
© Superna Inc