Administration Guides

Advanced Cluster Configuration

Home

The clusters configuration can be customized from defaults.   The cluster can be shutdown, the main configuration file updated, and restart the cluster for the changes to take effect.


 

Advanced Cluster Configuration 

Suppress PowerScale changelist mode - Use only if directed by support

  1. Search creates snapshots with a 5 day expiry. When we've disabled incremental ingestion, but are processing a long-running full ingestion, this snapshot can be deleted and we're left without one on disk. To avoid the issue, add an optional setting to "eca-env-common.conf" to disable incremental that will stop processing after the snapshot has been created, but before the changelist is created. This will keep creating snaps on the PowerScale, but will not process any changelist data.
  2. add to eca-env-common.conf  and requires a restart of the taskmaster container on node 1 .
  3. export SUPPRESS_CHANGELIST_TASK_CRON="0 0 * * *"  

Disable Query Index before saving new records to the Index

  1. This option disables the index check to verify if a file is already in the index.  This check will increment the skipped counter folder stat.  In some scenarios, this extra processing can be undesirable when you want to force index all data on a path into the index.  Use this variable to disable the index check before saving records to the database.  It also increases performance when processing a large file system.
  2. on node 1 add this variable below and save the file
  3. nano /opt/superna/eca/eca-env-common.conf
  4. export SOLR_QUERY_BEFORE_SAVE=false
  5. control+x
  6. ecactl cluster down 
  7. ecactl cluster up


How to Increase HTTP API Timeout

  1. Use these steps when the cluster cannot return API requests under the default 30 seconds.  It is abnormal for a cluster to take longer than 30 seconds.  Only apply if directed by support.
  2. on node 1 add this variable below and save the file.   The value is in ms and this adds timeout of 5 minutes
  3. nano /opt/superna/eca/eca-env-common.conf
  4. export HTTP_TIMEOUT_MS=300000
  5. control+x  (save the changes)
  6. ecactl cluster push-config
  7. ecactl cluster services restart isilongateway
     


How to Increase Changelist job timeout for clusters with Performance issues and need more time to process a changelist job

  1. Login to node 1 as ecaadmin
  2. nano /opt/superna/eca/eca-env-common.conf
  3. add this variable . NOTE Default is 4 hours or 14400000 ms 
    1. export ISILON_CHANGELIST_REQUEST_TIMEOUT_MS=14400000
  4. control + x to save and exit
  5. ecactl cluster push-config
  6. ecactl cluster services restart isilongateway

How to enable fast incremental mode for high change rate file systems

  1. This feature will skip collection of metadata from the file system for each file in the change list which takes additional api latency to retrieve.  The change list contains the data stamps of the file but does not contain owner, group information.  This means any reports that depend on owner of the file will no longer work for incremental data in the index.  This feature will increase the performance of incremental indexing and still allows age based reporting to function normally.
  2. Requires a patch build of 1.1.8 , please open a case to request it.
  3. Login to node 1 as ecaadmin
  4. nano /opt/superna/eca/eca-env-common.conf
  5. add this variable.  
    1. export INGESTION_SMART_INCREMENTAL=true
  6. control + x to save and exit
  7. ecactl cluster push-config
  8. ecactl cluster services restart isilongateway



© Superna Inc