AnsweredAssumed Answered

Lucene indexes backup error

Question asked by mynt on Apr 23, 2012
Latest reply on Oct 9, 2013 by malleshwari
Hi,

We have an Alfresco Enterprise v3.4.2 on RHEL 5, it has been going fine for months but of late we are getting this error. We have seen that it may be related to the directories permissions but we checked them and they are correct. We did the copy manually too, with the user that runs the tomcat, with no trouble.

03:00:02,166  ERROR [quartz.core.JobRunShell] Job DEFAULT.indexBackupJobDetail threw an unhandled Exception: 
org.alfresco.error.AlfrescoRuntimeException: 03230036 Failed to copy Lucene index root:
   Index root: /opt/alfresco/indices/lucene-indexes
   Target: /opt/alfresco/indices/backup-lucene-indexes
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$BackUpReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:1244)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$CoreReadOnlyWork$1.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2029)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$CoreReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2023)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory.doReadOnly(AbstractLuceneIndexerAndSearcherFactory.java:1963)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent.backupImpl(AbstractLuceneIndexerAndSearcherFactory.java:1209)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent.access$000(AbstractLuceneIndexerAndSearcherFactory.java:1049)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$1.execute(AbstractLuceneIndexerAndSearcherFactory.java:1165)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:381)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:253)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent.backup(AbstractLuceneIndexerAndSearcherFactory.java:1169)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupJob.execute(AbstractLuceneIndexerAndSearcherFactory.java:1578)
   at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
Caused by: java.io.IOException: Destination '/opt/alfresco/indices/.indexbackup_temp' directory cannot be created
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$BackUpReadOnlyWork.copyDirectory(AbstractLuceneIndexerAndSearcherFactory.java:1308)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$BackUpReadOnlyWork.backupDirectory(AbstractLuceneIndexerAndSearcherFactory.java:1269)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$BackUpReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:1239)
   … 46 more
03:00:02,170  ERROR [quartz.core.ErrorLogger] Job (DEFAULT.indexBackupJobDetail threw an exception.
org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: org.alfresco.error.AlfrescoRuntimeException: 03230036 Failed to copy Lucene index root:
   Index root: /opt/alfresco/indices/lucene-indexes
   Target: /opt/alfresco/indices/backup-lucene-indexes]
   at org.quartz.core.JobRunShell.run(JobRunShell.java:227)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
Caused by: org.alfresco.error.AlfrescoRuntimeException: 03230036 Failed to copy Lucene index root:
   Index root: /opt/alfresco/indices/lucene-indexes
   Target: /opt/alfresco/indices/backup-lucene-indexes
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$BackUpReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:1244)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$CoreReadOnlyWork$1.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2029)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$CoreReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2023)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2600)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doWithFileLock(IndexInfo.java:2520)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.doReadOnly(IndexInfo.java:2501)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneBase.doReadOnly(AbstractLuceneBase.java:338)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$NestingReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:2000)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory.doReadOnly(AbstractLuceneIndexerAndSearcherFactory.java:1963)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent.backupImpl(AbstractLuceneIndexerAndSearcherFactory.java:1209)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent.access$000(AbstractLuceneIndexerAndSearcherFactory.java:1049)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$1.execute(AbstractLuceneIndexerAndSearcherFactory.java:1165)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:381)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:253)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent.backup(AbstractLuceneIndexerAndSearcherFactory.java:1169)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupJob.execute(AbstractLuceneIndexerAndSearcherFactory.java:1578)
   at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
   … 1 more
Caused by: java.io.IOException: Destination '/opt/alfresco/indices/.indexbackup_temp' directory cannot be created
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$BackUpReadOnlyWork.copyDirectory(AbstractLuceneIndexerAndSearcherFactory.java:1308)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$BackUpReadOnlyWork.backupDirectory(AbstractLuceneIndexerAndSearcherFactory.java:1269)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory$LuceneIndexBackupComponent$BackUpReadOnlyWork.doWork(AbstractLuceneIndexerAndSearcherFactory.java:1239)
   … 46 more
)

The machine has plenty of space for indexing and copying in the Oracle database backing it as much as in the lucene filesystem space.
What else can we look at? any hints welcomed.

Outcomes