Alfresco running in read-only mode

[ebrenes]

Hello

I got this error

Alfresco has detected a manual change within the user tracking database, the system has now been switched to run in a read-only mode. Please contact Alfresco Support for further assistance, at https://support.alfresco.com/.

any idea on how to revert this and have the system running again in "write mode".

Note: it is not a license issue.

Thanks,

Erick Brenes.

[jpotts]

Definitely something you should get support to help you with.

[deshdeepak1947]

Hi Jeff,

Good Morning,

I am also getting same issue which i am able to resolve by restarting but again after few days alfresco goes read-only. Can we get at least the exact reason why this happens.

Any help / suggestions will be highly appreciated. Thanks in advance.

i am attaching the log below:

+PATH:"/app:company_home/st:sites/cm:maddysharma9787654139860/cm:documentLibrary/cm:_x0030_4_/cm:_x0030_1_ncdc_x0020_Text/cm:_lmx_jm_0011/cm:design/*" -TYPE:"cm:systemfolder" -TYPE:"fm:forums" -TYPE:"fm:forum" -TYPE:"fm:topic" -TYPE:"fmost"
2019-01-21 02:55:34,595 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1380] doclist.lib.js - query results: 9
2019-01-21 02:55:34,596 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1380] doclist.lib.js - totalRecords: 9
2019-01-21 02:56:36,264 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1528] Generating form for item:
2019-01-21 02:56:36,265 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1528] kind = node
2019-01-21 02:56:36,265 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1528] id = workspace/SpacesStore/ac19812a-123-408e-b4f5-3f6a8a6a2375
2019-01-21 02:56:36,265 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1528] fields = cm:name,cm:title,cm:description,mimetype,size,cm:creator,cm:created,cm:modifier,cm:modified
2019-01-21 02:56:36,265 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1528] forcedFields = cm:name
2019-01-21 02:56:36,272 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1528] formModel = {"item": "\/api\/node\/workspace\/SpacesStore\/ac19812a-123-408e-b4f5-3f6a8a6a2375", "submissionUrl": "\/api\/node\/workspace\/SpacesStore\/ac19812a-123-408e-b4f5-3f6a8a6a2375\/formprocessor", "type": "asc:content", "fields": "[Lorg.alfresco.repo.forms.FieldDefinition;@164e591d", "formData": {"nodeType": "content", "isContainer": false, "prop_cm_name": "Archive_u.Sanuk-2019_01_21_02_55.zip", "prop_mimetype": "application\/zip", "prop_size": 12827517, "prop_cm_creator": "u.shanuk", "prop_cm_created": "2019-01-21T02:55:03.511-05:00", "prop_cm_modifier": "u.Sanuk", "prop_cm_modified": "2019-01-21T02:55:10.857-05:00"}}
2019-01-21 02:58:23,707 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1608] doclist.lib.js - NodeRef: null Query: +PATH:"/app:company_home/st:sites/cm:ascarchives/cm:documentLibrary/cm:Mediclaime/cmKumar_9788973733018/cm:Final_Pages/*" -TYPE:"cm:systemfolder" -TYPE:"fm:forums" -TYPE:"fm:forum" -TYPE:"fm:topic" -TYPE:"fmost"
2019-01-21 02:58:23,747 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1608] doclist.lib.js - query results: 4
2019-01-21 02:58:23,747 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1608] doclist.lib.js - totalRecords: 4
2019-01-21 02:58:27,911 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1596] doclist.lib.js - NodeRef: null Query: +PATH:"/app:company_home/st:sites/cm:ascarchives/cm:documentLibrary/cm:Mediclaime/cmKumar_9788973733018/cm:Final_Pages/cmDF_x0020_files/*" -TYPE:"cm:systemfolder" -TYPE:"fm:forums" -TYPE:"fm:forum" -TYPE:"fm:topic" -TYPE:"fmost"
2019-01-21 02:58:28,038 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1596] doclist.lib.js - query results: 12
2019-01-21 02:58:28,039 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1596] doclist.lib.js - totalRecords: 12
2019-01-21 02:58:35,020 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1528] doclist.lib.js - NodeRef: null Query: +PATH:"/app:company_home/st:sites/cm:ascarchives/cm:documentLibrary/cm:Mediclaime/cmKumar/cm:Final_Pages/*" -TYPE:"cm:systemfolder" -TYPE:"fm:forums" -TYPE:"fm:forum" -TYPE:"fm:topic" -TYPE:"fmost"
2019-01-21 02:58:35,030 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1528] doclist.lib.js - query results: 4
2019-01-21 02:58:35,033 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1528] doclist.lib.js - totalRecords: 4
2019-01-21 03:00:01,871 WARN [repo.transaction.TransactionServiceImpl] [DefaultScheduler_Worker-10] setAllowWrite:false. Applying veto on write operations: {http://www.alfresco.org/model/application/1.0}AuthorizationsConsistencyMonitor
2019-01-21 03:00:01,896 ERROR [quartz.core.JobRunShell] [DefaultScheduler_Worker-10] Job DEFAULT.acm threw an unhandled Exception:
org.alfresco.error.AlfrescoRuntimeException: 0021299483 Alfresco has detected a manual change within the user tracking database, the system has now been switched to run in a read-only mode. Please contact Alfresco Support for further assistance, at https://support.alfresco.com/.
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$1.execute(AuthorizationsConsistencyMonitor.java:111)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$1.execute(AuthorizationsConsistencyMonitor.java:87)
at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:464)
at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:352)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$2.doWork(AuthorizationsConsistencyMonitor.java:125)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$2.doWork(AuthorizationsConsistencyMonitor.java:119)
at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:555)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor.checkConsistency(AuthorizationsConsistencyMonitor.java:129)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$AuthorizationsConsistencyMonitorJob.execute(AuthorizationsConsistencyMonitor.java:172)
at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:563)
2019-01-21 03:00:01,897 ERROR [quartz.core.ErrorLogger] [DefaultScheduler_Worker-10] Job (DEFAULT.acm threw an exception.
org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: org.alfresco.error.AlfrescoRuntimeException: 0021299483 Alfresco has detected a manual change within the user tracking database, the system has now been switched to run in a read-only mode. Please contact Alfresco Support for further assistance, at https://support.alfresco.com/.]
at org.quartz.core.JobRunShell.run(JobRunShell.java:227)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:563)
Caused by: org.alfresco.error.AlfrescoRuntimeException: 0021299483 Alfresco has detected a manual change within the user tracking database, the system has now been switched to run in a read-only mode. Please contact Alfresco Support for further assistance, at https://support.alfresco.com/.
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$1.execute(AuthorizationsConsistencyMonitor.java:111)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$1.execute(AuthorizationsConsistencyMonitor.java:87)
at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:464)
at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:352)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$2.doWork(AuthorizationsConsistencyMonitor.java:125)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$2.doWork(AuthorizationsConsistencyMonitor.java:119)
at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:555)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor.checkConsistency(AuthorizationsConsistencyMonitor.java:129)
at org.alfresco.enterprise.repo.authorization.AuthorizationsConsistencyMonitor$AuthorizationsConsistencyMonitorJob.execute(AuthorizationsConsistencyMonitor.java:172)
at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
... 1 more
2019-01-21 03:00:39,166 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1596] doclist.get.js - NodeRef: alfresco://company/home Query: +@cm\:modified:[2019\-1\-14T00\:00\:00.000 TO 2019\-1\-21T23\:59\:59.999] +@cm\:modifier:"Raghul.S" +TYPE:"cm:content" -TYPE:"cm:systemfolder" -TYPE:"fm:forums" -TYPE:"fm:forum" -TYPE:"fm:topic" -TYPE:"fmost" +(TYPE:"content" OR TYPE:"app:filelink" OR TYPE:"folder")
2019-01-21 03:00:39,860 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1596] doclist.get.js - query results: 23
2019-01-21 03:00:39,934 DEBUG [repo.jscript.ScriptLogger] [http-apr-8080-exec-1596] doclist.get.js - totalRecords: 23
2019-01-21 03:00:40,935 ERROR [extensions.webscripts.AbstractRuntime] [http-apr-8080-exec-1611] Exception from executeScript - redirecting to status template error: 0021299496 Access Denied. The system is currently in read-only mode.
org.alfresco.repo.security.permissions.AccessDeniedException: 0021299496 Access Denied. The system is currently in read-only mode.
at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:404)
at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecute(RepositoryContainer.java:587)
at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecuteAs(RepositoryContainer.java:656)
at org.alfresco.repo.web.scripts.RepositoryContainer.executeScriptInternal(RepositoryContainer.java:428)
at org.alfresco.repo.web.scripts.RepositoryContainer.executeScript(RepositoryContainer.java:308)
at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:382)
at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:210)
at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:132)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

[jpotts]

Desh,

Do you have a valid license for Enterprise Edition?

Have you manually made any changes to the database?

Jeff

[deshdeepak1947]

Thanks Jeff, 

we have recently upgraded the license now it will expire after 300 days. Number of users is however approaching to limit but we have 900+ users against licence of 1000 users.

We did not try to change the database manually.Whatever we do is just regular work of upload, change, preview docs or create, delete users through alfresco share UI and admin console.

This started happening for last 1 months. Before that it was working without any problem.

One point i would like to mention that i have uploaded the licence through admin console and applied from there.

Thanks,

Desh

[jpotts]

Are you running a cluster?

[deshdeepak1947]

i don't think so as our alfresco is installed on single Linux CentOS machine.It has been working without any problem for last 1 year.

I would like to mention an observation that, this read-only mode is occurring at every Monday 3 AM and then resolves after restarting and then again after 1 week on same day and time it goes read-only.

Thanks,

Desh

[jpotts]

Well that is certainly a clue. Are there any cron jobs set to run at or around that time?

Also, if you have OOTB Support Tools installed, which is pretty much always recommended, you can easily see a list of Alfresco's scheduled jobs by going to http://alfresco.local:8080/alfresco/s/ootbee/admin/scheduled-jobs . Maybe there is something running in Alfresco around that time that is mis-behaving.

[ebrenes · Accepted solution]

In my case I was running a cluster architecture and one of the nodes had a wrong hostname, the issue got solved after changing the hostname to its correct value.

This is not related to Alfresco. It is an OS/Linux issue.

[nila]

Hi, I am experiencing a similar issue. Could you please share some details on how you fixed this? I am running 6.0.2-ga and started from the AiO project. Whe I try to create a node I get:

org.alfresco.service.transaction.ReadOnlyServerException: 07300043 Access Denied. The system is currently in read-only mode.

The environment is the AiO docker setup, the host machine runs Fedora. What was your hostname issue about?

Thank you in advance.