Bulk upload in parallel

cancel
Showing results for 
Search instead for 
Did you mean: 
franciscoduarte
Member II

Bulk upload in parallel

Hello,

We are having some issues when uploading files in bulk from our ADF.

We have two people uploading 10000 files each from our ADF, at the same time. And sometimes, some files fail to upload (usually 2 or 3 files) and we get the following error:

Logs 

Can you help?

Thank you

1 Reply
abhinavmishra14
Advanced

Re: Bulk upload in parallel

The error indicates that it is trying to modify the same node concurrently or may be a deadlock situation is occurring. 

This error also notable : Transactional update cache 'org.alfresco.userToAuthorityTransactionalCache' is full (100).

Increasing the maxItems count can be a quick fix, but does not help, batch processing is the right option.

https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/resources/alfres...

https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/resources/alfres...

cache.userToAuthoritySharedCache.tx.maxItems=100

https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/resources/alfres...

You may need to upload the files in batches or wrap the the upload logic in transaction scope.

~Abhinav
(ACSCE, AWS SAA, Azure Admin)