Benchmark Testing with Alfresco

Document created by derek Employee on Mar 29, 2016Last modified by janv on Feb 23, 2017
Version 3Show Document
  • View in full screen mode

Benchmark Framework

 

The set up and configuration of specific tests will be covered in detail but deployment and and environment setup details can be found in page Benchmark Framework 2.0.

The benchmark lab configuration can be found on the internal Wiki page.

 


 

Compatibility Matrix

Table 1: Benchmark Project List
NameDescriptionArtifact ReleasesArtifact SnapshotsSourcePrerequisites
Benchmark ServerBenchmark controller application and framework codeReleasesSnapshotsSource
Alfresco Sign UpCreate users in Alfresco as a prerequisite for Alfresco testingReleasesSnapshotsSource
   Alfresco instance with /alfresco exposed
Alfresco Data LoadCreate shared, common data in Alfresco: Sites, site members, site-based files and foldersReleasesSnapshotsSource
   Alfresco instance with /alfresco exposed
   User collection mirror in MongoDB (Alfresco Sign Up)
Alfresco WorkflowCreate and progress through Activiti workflows in AlfrescoReleasesSnapshotsSource
   Alfresco instance with /alfresco exposed
   User collection mirror in MongoDB (Alfresco Sign Up)
CMISPure CMIS testReleasesSnapshotsSource
   Any CMIS server
   User collection mirror in MongoDB (Alfresco Sign Up)
ShareSelenium-based testing using Share page objectsReleasesSnapshotsSource
   Alfresco instance with /share exposed
   User collection mirror in MongoDB (Alfresco Sign Up)
   Selenium grid running local to each instance of the test (ideally)

 

Table 1 gives the names of the Alfresco Benchmark projects and where to find artifacts and source code.

Click on the test name to get more detailed instructions on how to run the application.


Table 2: Benchmark Software Compatibility
Product VersionBenchmark Test(s)
CMIS 1.1 Server
   Benchmark Server 2.1.1 or later
   CMIS 1.4
Alfresco 5.2.0
   Benchmark Server 2.1.1 or later
   Sign Up 2.3 or later
   Data Load 2.6 or later
   CMIS 1.4
   Workflow 1.1
   Public API 1.0-SNAPSHOT
   Share 5.2.0-SNAPSHOT (trunk)
Alfresco 5.1.0
   Benchmark Server 2.1.1 or later
   Sign Up 2.3 or later
   Data Load 2.6 or later
   CMIS 1.4
   Workflow 1.1
   Public API 1.0-SNAPSHOT
   Share 5.1.0
Alfresco 5.0.N
   Benchmark Server 2.1.1 or later
   Sign Up 2.3 or later
   Data Load 2.6 or later
   CMIS 1.4
   Workflow 1.1
   Public API 1.0-SNAPSHOT
   Share 5.0.0 / 5.0.1 / 5.0.x-SNAPSHOT
Alfresco 4.2.5
   Benchmark Server 2.1.1 or later
   Sign Up 2.3 or later
   Data Load 2.6 or later
   Workflow 1.1
   Share 4.2.x-SNAPSHOT
Alfresco 4.2.3
   Benchmark Server 2.1.1 or later
   Sign Up 2.3 or later
   Data Load 2.6 or later
   Workflow 1.1
   Share 4.2.4.x-SNAPSHOT
Alfresco 4.1.5
   Benchmark Server 2.1.1 or later
   Sign Up 2.3 or later
   Data Load 2.6 or later
   Workflow 1.1
   Share 4.1.x-SNAPSHOT

 

Table 2 shows the test version compatibility with specific product versions.

Where a specific Product Version is not listed, use the most recent version listed.  For example, if you are using Alfresco 4.2.4 and only Alfresco 4.1.3 and Alfresco 5.0.0 are listed, then the tests to use will be those of the latest prior release; in this example: Alfresco 4.1.3.

 


Attachments

    Outcomes