Ticket #461 (new Task)

Opened 4 years ago

Last modified 4 years ago

SERVICES SPRINT 04 - eXist XML dB scalability testing

Reported by: markmorgan Owned by: allyn
Priority: major Milestone:
Component: WP4 - Deployment of Services Version:
Keywords: Services, Exist, Database Cc:
Requirement:

Description

Estimated unique document instances = 10,000.  Therefore must test against databases ranging from 10000 to 100000 CIM instances. 

Unit tests will need to be written against simple, medium and high complexity searches. Unit test results will need to be collated & published to members of the Metafor services group for discussion.  Statistics should also be made of the database file sizes.

Change History

comment:1 Changed 4 years ago by markmorgan

  • Priority changed from blocker to major

comment:2 Changed 4 years ago by markmorgan

  • Requirement modified (diff)

comment:3 Changed 4 years ago by markmorgan

  • Milestone M4.5 Web Services Deployed deleted

comment:4 Changed 4 years ago by markmorgan

Decided in sprint review telco to write scripts to generate a test database of sufficient size via a random data generation algorithm. Over time this generator script may be extended to generate a known test database to act as the basis for formalized unit testing.

comment:5 Changed 4 years ago by markmorgan

Discussion regarding the definintion of an Atmoic dataset and the impact on the number of CIM instances that will end up being in the eXist db. Present estimates consider that there will be 1-2 million CIM DataObject? instances. An in memory database is feasible but indexing and search query optimisation will be important.

Note: See TracTickets for help on using tickets.