Bootstrax/Ajax/Microstrax updates
Created by: jorana
Preamble This is a aggregation of the scripts running on the eventbuilders to process data and maintain the hosts/rundatabse. Below the changes to each script are highlighted.
Also for all of the scripts, we have changed the disks on eb0 and eb1 to also read /data
. Also, the scripts are changed such that eb2 is not contributing at all to live processing.
Ajax
- Delete old lineage-data from the host. Remove any high-level data if the lineage hash for that datatype is not in correspondence with the latest lineage hash.
- Clean the runsdatabase. We had some entries that were listed in the database but they appeared non-existent. Therefore we add a task to ajax to check that the data listed in the runs-database actually exist.
Bootstrax
- Prepare bootstrax for the linked mode. At the moment we have some muon-veto data that we should be able to open with bootstrax. Please be aware. We are now just trying to open the data with the defaults from redax but it's much better if these are properly set.
- Reinstate a check for 'dead' bootstrax instances, mark as dead if bootstrax hasn't checked in for a while.
- Update the data-document in the rundoc with metadata concerning the strax(en) version and the data-size. See for example:
.
Microstrax
- Have eb2 now write a document every minute that it is hosting microstrax.