The cta-statistics-update tool¶
This tool only works for PostgreSQL and Oracle database.
The cta-statistics-update tool is a C++ command line tool that allows the user to perform a per-Tape statistics update in the CTA Catalogue database.
This documentation will present how to configure this tool and how it works.
Configuration of the cta-statistics-update tool¶
As this tool only interrogates and updates the CTA Catalogue database, it only needs the Catalogue database configuration file. The content of the configuration file has to be done according to the catalogue/cta-catalogue.conf.example file.
Running the cta-statistics-update tool¶
In order to run the tool, just type :
What does this tool do¶
Checks that the Catalogue contains the tables and the columns needed for updating¶
In order to compute the Per-tape statistics, the tool needs the following TABLES and COLUMNS to exist:
Executes a SQL UPDATE query on the TAPE table¶
The query will update every tape which has the flag DIRTY set to 1. This flag is automatically set to 1 by CTA when files are added or removed.
The following fields will be updated on the TAPE table:
- DIRTY is set to 0
- NB_MASTER_FILES: The number of tape files present which have not been deleted. Counts 1st, 2nd, ... copies as one file each.
- MASTER_DATA_IN_BYTES: The amount of "useful data" on the tape, i.e. the sum of the size in bytes of all the MASTER files that the tape contains. This term corresponds to the WLCG term "Amount of Data Stored"/"usedSize".
- NB_COPY_NB_1: The number of unique tape files on the tape. This is the count one gets when only counting first copies. The sum of all nbCopyNb1 statistics from all tapes should equal the number of archive files in the system.
- COPY_NB_1_IN_BYTES: The amount of data in the tape when counting only unique tape files. Or, in other words, when only counting the first copy of each archive file.
- NB_COPY_NB_GT_1: The number of replicated tape files on the tape. This is the count one gets when only counting 2nd, 3rd, ... copies.
- COPY_NB_GT_1_IN_BYTES: The amount of data on the tape when counting only tape files which are 2nd, 3rd, ... copies.
When the query is executed, the number of updated tapes will be displayed through stdout.
Example of the output of the tool:
$ cta-statistics-update /etc/cta/cta-catalogue-oracle.conf Updating tape statistics in the catalogue... Updated catalogue tape statistics in 0.0989, 5 tape(s) have been updated