Provide statistics

[nichtich]

Can be calculated once and stored on disk (I'd use jq). Numbers such as

• Timestamp of last update
• Number of analyzed DDC numbers
• Number of incompletely analyzed DDC numbers
• Number of distinct incompletely analyzed DDC numbers
• Number of distinct elements and frequency of their use
• ...

[stefandesu]

• Number of incompletely analyzed DDC numbers
• Number of distinct incompletely analyzed DDC numbers

What's the difference between these two? The database uses the concept URI as the primary key, so there should be no duplicates.

I'd use jq

How would you use jq for this? The data is currently only in the PostgreSQL database.

[nichtich]

How would you use jq for this? The data is currently only in the PostgreSQL database.

The data is converted to JSON and imported then, so we could also create a JSON dump and work in this. It's just a matter of convenience.

[stefandesu]

The data is converted to JSON and imported then, so we could also create a JSON dump and work in this. It's just a matter of convenience.

I'll check the convert script whether the conversion to JSON works properly at the moment. I haven't tested it since we haven't used it at all.

If it's easier for you to write a jq call that calculates the data than writing a small helper script in JavaScript, then go ahead. I wouldn't even know where to start. 😅

[stefandesu]

Added a small fix in 6f63368. Now the convert script correctly outputs ndjson when using it without the --import flag.

[nichtich]

There is a statistics script on the dev branch. The server needs to be adjusted to server stats.json (if available) and/or a summary in the interface. Date of last update is also not included yet.