Monitoring dashboard for shared resources use in dataverse

[mbamouni]

No description provided.

[mbamouni]

As Philip DUrbin suggest in this trend https://groups.google.com/forum/?utm_medium=email&utm_source=footer#!topic/dataverse-community/zziMWREdirs,

I think, it will be good to have a monitoring dashboard for some resources we in dataverse. For example :

• DataCite
• Harvard WorldMap
• ORCID login
• OSF
• RSpace
• Whole Tale

Best regards,

Michel

[RightInTwo]

I would love to see this as well. It would be awesome to have it combined with the tool proposed as the "dataverse store" #5688.

[RightInTwo]

As Philip Durbin suggest in this thread

Looking at that exchange, the core idea is to "set up some sort of monitoring solution such as Nagios or whatever the cool kids uses these days so we could all check a dashboard to see if services we depend on are up or not".

[RightInTwo]

I think, it will be good to have a monitoring dashboard for some resources we in dataverse.

In addition to monitoring external tools (asserting/analyzing responses of their respective APIs), the monitoring of internal processes would of course also be very useful:

• data integrity
• file ingest
• harvesting
• usage metrics

Should this be a separate issue? I think not, but maybe there is a sensible first step that could go to a separate issue.

[pdurbin]

monitoring of internal processes

I completely agree but a new issue would be better, I think.

Unless I'm thinking about this wrong.

Are you thinking all ~50 installations of Dataverse would monitor if DataCite is down? I was thinking one monitoring system for DataCite, ORCID, etc is enough. Of course someone has to host it. Harvard? The GDCC? One of the Dataverse installations? 😄

[RightInTwo]

Are you thinking all ~50 installations of Dataverse would monitor if DataCite is down? I was thinking one monitoring system for DataCite, ORCID, etc is enough. Of course someone has to host it. Harvard? The GDCC? One of the Dataverse installations? smile

Well, okay, then we are talking about different things. I thought about a software (e.g. an elk stack template adapted to research data management needs, including these services as defaults), not a service. Of course, not everyone would want to monitor everything, but if that would be integrated with dataverse, many smaller institutes could set up monitoring for their data ecosystem without much hassle. Oh, and I don't think it necessarily a bad idea to check for availability of a service from the same server or at least local network where dataverse is installed in.

And if that was the case, adding monitoring functionality using the dataverse APIs would be much easier.

[pdurbin]

This issue has gone cold.

@mbamouni are you still interested?

Maybe each service should provide its own monitoring page like DataCite does: https://status.datacite.org

We could document these in the guides if we don't already. I'm not so sure the Dataverse project should run a monitoring service to see if DataCite, OSF, RSpace, etc. are up. If someone out there sets up this monitoring service, I'd certainly use it if I think something's down.

[cmbz]

To focus on the most important features and bugs, we are closing issues created before 2020 (version 5.0) that are not new feature requests with the label 'Type: Feature'.

If you created this issue and you feel the team should revisit this decision, please reopen the issue and leave a comment.