Service: Establish Dataverse Project and Harvard Dataverse Repository Metrics Service

[cmbz]

Purpose

• Design, implement & operationalize a metrics service for the Dataverse Project and Harvard Dataverse Repository.

Background

• A number of metrics about Dataverse Project and Harvard Dataverse are collected at different time intervals and published to different locations. For instance, some metrics are available from the Dataverse.org home page: https://dataverse.org/metrics, the IQSS metrics webpage: https://www.iq.harvard.edu/metrics. Metrics also appear on the Harvard Dataverse Repository homepage: https://dataverse.harvard.edu/. Use metrics for individual datasets are also shown on Harvard Dataverse Dataset pages. Other metrics related to Harvard Dataverse Repository (e.g., number of user searches or most popular users searches) are currently produced and tracked by the software but not always publicized.
• Within IQSS there is a need for ready access to these, and additional new metrics about the Dataverse Project and Harvard Dataverse Repository for monitoring and marketing purposes and to quantify and demonstrate growth of the software and repository over time.
• The project will:
  • Centralize all Dataverse and Harvard Dataverse-related metrics
  • Identify the existing and new elements needed to collect and present Dataverse Project and Harvard Dataverse Repository metrics
  • Improve existing or implement new processes (technical and administrative) to collect desired data and produce metrics in a repeatable, highly automated fashion.
  • Establish an implementation timeline, including specific short, medium, and long term tasks needed to produce all required metrics
  • Define a repeatable, highly automated process for aggregating and delivering existing metrics and for supporting new metrics as needed.
• Eventually, hub.dataverse.org will become the only authoritative source of information of all the original three metrics pages.

Harvard Dataverse Repository Metrics

Service will provide the following:

• Regular automated monitoring and sharing of metrics about HDV and related services, including storage usage, downloads, and curation
• Static and interactive visualizations of data about HDV for visual exploration and use in Web pages and reports
• Provide input for IQSS and Harvard Library strategic planning efforts and HDV research projects
• Support user dataset creation and usage report requests for NIH and other grants

Tasks

• Develop a services definition and plan outlining different program components, design, and timeline
• Create scripts for generating monthly search statistics in prod.  dataverse.harvard.edu#280

Monitoring Issues

• Metrics Hub: Design and Analysis, 2024-07-17 - 2024-07-31 #303
• Metrics Hub: Design and Analysis, 2024-08-01 - 2024-08-31 #305
• Metrics Hub: Design and Analysis, 2024-09-01 - 2024-09-26 #328

Related

• GREI 4: Task 6 - Assemble and provide metrics about HDV data collection for therapeutic areas #229
• Epic: Harvard Dataverse Repository NIH Metrics #217
• Epic: GREI Implement Make Data Count (MDC) #196

Resources

• Dataverse Hub
• Dataverse Hub repo: https://github.com/jp-tosca/dataverse-hub
• Service: Establish Dataverse Project and Harvard Dataverse Repository Metrics Service (Deprecated)

Metrics Resources

• IQSS Metrics: Dataverse Project
• Dataverse.org: Installations
• GORC International Model WG - Commons Model V1.1

[cmbz]

Status: June 2024

• Proposal outline created by @siacus here: https://iqss.slack.com/archives/C03R1E7T4KA/p1719237600176579

[cmbz]

Status: July 2024

• Met with @jp-tosca and @siacus to discuss plan and itemize tasks.
• New channel created: https://iqss.slack.com/archives/C07CFTZ0YG6
• Began tracking work: Metrics Hub: Design and Analysis, 2024-07-17 - 2024-07-31 #303
• Additional tasks:
  • Coordinate with @scolapasta on Market place work.
  • Then prioritize and schedule tasks.
• Related: Project: Dataverse Marketplace #278

[jp-tosca]

Status: August 2024

• Completed Analysis of the data source from https://www.iq.harvard.edu/metrics and reported several issues related to this website.
• Completed analysis of the data source from https://dataverse.harvard.edu/
• Proposal of design philosophy and features.
• An initial definition of data is required for metrics generation.

[qqmyers]

FWIW: #10865 fixes a bug that has affected metrics coming from Dataverse, particularly for those like Harvard that have many harvested datasets.

[jp-tosca]

Status: September 2024

• We presented to de Dataverse team a document on this link it includes the results of the initial analysis, an initial proposal for the data schema and a list of features that will make an MVP.
• We deprecated the original proposal in favor of the new Dataverse Hub document. Future updates to design, plans, and timeline will be made to this new document.