3-year ROADMAP (new products and tools)

[eplebel]

For RESEARCHERS (part of Curate Scholar product)

• users can choose a specific transparency standard they want (or need) to comply with (& also automatic transparency compliance determination as user is curating article transparency, showing additional requirements needed to achieve a higher standard):
  
  
• personalized gamification to nudge researchers toward making their articles more accessible (see accessibility standards below) AND transparent (i.e., adding links to open materials, data, code, etc.)
  • personalized gamification involves offering rewards tailored to a specific user, egs:
    • career stage: e.g., for ECRs, give achievement badges, points, leader boards, etc.; vs. for more established researchers, virtue signaling, philanthropy charity micro-donations, social proof angle, and/or "impact as motivation" (visual summary of how one's curated articles have helped others), reciprocity bias, spotlight effect, public commitment, empathy/compassion inducements,
    • personality type (or at least inferred personality type based on user behavior patterns), e.g., performance graphs (for less competitive personality types, given that performance graphs show transparent/accessibility behaviors compared to one's previous behaviors, rather than compared to other researchers (and this fits nicely with the plan to show one's transparency/accessibility improvements over time, instead or in addition to impact metrics). For overview of different kinds of (gamified) nudges, see https://dl.acm.org/doi/fullHtml/10.1145/3290605.3300733

• Interact w/ data & Code Ocean capsules directly within article list via full-screen mode (multi-panel mode: live demo (scroll down to "Registered Replication Report..." article card, hover over code badge (teal color), and click full-screen icon on the right of the CodeOcean URL)
  
  

• Interactive CV (based on one's Curate Scholar's author page) w/ interactive article cards featuring interactive Transparency badges & impact metrics, and also featuring full-screen viewable full-text articles (exportable in various formats):
  

For REPLICATORS/Credibility curation

1. Replication/replicability curation

• study-level curation and improved replication taxonomy, including automatic methodological similarity categorization based on user ticking check boxes:
  
  

• replication collection pages to track replicability of effects across distinct methods of observing/testing an effect (involving automatically updating meta-analytic estimates across subsets of replications based on transparency and key study characteristics)
  
  Medical/COVID-19 example, more relevant to our CURATE Citizen product, whereby any citizen can track papers and evidence/replication collections related to topics, conditions, and diseases that are personally-relevant to them:
  

2. Result reproducibility curation

• curation and display of result reproducibility status of articles/studies):
  
  

3. Result robustness curation (ambitious)
   [insert screenshot of rough paper mockups of study-level result robustness curation workflows...; e.g., UI to post crowd-sourced multiverse analyses of previously published findings; which goes beyond currently-offered article-level curation of articles reporting robustness re-analyses]
   

For JOURNALS

• journal issue article list embed widget to make journals accountable given that any follow-up commentaries and replications added on CS will automatically be displayed in their journal issues article lists (see example articles in journal issue mockup below)!:
  
  
  

• Journal article page transparency signaling UI designs
  

• Including displaying article T & C within existing journal website (for journals who prefer keeping their legacy journal website issue layout, rather than using our article list issue widget):
  

• journal submission portal article editor widget so journals can require transparency compliance (of their choosing) for submissions (& can also decide whether want to allow/do this 1. at submission, 2. after 1st round of review/per reviewer request, or 3. upon acceptance).
  
  
  

For UNIS

• This includes an admin dashboard for the university staff/prof in charge of ensuring all department articles meet minimum T standard within a certain time period (see below)
  

For FUNDERS

• This also includes an admin dashboard for the funding agency staff in charge of ensuring that all grantee publications meet minimum T standard within a certain time period (just like admin dashboard for university librarian/staff, see prototype above under "For UNIS")

• Funder grant review transparency standards that can be used globally by any funder (non-profit funder; publicly-funded government funding agencies), to ensure that their grant review processes are sufficiently transparent, hence ensuring the accountability of the funder to its stakeholders:
  

OTHER PRODUCTS, TOOLS, & NEW FEATURES

• journal article CITATION popup prototype: hovering over in-text citation in an HTML article (or news article, blog post, etc.) displays the cited article's metadata & CS transparency info! (live demo)
  
  

• for Journalists!: Embed the transparency and credibility information of a scientific article a journalist is reporting on for accountable science journalism (given that follow-up replications and critical commentaries will automatically be displayed)

• user page (listing recent user contributions and contribution statistics)

• allow non-admin users to add non-author page articles (& add “+ ADD” button on navbar)

  • but this requires to split current non-admin user type into 2 new non-admin user types:
    • editors: can add/edit any article (incl. articles claimed by authors), but cannot delete articles, even ones they themselves created.
    • users: can add/edit only new articles that they themselves added; if author claims (i.e., links to their author page) a user-created article, user loses ability to edit that article (but a message is displayed saying they can become editors by achieving a certain curation milestone).

• Create embedabble article lists:

  • use cases: article lists for courses; topic-based for general reference; references lists for interactive HTML articles; publicly editable crowdsourced article lists (e.g., Brent Roberts open science article list)).
    

• article list NEWS FEEDS (see paper mockup)

  • similar to article lists, except it's an automatically updating (& embeddable) article list resulting from a filtered search query! Use cases: university websites, conference website, etc. (but this only useful once our DB is sufficiently large)

• tracked content page to automatically be notified of new transparency-compliant articles and replications in one's research area:
  

• lab pages: article lists of authors/researchers belonging to the same lab (w/ lab info input boxes at the top) (live demo)
  

• author page topic tagging filtering (e.g., see T. Griffiths’ website)

• upload files to OSF via CS interface (via user-authorized API)

• web scraping

  • open content URLs and open access PDF/HTML URLs from most transparent top journals (e.g., PSCI, Cognition, etc.)
  • automatic updating of citations (via GS) and open content/preprint metrics (via OSF API)

Various integrations

• Wikipedia Curate Science integration: Embed a Curate Science article card within Wikipedia citation tooltips:
  
• Zotero integration to display any transparency and/or credibility information based on article DOI
  
  
• Web browser plug to display any transparency and/or credibility information based on article DOI