Availability of Open Citations from Open Journals in Crossref - Protocol

We download the DOAJ public data dump containing article metadata in tar.gz format.

The dump is structured as a single directory of the form  doaj_article_data_[date generated] where are listed files with names of the form  article_batch_[number].json . Each file contains up to 100,000 records for a total size of 270Mb.

To decrease the size of each batch, we filter each key to get only the information useful for our research:

• DOI of the article
• year of publication
• ISSNs journal they belong to

To do so we used the batches_cleaner.py software.

Import needed:
os
json

Script to execute:
python3 -m batches_cleaner doaj_article_data_[date generated]
From Windows:
py -m batches_cleaner doaj_article_data_[date generated]

In order to reply to our research questions we should enrich the cleaned dump with information retrieved by Crossref REST API. To do so we used the main.py script that launches the populate.py software, both developed in python. It uses three method explained in the subsections below:

• requests method
• _read_json method
• populate method

Import needed:
os
json
ABC
requests
time
random
requests_cache
backoff

Script to execute:
python3 -m main <path/> doaj_article_data_[date generated]
From Windows:
py-m main <path/> doaj_article_data_[date generated]

requests method.

This method launch requests to Crossref REST API in the format https://api.crossref.org/works/{doi}. The method use

requests_cache, backoff, ReadTimeout to avoid getting blocked and speed up the process.

def__init__(self) -> None:
    requests_cache.install_cache('multithread_cache')
    self.api = "https://api.crossref.org/works/"

    @backoff.on_exception(backoff.expo, requests.exceptions.ReadTimeout, max_tries=20)
    defquery_crossref(self, doi):

    query = self.api + doi
    time.sleep(random.randint(1,3))

    req = requests.get(query, timeout=60)
    returnreq, doi

_read_json method.

This method iterates over articles stored in article_batch_[number].json, indexing DOI for their journal ISSNs then, for each article DOI, we send a request through request method. If the process is having some errors it saves a temporary file in the directory temp.

If the response status code is not equal to 200 the DOI is not present in Crossref, so we add those key value:

• "'crossref': 0
• "reference": 0

In other cases we read the response message and we add those key value:

• "crossref": 1
• "reference": 0

Then, if in the response are presents reference values we read the reference list to read reference articol information. Id DOI is present we add this key value to our reco:

• "doi": "article-doi"
• "doi": "not-specified" (if not present)

Then we look for the entities responsible for DOI specification that crossref saved under the key "doi-asserted-by". Consequentially, we add to reference informations this key value:

• "doi-asserted-by": "publisher"
• "doi-asserded-by": "crossref"
• "doi-asserted-by": "not-specified" (if not present)

When the file is finally populated a temporary copy is saved in temp/compleated to save time whether we need to restart the process.

populate method.

Populate iterates over all files in the directory doaj_article_data_[date generated] controlling if they are temporary files. In the end it produces a JSON file as output named batch.json in the output directory.

We will publish our datasets at the end of our research in JSON formats on https://github.com/open-sci/2021-2022-la-chouffe-code together with the two software mention above and software documentation.

We will provide a permanet doi for the software and the research's results.

We will observe the percentage of articles on DOAJ that are present in Crossref, in particular:

1. DOAJ articles w/DOI // Total DOAJ Articles : % Of articles with a DOI Over the DOAJ This gives the scope of DOAJ articles with a persistent identifier and that have a DOI. Also informs about the scope of the rest of the research.
2. DOAJ articles on crossref // DOAJ articles w/DOI : % articles indexed on crossref. This gives the scope of the articles of the DOAJ indexed on crossref. This is important as articles indexed on crossref have their metadata available for everyone outside the DOAJ and helps indexing
3. DOAJ articles w/references on Crossref // DOAJ articles on Crossref +DOAJ articles w/references on Crossref // DOAJ articles with DOI : % of articles of the doaj (and on crossref) with references that are indicated.
4. N. references issued by Crossref // Total number of references + N. of references issued by the publisher // Total number of references: % of references issued by Crossref or publisher. This can be useful to understand the role of crossref in registering articles and related metadata.
5. Y1, % of articles on Crossref in Y1, % articles with references in Y1… YN, % of articles on Crossref in YN, % articles with references in YN. This gives us information about the yearly evolution of publishing of scholarly metadata over Crossref
6. Issns,% articles with doi, % articles on cf for issn, % articles with references, %by publisher / Crossref: How are different journals in publishing metadata, how much metadata on crossref, how many open citations are put there.

We will employ python libraries such as seaborn or plotly to visualise our results.