Research Output Feeder technical details

In this topic Hide

About this help page

This page provides more details about how the Research Output feeder searches for matches to existing Research Output records, and creates new records.

 

Feeder process overview

The feeder reads the root directory in the specified source file location and looks for unprocessed files in each profile directory folder. The feeder processes one row of the data file at a time, as follows:

What the feeder needs ...

Where it finds it in the Research Output Feeder configuration

Source category column name

Category Column selected

Source category value

The column of the source data that matches the Category Column header defined above

Mapping for source categories

Category Mapping tab: RME Category

Mapping for fields

Field Mapping tab: RME Fields
 

Matching criteria

Search criteria 1

The feeder first looks for matches in RME for the DOI. If the DOI URL value does not include the prefix “https://doi.org/”, the system appends this and then searches for matches.

Validation checks that this is in a valid URL format, but not if it is the correct URL for the publication or output.

•        If a match is found, the feeder will not create a Research Output record. A log record stating that a record with this DOI already exists in the system will be shown in the Research Output Import Results.

•        If no match is found, the feeder applies the second search criteria below.

Search criteria 2

If no match is found in search 1, the feeder then tries to match any Source IDs in the source data to the mapped RME value.

For example, if the Source ID is mapped to the Scopus ID field, the feeder will look for matches to the provided source value in the RME Source Information related item: Output Source field = Scopus, and Output Source ID field = the provided Source ID.

•        If a match is found, the feeder will not create a Research Output record. A log record stating that a record with this ID already exists in the system will be shown in the Research Output Import Results.

•        If no match is found, a Research Output record is created and populated with data as mapped in the feeder configuration.

Search criteria 3: Additional matching for created Research Output records

For any research output records created after the above matching processes, the feeder also searches for matches to the following supporting records:

•        Book – searches for the ISBN

•        Journal – searches for the ISSN

•        Conference, searches for the Name

•        Publishers – searches for the plain text name

•        If a match is found for any of these as relevant, the feeder will not create an additional record.

•        If no match is found, the relevant record type (Book, Journal, Conference and/or Publisher) is created and populated with data as mapped in the feeder configuration.

Record creation

If no matching record exists in RME after matching, records are created as follows depending on the data available in the source file:

Record created

Where in RME

Fields that are populated and details

DOI

Research Outputs > Documents related item

Document Path: Path

In details: Document and Document Path: Provided DOI value, appended with 'https://doi.org/'.

Source ID

Research Outputs > Research Outputs record > Source Information related item

Output Source: Value based on the Source ID field mapping. For example, if mapped to Symplectic ID, the output source will be Symplectic.

Output Source ID: The provided value

Author

Research Outputs > Research Outputs record > Contributors related item

The source may provide multiple authors. All authors will be created in this related item as an author. The format and separator used by the feeder to segregate author names and format is defined in the profile configuration for this field. See: Author configuration

•        Person Code: The provided code


This is a required field in RME. This field will be linked to a research output external person (ECODE - PUB_EXTERNAL_PERSON)

•        Order: It starts with 1 and will increment by 1 for subsequent records

•        First Name: The provided author name based on the format (F character's position)

•        Middle Name: The provided author name based on the format (M character's position)

•        Last Name: The provided author name based on the format (S character's position)

•        Full Name: The provided author's name

•        Position: Author

•        Type: External

Category

Research Outputs > Output Categories

If a source field is mapped to an RME category field, the feeder checks to see if there is an existing category in RME. If not, the feeder will create a new category if in the feeder configuration, the Create if not existing? option is enabled for that category.

If input value length exceeds 50, an error will be logged and the record will not be processed because the max eCode is 50.

Organisation

Setup > Organisation

eCode, Organisation Name and Abbreviation: Value provided (all other fields will need to be completed manually)

If input value length exceeds 50, an error will be logged and the record will not be processed because the maximum eCode size is 50 characters.

 

ID: Research_Outputs_Feeder_Notes.htm