Both sides previous revisionPrevious revisionNext revision | Previous revision |
indexing:dspace [2020/09/21 15:38] – [2. Import records into VuFind using OAI-PMH harvest] demiankatz | indexing:dspace [2023/08/16 19:52] (current) – demiankatz |
---|
====== How to index DSpace with VuFind ====== | ====== How to index DSpace with VuFind® ====== |
| |
===== 1. Make sure OAI-PMH is turned on and properly indexed in DSpace ===== | ===== 1. Make sure OAI-PMH is turned on and properly indexed in DSpace ===== |
{{ :indexing:dspace-oai.jpg?600 |Default Context. This is the default context of the DSpace OAI-PMH data provider. Identify. List Sets. List Metadata Formats. List Identifiers. List Records. }} | {{ :indexing:dspace-oai.jpg?600 |Default Context. This is the default context of the DSpace OAI-PMH data provider. Identify. List Sets. List Metadata Formats. List Identifiers. List Records. }} |
| |
Before harvesting data from DSpace to VuFind, you should check that DSpace's OAI (Open Archives Initiative) Solr indexing is working correctly. For this, in the above screen click the List Records button, and you should see something similar to: | Before harvesting data from DSpace to VuFind®, you should check that DSpace's OAI (Open Archives Initiative) Solr indexing is working correctly. For this, in the above screen click the List Records button, and you should see something similar to: |
| |
{{ :indexing:dspace-records.jpg?600 | List of Records. Results fetched: 1. Identifier oai:localhost:123456789/3. Last Modified 2020-09-12 08:49:34. Sets. Metadata. }} | {{ :indexing:dspace-records.jpg?600 | List of Records. Results fetched: 1. Identifier oai:localhost:123456789/3. Last Modified 2020-09-12 08:49:34. Sets. Metadata. }} |
* -c Clears the Solr index before indexing (it will import all items again) | * -c Clears the Solr index before indexing (it will import all items again) |
| |
===== 2. Import records into VuFind using OAI-PMH harvest ===== | ===== 2. Import records into VuFind® using OAI-PMH harvest ===== |
| |
These steps use VuFind's [[indexing:oai-pmh|OAI-PMH harvest tool]] and [[XML indexing tool|indexing:xml]]. You can follow the links to learn more about the tools. | These steps use VuFind®'s [[indexing:oai-pmh|OAI-PMH harvest tool]] and [[indexing:xml|XML indexing tool]]. You can follow the links to learn more about the tools. |
| |
- Modify **$VUFIND_LOCAL_DIR/harvest/oai.ini**<code>[DSpace] | - Modify **$VUFIND_LOCAL_DIR/harvest/oai.ini**<code>[DSpace] |
injectId="identifier" | injectId="identifier" |
dateGranularity=auto | dateGranularity=auto |
harvestedIdLog=harvest.log</code> | harvestedIdLog=harvest.log |
| combineRecords=true</code> |
- Run these commands:<code>cd $VUFIND_HOME/harvest | - Run these commands:<code>cd $VUFIND_HOME/harvest |
php harvest_oai.php | php harvest_oai.php |
</code> | </code> |
| |
After that processing completes, retry the harvest process on the VuFind server as described above. | After that processing completes, retry the harvest process on the VuFind® server as described above. |
| |
===== 3. Customize Import Rules (optional) ===== | ===== 3. Customize Import Rules (optional) ===== |
| |
If you wish to customize the way your records are ingested, see the [[indexing:xml|indexing XML]] page for details. The instructions above use the example [[https://github.com/vufind-org/vufind/blob/dev/import/dspace.properties|dspace.properties]] and [[https://github.com/vufind-org/vufind/blob/dev/import/xsl/dspace.xsl|dspace.xsl]] files that ship with VuFind. You can copy these into appropriate subdirectories of your [[configuration:local_settings_directory|$VUFIND_LOCAL_DIR directory]] and modify them as needed to change the way data is indexed. | If you wish to customize the way your records are ingested, see the [[indexing:xml|indexing XML]] page for details. The instructions above use the example [[https://github.com/vufind-org/vufind/blob/dev/import/dspace.properties|dspace.properties]] and [[https://github.com/vufind-org/vufind/blob/dev/import/xsl/dspace.xsl|dspace.xsl]] files that ship with VuFind®. You can copy these into appropriate subdirectories of your [[configuration:local_settings_directory|$VUFIND_LOCAL_DIR directory]] and modify them as needed to change the way data is indexed. |
| |
:!: If you change import rules, note that you will need to remove your $VUFIND_LOCAL_DIR/harvest/DSpace directory, re-harvest the records, and repeat the indexing process in step 2 above. | :!: If you change import rules, note that you will need to remove your $VUFIND_LOCAL_DIR/harvest/DSpace directory, re-harvest the records, and repeat the indexing process in step 2 above. |
===== 4. Customize Record Display (optional) ===== | ===== 4. Customize Record Display (optional) ===== |
| |
By default, VuFind does not include any DSpace-specific display logic; records indexed from DSpace are displayed using the standard "SolrDefault" record driver and templates. However, the default import setup marks DSpace records with a record_format value of "dspace" which means that you can create a custom record driver named SolrDspace in order to create custom DSpace-only display options. See [[development:howtos:displaying_a_custom_field|displaying a custom field]] for some examples of record display customization. | By default, VuFind® does not include any DSpace-specific display logic; records indexed from DSpace are displayed using the standard "SolrDefault" record driver and templates. However, the default import setup marks DSpace records with a record_format value of "dspace" which means that you can create a custom record driver named SolrDspace in order to create custom DSpace-only display options. See [[development:howtos:displaying_a_custom_field|displaying a custom field]] for some examples of record display customization. |
---- struct data ---- | ---- struct data ---- |
| properties.Page Owner : |
---- | ---- |
| |