Warning: This page has not been updated in over over a year and may be outdated or deprecated.
indexing:dspace
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionLast revisionBoth sides next revision | ||
indexing:dspace [2019/02/04 20:35] – [4. Customize Record Display (optional)] demiankatz | indexing:dspace [2023/08/16 19:51] – [2. Import records into VuFind using OAI-PMH harvest] demiankatz | ||
---|---|---|---|
Line 1: | Line 1: | ||
====== How to index DSpace with VuFind ====== | ====== How to index DSpace with VuFind ====== | ||
- | These are the instructions used by the Naval Postgraduate School | + | ===== 1. Make sure OAI-PMH is turned on and properly indexed |
- | ===== 1. Turn on OAI-PMH | + | To retrieve records from DSpace, you will need to use the [[indexing: |
- | OAI must be enabled | + | In newer versions of DSpace, |
- | - Modify the DSpace server config in **nginx.conf** on the DSpace server:< | + | |
- | Proxy_set_header X-Forwarded-Host $host; | + | |
- | Proxy_set_header X-Forwarded-Server $host; | + | |
- | Proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; | + | |
- | + | ||
- | Proxy_pass http:// | + | |
- | Proxy_redirect http:// | + | |
- | Proxy_buffering off; | + | You can check whether the service is enabled by visiting < |
- | Proxy_store off; | + | |
- | Proxy_connect_timeout 120; | + | {{ :indexing: |
- | Proxy_send_timeout 120; | + | |
- | Proxy_read_timeout 120; | + | |
- | } | + | |
- | </ | + | |
- | - Modify | + | |
- | Reloadable=" | + | |
- | allowLinking=" | + | |
- | | + | |
- | harvest.includerestricted.oai = true | + | |
- | harvester.autoStart = true | + | |
- | ...</ | + | |
- | ===== 2. Import records into VuFind | + | Before harvesting data from DSpace to VuFind, you should check that DSpace' |
- | These steps use VuFind' | + | {{ : |
+ | |||
+ | In the above image, if you click Metadata, it should provide you with an oai_dc-formatted metadata response. | ||
+ | |||
+ | ==== Fixing Missing Indexing ==== | ||
+ | |||
+ | If metadata does not display correctly through the server (for example, if you receive an "Error No matches for the query" message), this is probably a sign that DSpace' | ||
+ | |||
+ | <code bash> | ||
+ | ./dspace oai import -o -c | ||
+ | </ | ||
+ | |||
+ | The meaning of parameters –o and –c is as follows: | ||
+ | |||
+ | * -o Optimize index after indexing | ||
+ | * -c Clears the Solr index before indexing (it will import all items again) | ||
+ | |||
+ | ===== 2. Obtain records using OAI-PMH harvest ===== | ||
+ | |||
+ | These steps use VuFind' | ||
- Modify **$VUFIND_LOCAL_DIR/ | - Modify **$VUFIND_LOCAL_DIR/ | ||
Line 44: | Line 44: | ||
injectId=" | injectId=" | ||
dateGranularity=auto | dateGranularity=auto | ||
- | harvestedIdLog=harvest.log</ | + | harvestedIdLog=harvest.log |
+ | combineRecords=true</ | ||
- Run these commands:< | - Run these commands:< | ||
php harvest_oai.php | php harvest_oai.php | ||
./ | ./ | ||
+ | |||
+ | ==== Troubleshooting ==== | ||
+ | |||
+ | If you receive an error message during harvesting, you may need to rebuild the OAI indexes on your DSpace server. Log into that system and run these commands: | ||
+ | |||
+ | < | ||
+ | <path to dspace directory>/ | ||
+ | <path to dspace directory>/ | ||
+ | </ | ||
+ | |||
+ | After that processing completes, retry the harvest process on the VuFind server as described above. | ||
===== 3. Customize Import Rules (optional) ===== | ===== 3. Customize Import Rules (optional) ===== | ||
- | If you wish to customize the way your records are ingested, see the [[indexing: | + | If you wish to customize the way your records are ingested, see the [[indexing: |
:!: If you change import rules, note that you will need to remove your $VUFIND_LOCAL_DIR/ | :!: If you change import rules, note that you will need to remove your $VUFIND_LOCAL_DIR/ | ||
Line 59: | Line 71: | ||
By default, VuFind does not include any DSpace-specific display logic; records indexed from DSpace are displayed using the standard " | By default, VuFind does not include any DSpace-specific display logic; records indexed from DSpace are displayed using the standard " | ||
---- struct data ---- | ---- struct data ---- | ||
+ | properties.Page Owner : | ||
---- | ---- | ||
indexing/dspace.txt · Last modified: 2023/08/16 19:52 by demiankatz