Warning: This page has not been updated in over over a year and may be outdated or deprecated.
administration:search_engine_optimization
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
administration:search_engine_optimization [2020/06/04 15:19] – [Best Practices] demiankatz | administration:search_engine_optimization [2024/05/08 09:00] – Add link to Tracking Record Changes page mtrojan | ||
---|---|---|---|
Line 7: | Line 7: | ||
// This feature was added after the release of VuFind 1.0.1. // | // This feature was added after the release of VuFind 1.0.1. // | ||
- | Several search engines look for sitemap files which list all of the pages of your site and ensure that no content is missed during indexing. | + | Several search engines look for sitemap files which list all of the pages of your site and ensure that no content is missed during indexing. |
- | VuFind comes with a simple | + | VuFind comes with a tool for generating sitemaps. |
- | 1. Edit the [[configuration: | + | 1. Edit the [[configuration: |
- | 2. Switch to the util folder under your VuFind installation, | + | 2. Run the sitemap generator: |
+ | |||
+ | :!: This is an example command. See also [[administration: | ||
< | < | ||
- | php sitemap.php | + | cd $VUFIND_HOME |
+ | VUFIND_LOCAL_DIR=`pwd`/ | ||
</ | </ | ||
- | This may take some time. When it is complete, your sitemap file(s) | + | This may take some time. When it is complete, your sitemap file(s) |
You may wish to automate this so that sitemaps are built on a regular basis; see the [[administration: | You may wish to automate this so that sitemaps are built on a regular basis; see the [[administration: | ||
+ | |||
+ | Since the sitemap generation takes some time, it is recommended to generate the sitemap files in a temporary directory and move them in place only when completed. Otherwise the robots may try to crawl incomplete sitemap information while the generation is still in progress. Make sure to clean up any old sitemap files from the temporary directory before generating new ones, and from the public directory when copying them over. | ||
+ | |||
+ | 3. Include a reference to the sitemap in [[administration: | ||
+ | |||
+ | :!: This is an incomplete excerpt to illustrate the Sitemap option. The Sitemap URL must be fully-qualified. | ||
+ | |||
+ | < | ||
+ | User-agent: * | ||
+ | Disallow: /AJAX | ||
+ | |||
+ | Sitemap: http:// | ||
+ | </ | ||
==== Best Practices ==== | ==== Best Practices ==== | ||
Line 32: | Line 48: | ||
A VuFind site can easily have hundreds of thousands, or even millions, of pages in its sitemaps -- it's all dependent on the number of records in your index. Search engines will take a significant amount of time to crawl all of these pages, and even more time to detect changes. Be aware that publishing a sitemap will not instantly lead to full visibility of all of your content. | A VuFind site can easily have hundreds of thousands, or even millions, of pages in its sitemaps -- it's all dependent on the number of records in your index. Search engines will take a significant amount of time to crawl all of these pages, and even more time to detect changes. Be aware that publishing a sitemap will not instantly lead to full visibility of all of your content. | ||
+ | |||
+ | Note that the effect of your settings on crawling budgets is dependent on each indexer. e.g. [[https:// | ||
+ | |||
+ | If you want to adjust the frequency for other bots, it is recommended to rather reduce this setting if you have a high amount of records, else the indexers might take months to crawl all of your pages and might waste the crawl budget by downloading the same sites over and over again even if there are no changes at all. | ||
=== Using Search Engine Tools === | === Using Search Engine Tools === | ||
Line 47: | Line 67: | ||
[[administration: | [[administration: | ||
+ | |||
+ | ===== Related Video ===== | ||
+ | |||
+ | You can learn more about sitemaps through the [[videos: | ||
---- struct data ---- | ---- struct data ---- | ||
+ | properties.Page Owner : | ||
---- | ---- | ||
administration/search_engine_optimization.txt · Last modified: 2024/05/08 11:20 by demiankatz