Warning: This page has not been updated in over over a year and may be outdated or deprecated.
administration:search_engine_optimization
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionLast revisionBoth sides next revision | ||
administration:search_engine_optimization [2024/05/08 08:54] – Change section "Understanding Crawling Budgets" based on PR #3641 mtrojan | administration:search_engine_optimization [2024/05/08 11:19] – demiankatz | ||
---|---|---|---|
Line 1: | Line 1: | ||
====== Search Engine Optimization ====== | ====== Search Engine Optimization ====== | ||
- | In some cases, you may wish to make sure that the contents of your VuFind | + | In some cases, you may wish to make sure that the contents of your VuFind® |
===== Sitemaps ===== | ===== Sitemaps ===== | ||
- | // This feature was added after the release of VuFind | + | // This feature was added after the release of VuFind® |
Several search engines look for sitemap files which list all of the pages of your site and ensure that no content is missed during indexing. | Several search engines look for sitemap files which list all of the pages of your site and ensure that no content is missed during indexing. | ||
- | VuFind | + | VuFind® |
- | 1. Edit the [[configuration: | + | 1. Edit the [[configuration: |
2. Run the sitemap generator: | 2. Run the sitemap generator: | ||
Line 24: | Line 24: | ||
This may take some time. When it is complete, your sitemap file(s) have been generated. | This may take some time. When it is complete, your sitemap file(s) have been generated. | ||
- | You may wish to automate this so that sitemaps are built on a regular basis; see the [[administration: | + | You may wish to automate this so that sitemaps are built on a regular basis; see the [[administration: |
Since the sitemap generation takes some time, it is recommended to generate the sitemap files in a temporary directory and move them in place only when completed. Otherwise the robots may try to crawl incomplete sitemap information while the generation is still in progress. Make sure to clean up any old sitemap files from the temporary directory before generating new ones, and from the public directory when copying them over. | Since the sitemap generation takes some time, it is recommended to generate the sitemap files in a temporary directory and move them in place only when completed. Otherwise the robots may try to crawl incomplete sitemap information while the generation is still in progress. Make sure to clean up any old sitemap files from the temporary directory before generating new ones, and from the public directory when copying them over. | ||
Line 43: | Line 43: | ||
=== Exposing Static / Multi-lingual Content === | === Exposing Static / Multi-lingual Content === | ||
- | If you have important static content pages (landing pages, texts about services/ | + | If you have important static content pages (landing pages, texts about services/ |
=== Understand Crawling Budgets === | === Understand Crawling Budgets === | ||
- | A VuFind | + | A VuFind® |
- | Note that the effect of your settings on crawling budgets is dependent on each indexer. e.g. [[https:// | + | Note that the effect of your settings on crawling budgets is dependent on each indexer. e.g. [[https:// |
If you want to adjust the frequency for other bots, it is recommended to rather reduce this setting if you have a high amount of records, else the indexers might take months to crawl all of your pages and might waste the crawl budget by downloading the same sites over and over again even if there are no changes at all. | If you want to adjust the frequency for other bots, it is recommended to rather reduce this setting if you have a high amount of records, else the indexers might take months to crawl all of your pages and might waste the crawl budget by downloading the same sites over and over again even if there are no changes at all. | ||
Line 58: | Line 58: | ||
==== Technical Details ==== | ==== Technical Details ==== | ||
- | Early versions of VuFind | + | Early versions of VuFind® |
===== Staying Informed ===== | ===== Staying Informed ===== |
administration/search_engine_optimization.txt · Last modified: 2024/05/08 11:20 by demiankatz