Webmaster Guidelines
The below guidelines lay down few basic principles for website owners to ensure that the Guruji crawler crawls and indexes their website content in the best possible way.
Content guidelines:
- Make sure that each webpage is accessible by at least one static text link.
- Adding a sitemap would help Guruji crawler to find all of your web pages. Links that are embedded in menus, list boxes, and similar elements may not be accessible to Guruji crawler unless they appear in the sitemap.
- Check for broken links on the website as this may make it difficult for Guruji crawler to crawl and index your website effectively.
- Keep URLs simply formed and static. This makes it easier for Guruji crawler to crawl them. If you choose to use dynamic pages try and keep the parameters short and restrict their numbers to a few.
- Try and keep your website hierarchy as flat as possible. That is, each webpage should only within three click levels from the default webpage.
- Anticipate words that users would use to search for the information on your website. Include these words in the visible part of your website text.
- Use text instead of images to display important sections, links of your website. Majority of the crawlers including Guruji do not recognize text contained in images.
Technical guidelines:
- Use only well formed, HTML Code that is appropriately validated.
- Ensure that the Guruji crawler is permitted to crawl your website. Guruji crawler complies with the standards of robots.txt.
- Avoid linking to spam sites, malware sites from your webpages. Linking to such sites will negatively affect the way Guruji crawler crawls and indexes your website.
- Use descriptive, relevant and honest metadata about your webpage content. Any attempt to deceptively describe your web content can and will negatively affect the way Guruji crawler crawls and indexes your website.
- Use robots.txt to communicate your crawling preferences to the Guruji crawler.
- Ensure that your website complies with the general standards of good web design.
- Ensure that your website appears correctly in all browsers.
Things to be avoided:
We constantly strive to avoid and purge web pages that employ illicit means to attempt a better rank and in the process harm the quality of our search results. Some of the commonly suggested guidelines to website owners are:
- Avoid stuffing irrelevant keywords in sections of the webpage which users are unlikely to view.
- Avoid Including hidden texts and hidden links.
- Don�t be a part of link exchange programs that attempt to artificially improve your website's in-link quotient. Specifically, avoid linking to web spammers as this may jeopardize your website rank as well.
- Avoid cloaking and improper re-directs.
- Avoid creating doorway pages solely intended to re-direct the user to some other page.
- Avoid automatically created pages that add little or no value.
- Avoid duplicate content across multiple pages.
You may submit your site URL to the Guruji crawler here