Elxis CMS Forum

Support => Elxis 4.x/5.x DEV => Topic started by: maple on July 01, 2013, 11:25:07

Title: Sitemap component - issues
Post by: maple on July 01, 2013, 11:25:07

Uoooh! Great job! I found that works perfectly.

I just have some questions:

1-It seems that it's possible to add an instruction sitemap inside robots.txt. My question is what if I insert more than one like following?

Code: [Select]

sitemap: http://www.example.com/sitemap/sitemap.xml.gz
sitemap: http://www.example.com/sitemap/sitemap.xml
sitemap: http://www.example.com/sitemap/images.xml
2-What is the difference of usability between this two url's?:

Code: [Select]

http://www.example.com/sitemap/
http://www.example.com/sitemap/sitemap.html
3-What is this used for? UPDATED

Code: [Select]

http://www.example.com/sitemap/urllist.txtOh, it seems that this is for Yahoo sitemap indexation? Then is the following correct to insert inside the robots.txt in conjuction with the others? I see that is not a xml file. And, could incurring this in duplicate content? I believe that Yahoo now support xml sitemaps:

Code: [Select]

sitemap: http://www.example.com/sitemap/sitemap.xml.gz
sitemap: http://www.example.com/sitemap/sitemap.xml
sitemap: http://www.example.com/sitemap/images.xml
sitemap: http://www.example.com/sitemap/urllist.txt
Need to be in first level domain like this?

Code: [Select]

http://www.example.com/urllist.txt
4-Why you put all inside the "sitemap folder" instead of in the first domain level? Doesn't matter? Perhaps at least could be interesting for the html option be direct like this:

Code: [Select]

http://www.example.com/sitemap.htmlinstead of:

Code: [Select]

http://www.example.com/sitemap/sitemap.html
5-For the Core components "other pages", I need to remove the "Users central". How I can to do this?

6-What is the option EDC - requires component EDC?


Sitemaps for multiple sites. Some extra info just in case you need it: http://bit.ly/16JijeX (http://bit.ly/16JijeX)


Thanks a lot

Title: Re: Sitemap component - issues
Post by: datahell on July 01, 2013, 13:19:15

1. In robots.txt put your XML sitemap, meaning this:

Code: [Select]

sitemap: http://www.example.com/sitemap/sitemap.xmlor better* written like this:

Code: [Select]

sitemap: http://www.example.com/inner.php/sitemap/sitemap.xml
* By using inner.php instead of index.php you avoid loading modules, template, etc, in a page you don't want such things. So your site and database has less stress.

2. None. the HTML sitemap is the default output so sitemap/ equals to sitemap/sitemap.html. Use the sitemap/ if you want to publish a link to the html sitemap.

3. urllist.txt is a plain text sitemap for search engines that support, or require, this format.

4. I dont put anything in "folder". They are pages of component sitemap, so they are all under sitemap/
Elxis 4.x allows you to re-route pages and directories.
You can make http://www.example.com/sitemap/sitemap.xml to be accessible via http://www.example.com/sitemap.xml
Elxis administration > Site > Routing

My recommendation is to leave it as is.

5. Edit components/com_sitemap/controllers/generator.php

6. EDC is component EDC built specially for elxis.net (https://www.elxis.net)

Title: Re: Sitemap component - issues
Post by: maple on July 01, 2013, 13:25:49

Hi,

another issue:

I have a problem for HTML display. Articles need to be ordered by "title" because:

1 - Category
    1.4 name (article)
    1.1 name
    1.2 name
    1.3 name

and need to be:

1 - Category
    1.1 name (article)
    1.2 name
    1.3 name
    1.4 name

And the static pages (all pages without categories) need to be ordered by "Ordering".

I see that I can modify this by generator.model.php file on line 64. But I guess that XML files will be also affected. XML file are correct now ordered by "created" and DESC.

From my questions before, the #1 if I don't add sitemap.xml.gz (only the sitemap.xml) inside robots.txt, how google will get this file? The same for images.xml and urllist.txt.

Thanks a lot. And thanks for your response to my questions before.

Title: Re: Sitemap component - issues
Post by: datahell on July 01, 2013, 13:43:29

Categories get ordered by ordering and articles by date descnding. As the query limits the results to 500 (or 200) if you change the order you might miss new additions in your sitemap if you reach this number of articles. So, don't change the order...

Submit images.xml in google's webaster central, dont put it in robots.txt. Do the same for sitemap.xml regardless if you put it in robots.txt file too.
In robots.txt put only sitemap.xml, nothing else.

Title: Re: Sitemap component - issues
Post by: maple on July 02, 2013, 08:29:31

UPDATED 2 + Screenshot

Oh, articles by date descending is a problem for HTML display, you look before why. So, could be a separate ordenation XML and HTML (a different order each).

In HTML I need to be ordered by Title. You can look the problem for visitors with unordered titles: 1.4, 1.1, 1.2, 1.3 and so on... this can be annoying for them (screenshot).
XML are correct like already is. Date descending.

Note: Why the query are limited to 500, this is a mysql problem, quick access to the site? In case of xml files we have a sitemap.xml.gz files. For HTML we can have a page menu (1-2-3-4-5 so on...) about 100 or 300 per page. For XML files, Google webmaster guideline say that a Sitemap file can contain no more than 50,000 URLs and must be no larger than 50MB when uncompressed. If your Sitemap is larger than this, break it into several smaller Sitemaps. These limits help ensure that your web server is not overloaded by serving large files to Google. You can see this here: http://bit.ly/119Slmq   on official google guidelines for sitemaps.

Or, give me the extra code under my responsability to make articles in HTML mode ordered by title -separetely from xml files, that need to be ordered like already is-.

Also the static pages (all pages without categories) need to be ordered by "Ordering". You can see them also in screenshot.


Thanks a lot.

Title: Re: Sitemap component - issues
Post by: webgift on July 02, 2013, 10:44:48

I would like to mention something here a little bit outside of this subject. When a software is provided for free and it is released for a community, different people may have their own opinions, needs about f.e: sitemap component or anything else. If there were 10 different people like you, Maple what will be the position of the developer?
It's a great advantage and i think Elxis CMS is one of the community that you can speak directly to developers. However we must realize that each extension is released always need to be updated according to our needs. So it would be great if you simply mention the changes that you like and let the extension's developer decide if they need to be included in a future update.

Title: Re: Sitemap component - issues
Post by: maple on July 02, 2013, 11:15:28

webgift,

yes, I understand. In my opinion, having HTML article ordered by title, could be an standard option due ordered lists. Anyway, I can pay for this little code. Nevertheless, I want to mention that in general I'm very happy with Elxis support and the software.

thanks

pd: I will try do it myself.

Title: Re: Sitemap component - issues
Post by: maple on July 02, 2013, 12:27:06

I realize that file backend.html.php file are some info/instructions about sitemap -control panel html-. But I can't find this into my elxis control panel.
This info are not displayed into components -editing component sitemap- neither other place.

Title: Re: Sitemap component - issues
Post by: datahell on July 02, 2013, 14:07:36

To access Sitemap backend:
Elxis administration > Extensions > Sitemap

Comments are welcome although you should not press too much.
I will improve even more sitemap some time (eg more options on the HTML sitemap like displau only categories or only articles), currently let is as is. It is fine. The most important feature is the XML sitemap.

Title: Re: Sitemap component - issues
Post by: maple on July 02, 2013, 14:28:45

Hey, I just found a problem on sitemap.xml

In lastmod instead of last modification date, it display the creation date.

thanks


pd: I just try for myself and I get ordered html by title but xml file do the same... Ok... I'll be looking for sitemaps improvements. Thanks for your response.