Thoughts on Adult Pages, Link Farms and the like
Adopted
Abstract
We might be better off identifying pages that don't add value to our core mission
Types of Pages
- Adult (Possibly Adult Content)
- Link Farms
- 404 Errors
- Malware
- NoBot
- see PageRank for more thoughts on this
NoFollow
For these kinds of pages, we may want to set all outgoing links (Page title, Thumbnail and link above Thumbnail) to "NoFollow". The fact that we're giving them any love right now is probably hurting our ranking with Search Engines and also text link price calculators.
Walled Garden
By marking more pages as "Possibly Adult Content" we will also be protecting folks who don't want to see that material on our site.
Next Steps
- The key to making this happen is identifying the pages in bulk. How an we identify pages in any of these categories in bulk? Manually tagging is not likely to get us there fast enough.
- NameIntel.com may be able to help
- Other public lists?
Optin Follow
Set all sites to nofollow until they have an edit history. Once they have an edit history or marked as a positive site it will be follow the external links. I will trust this more than an external list. We can do a trial run on limited categories. It is better to do work on subsets than a major change when it comes to Google. This way we will be marketing the human editor side of AboutUs.
Notes on recent work
I added the possible adult category to many, many categories that would only be used by adult sites. If a bot could automatically flag all the pages in those categories, we'd go a long way towards removing adult content. I have no idea if the work I've done is 10% of all adult pages or 50% or what. It was a lot of work. I would also like to have all categories removed from all adult pages. I'm not sure if google cares about this if the categories themselves are marked adult, but I think it's the right thing to do. I also think our policy demands it. TedErnst (talk) 14:42, 24 January 2008 (PST)
- Removing categories will be easy once identified as an adult site. Once you place the adult Splash Screen no PageRank will be lost because it is not a link to get to that page. Actually Google will not even be able to crawl those pages because there is no link to them, but a submit form. Igorberger 14:51, 24 January 2008 (PST)
- I am not a fan of removing the categories. Kind of defeats a purpose of AboutUs as folksonomy of the web, and if we are deleting the categories, why not just delete or blank the pages? ~~ MarkDilley
The implimentation section of AdultContentPolicy says: "To prevent unwanted associations, flagged pages will not be categorized or have related domains that cross the walled garden boundary." -- TedErnst (talk)
- yuck - ~~ MarkDilley
Nofollow Pitfall
There is a great danger once we start using nofollow the bug will spread to the whole project. We must guard this project from becoming all nofollow project. Igorberger 16:35, 24 January 2008 (PST)
- Igor, I am very interested in your thoughts about the slippery slope of nofollow. My gut tells me it is good in certain instances, but am weary of the slippery slope. ~~ MarkDilley
- Yes Mark we should only use nofollow for negative external links. We want to have Google iterate the domain as much as possible, but also avoid duplicate content as well, so not too many redirects unless they are 301 redirects.
Redirects
Igor I am interested in learning about redirects - how do we know if that are 301 or other? ~~ MarkDilley
#redirect [[NewDesinationDomain.foo]] this is a 302 redirect. 301 redirects will return 301 when you do header check. You need to set up a 301 by a sysop ability!Igorberger 18:07, 30 January 2008 (PST)- I see we are using header script for redirect and actually getting 200 ok which in pronciple is not a redirect but a new page. While it is discorage to have many pages to the same content, Google got really good at picking the best page to represent the content in the search results Still it may not be the desired page but some other page, depending which page gets the highest PageRank distributed to it from other higher PageRank pages with a combination of a number of superior links to a page. Igorberger 19:37, 30 January 2008 (PST)
