OurWork < DevelopmentTeam < Priorities < (1) PresidentialScraper (?)

What is the project? edit

Convert spike to compost ... automate the retrieval of all the stats used on Portal:2008_Presidential_Election, increase the freshness of the data.

See also Quote-Back Technology

Why is it important? edit

1. Very hot data
2. Takes a lot of time to manually update stats
3. Moves us towards implementing Quote-Back Technology
4. Eventually people will begin to consume our data and the campaigns themselves may begin to keep track of what is happening on Portal:2008_Presidential_Election

DoneDone edit

• Use compost to retrieve the data instead of the hacked heuristics
• Code is well tested
• Automagically refreshes the page every day
• Calls a human when values fall out of the expected norms
• BONUS: Create a machine readable datafeed of this data that others can consume.

Notes edit

• Portal:2008 Presidential Election/Social Stats (experimental) -- page used to test spike