Directory local/webscraper/sites/

Lines of Code

Developers

Most Recent Commits

helder 2010-06-28 21:54 Rev.: 809

Get article by urlid or url

13 lines of code changed in 1 file:

• local/webscraper/sites: mk_correiomanha.py (+13 -2)

helder 2010-06-20 13:47 Rev.: 780

Fixed video pages from Expresso

9 lines of code changed in 1 file:

• local/webscraper/sites: mk_expresso.py (+9)

helder 2010-06-05 20:44 Rev.: 775

Fix jnegocios date aquisition

11 lines of code changed in 1 file:

• local/webscraper/sites: mk_jnegocios.py (+11 -3)

helder 2010-05-27 09:03 Rev.: 774

Fixed the expresso scraper

10 lines of code changed in 1 file:

• local/webscraper/sites: mk_expresso.py (+10)

helder 2010-05-07 16:26 Rev.: 742

Fixed correio da manhã

49 lines of code changed in 1 file:

• local/webscraper/sites: mk_correiomanha.py (+49 -31)

helder 2010-05-06 12:39 Rev.: 739

Fixed DN scraper - the body is now enclosed in a div with id Article

1 lines of code changed in 1 file:

• local/webscraper/sites: mk_dn.py (+1 -1)

helder 2010-05-03 01:34 Rev.: 734

Expresso is using full lenght month names now.

6 lines of code changed in 1 file:

• local/webscraper/sites: mk_expresso.py (+6 -1)

helder 2010-03-30 17:44 Rev.: 649

Fixed Economico for old articles

20 lines of code changed in 1 file:

• local/webscraper/sites: mk_economico.py (+20 -4)

helder 2010-03-23 18:50 Rev.: 638

Scraper plus feed for jnegocios

130 lines of code changed in 1 file:

• local/webscraper/sites: mk_jnegocios.py (new 130)

helder 2010-03-23 17:24 Rev.: 637

Fix for some rare Economico articles

13 lines of code changed in 1 file:

• local/webscraper/sites: mk_economico.py (+13 -3)

helder 2010-03-23 16:24 Rev.: 636

Economico RSS feed parser

1 lines of code changed in 1 file:

• local/webscraper/sites: mk_economico.py (+1 -1)

helder 2010-03-23 13:46 Rev.: 635

Scraper for Económico.

108 lines of code changed in 1 file:

• local/webscraper/sites: mk_economico.py (new 108)

helder 2010-03-10 12:32 Rev.: 611

Fix a crash on the publico feed, now we accept feeds without terms;
Test for empty article even from a rss feed;
Fix a JN when an article is empty.

6 lines of code changed in 1 file:

• local/webscraper/sites: mk_jn.py (+6 -2)

helder 2010-02-25 02:28 Rev.: 581

Fixed rss source CM. Started escaping html entities.

9 lines of code changed in 2 files:

• local/webscraper/sites: mk_correiomanha.py (+7 -2), mk_publico.py (+2 -1)

helder 2010-02-23 16:05 Rev.: 574

Use Público's permalinks

5 lines of code changed in 1 file:

• local/webscraper/sites: mk_publico.py (+5 -1)

ze 2010-02-05 00:14 Rev.: 549

The rss for the Correio da Manhã

3 lines of code changed in 1 file:

• local/webscraper/sites: mk_correiomanha.py (+3 -3)

ze 2010-02-02 03:31 Rev.: 545

Created the webscraper for the Correio da Manhã, site feature. Missing the DATE.

89 lines of code changed in 1 file:

• local/webscraper/sites: mk_correiomanha.py (new 89)

helder 2010-02-01 09:43 Rev.: 542

Small fix to the Sol feed.

1 lines of code changed in 1 file:

• local/webscraper/sites: mk_sol.py (+1 -1)

helder 2010-01-31 01:45 Rev.: 536

- Update to the to do list;
- Small fixes on i-online and RSS JN.

2 lines of code changed in 1 file:

• local/webscraper/sites: mk_ionline.py (+2)

helder 2010-01-30 23:31 Rev.: 535

- New source 'Oje';
- How-to create a scraper;
- RSS reader for 'JN';
- Small Fixes.

342 lines of code changed in 5 files:

• local/webscraper/sites: README (new 207), mk_expresso.py (+1 -3), mk_jn.py (+1), mk_oje.py (new 133), mk_sol.py (-1)

(18 more)