bugGNU FM - Bugs: bug #26655, Repeated crash of lastscrape.py...

 
 

bug #26655: Repeated crash of lastscrape.py before finish

Submitted by:  superkuh <superkuh>
Submitted on:  Sat 23 May 2009 08:36:35 PM UTC  
 
Category: lastscrapeSeverity: 3 - Normal
Item Group: ImportingStatus: None
Privacy: PublicAssigned to: None
Open/Closed: Open

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Sat 23 May 2009 08:36:35 PM UTC, original submission:

I have >200k plays on last.fm. Using lastscrape.py takes a long time (obviously). Before all tracks can be scraped off the last.fm website the script will crash at a seemingly random point (each time about ~1 hour into running). I have tried 4 times now. I do not know how to further debug this.

example(s):

$ ./lastscrape.py superkuh lastfm_dump.txt
Trampled By Turtles Salvation 2009-05-23T13:58:36Z
...two hours pass...
Common Rider Rise or Fall 2007-10-18T23:15:42Z
Traceback (most recent call last):
File "./lastscrape.py", line 98, in <module>
sys.exit(main(*sys.argv))
File "./lastscrape.py", line 89, in main
for artist, track, timestamp in fetch_tracks(args[1]):
File "./lastscrape.py", line 75, in fetch_tracks
for artist, track, timestamp in tracks:
File "./lastscrape.py", line 34, in parse_page
for row in soup.find('table', 'candyStriped tracklist').findAll('tr'):
AttributeError: 'NoneType' object has no attribute 'findAll'

$ ls
-rw-r--r-- 1 superkuh superkuh 6.8M 2009-05-23 11:59 lastfm_dump.txt

$ ./lastscrape.py superkuh lastfm_dump2.txt
Trampled By Turtles Salvation 2009-05-23T13:58:36Z
...
The Raconteurs Consoler of the Lonely 2008-11-17T02:50:56Z
Traceback (most recent call last):
File "./lastscrape.py", line 98, in <module>
sys.exit(main(*sys.argv))
File "./lastscrape.py", line 89, in main
for artist, track, timestamp in fetch_tracks(args[1]):
File "./lastscrape.py", line 75, in fetch_tracks
for artist, track, timestamp in tracks:
File "./lastscrape.py", line 34, in parse_page
for row in soup.find('table', 'candyStriped tracklist').findAll('tr'):
AttributeError: 'NoneType' object has no attribute 'findAll'

$ ls
-rw-r--r-- 1 superkuh superkuh 2.1M 2009-05-23 12:46 lastfm_dump2.txt

superkuh <superkuh>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by encukou
  • -unavailable- added by superkuh (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follows 1 latest change.

    Date Changed By Updated Field Previous Value => Replaced By
    Tue 26 May 2009 09:04:04 PM UTCencukouCarbon-Copy-=>Added encukou

    Back to the top


    Powered by Savane 3.1-cleanup