Log in

No account? Create an account
Birthday Scraping - LiveJournal Client Discussions — LiveJournal [entries|archive|friends|userinfo]
LiveJournal Client Discussions

[ userinfo | livejournal userinfo ]
[ archive | journal archive ]

Birthday Scraping [Jun. 22nd, 2004|09:31 am]
LiveJournal Client Discussions


I'm interested in getting a list of user X's friends with birthdays. The context is a web page, not a client per se. I can see a few ways to do this:

a) Get X's FOAF data, parse the friends, then get the FOAF data for each of them. Advantages: uses the bot interface, no need to log in as X. Disadvantages: lots of HTTP requests.
b) Scrape X's userinfo, parse out the friends, then scrape their userinfo. Advantages: no need to log in as X. Disadvantages: strictly inferior to method a.
c) Require X to enter her password, and use getfriends. Advantages: uses the client API, single HTTP request. Disadvantages: ew, requiring passwords.

No matter which method is used, there will be caching of data.

I am not so emotionally committed to this project that I will be offended if anyone says "gee, that project is a bad idea." Someone said "Oh, it would be neat if" and I got interested. I think if the three options above are the only possibilities, I'll probably just skip it. However, I wanted to ask before I punted.

[User Picture]From: marksmith
2004-06-22 08:50 am (UTC)
Option C is the best, IMHO. That's how LochJournal works, and most other clients, I believe.

However, if you are dead set on avoiding that, use option A, but be nice to the server, please. :)
(Reply) (Thread)