?

Log in

No account? Create an account
Not sure if this the right place to post this request... This is… - LiveJournal Client Discussions — LiveJournal [entries|archive|friends|userinfo]
LiveJournal Client Discussions

[ userinfo | livejournal userinfo ]
[ archive | journal archive ]

[Sep. 15th, 2004|03:32 pm]
LiveJournal Client Discussions
lj_clients
[djsgc]
Not sure if this the right place to post this request...

This is what I want to do;

Pull the data that shows how many posts, comments, date journal started, last journal entry etc.

Then be able to pull data for everyone on my friends list.

Insert into some kind of graph so I can see highest number of posts comments, oldest journal, redundant journals etc.

Then

Make it useable by some of my LJ friends

The way I think it may be done;

Pull data *somehow* so it can be written into a html file *or similar*

Analyse data using some kind of web log analyser *or similar*

Now I am sure this has already been done, I want to do this firstly for my idle curiosity and secondly as if I can do this then

a> I learn something new

b> I can use my new found knowledge for other data etc

I don't want someone to *tell* me how to do this, just some good advice, starting points, similar code/scripts.

Any advice would be really helpful!

Robbie
linkReply

Comments:
[User Picture]From: mcfnord
2004-09-15 05:22 pm (UTC)
Do you plan to update the bot policy? And do you warn before you ban?
(Reply) (Parent) (Thread)
[User Picture]From: marksmith
2004-09-15 05:54 pm (UTC)
Update what how? The policy has not changed.

We warn if the user-agent is properly formed. Else, we just ban. No way to figure out who's doing it if they're not following the rules. No way that we care to invest time into doing, that is. If people are considerate to us and our site, we'll be considerate to them and theirs.
(Reply) (Parent) (Thread)
[User Picture]From: mcfnord
2004-09-15 06:31 pm (UTC)
The bot policy page says
      You are encouraged to use these resources instead of "screen-scraping" user pages.
You say
      We tend to ban clients that we notice are screen scraping.
and
      You should never have to parse HTML.
Do you believe these are the same policy?
(Reply) (Parent) (Thread)
[User Picture]From: marksmith
2004-09-15 06:38 pm (UTC)
Yep.
(Reply) (Parent) (Thread)
[User Picture]From: mcfnord
2004-09-15 08:49 pm (UTC)
Some day I would like to speak with you on the phone on this issue. I seem to lack a certain context that would be more clear that way.
(Reply) (Parent) (Thread)