?

Log in

No account? Create an account
ALJ - LiveJournal Client Discussions [entries|archive|friends|userinfo]
LiveJournal Client Discussions

[ userinfo | livejournal userinfo ]
[ archive | journal archive ]

ALJ [Feb. 13th, 2004|10:21 pm]
LiveJournal Client Discussions

lj_clients

[alexf]
ALJ is a program for exporting complete user's journal including all comments into plain files. Once journal is downloaded, program can check if new entries are available, download them and add to plain file.
Features: Unlike similar programs, like ljsm and "LiveJournal Download", ALJ downloading journal simultaneously in several streams, which makes it slightly faster and also downloading posts with more than 1 page of comments. Since some journals could be really big in size, program breaks plain file into smaller pieces of 1MB, so that IE can handle this files. All parts are linked to each others for easy navigation and program itself can re-use this files for downloading new entries, which eliminates need of keeping original pages received from livejournal web site. Because plain file is at least 2-4 times more compact than original pages, this could save you lots of disk space and reduces searching time through the pages. Program uses IE cookie in your system when its downloading, so it will see your and other people's posts according to your actual permissions.
How to use: enter user name, press Index. After indexing is completed, press Get. You can press stop if you want to stop downloading, it can be resumed later. Program will show you how many total links this jourmal has and how many percents are aleady downloaded. After downloading is finished, plain text version will be in Txt subfolder of the program.
If plain text version is corrupted for some reason, press Restore button and it will be re-created from available downloaded pages.
If you like it, try it and tell me what you think.
alj.zip
linkReply

Comments:
[User Picture]From: t3knomanser
2004-02-13 07:32 pm (UTC)
I doubt you'll care, but it doesn't work on a Mandrake box via WINE. Not your target audience, I know, but it's what I've got.
(Reply) (Thread)
[User Picture]From: alexf
2004-02-13 07:38 pm (UTC)

Re:

You are unable to run the program or downloading does not work? Program is actually pretty simply, using only WinInet and MS Regexp. It's probably regexp that is not working, probably it is not installed on WINE.
(Reply) (Parent) (Thread)
[User Picture]From: t3knomanser
2004-02-14 07:02 am (UTC)

Re:

It crashes when I used download or index. What DLLs are those in? I can try d/ling and installing them, see if that fixes things.

The error is a VC++ runtime library error with the message "Abnormal Program Termination"

So probably it is that the libraries for WINE are nonexistant or broken.
(Reply) (Parent) (Thread)
From: evan
2004-02-16 02:49 pm (UTC)

Re:

If you're on Mandrake: LogJam can download all of your entries, but not all of your comments.
(Reply) (Parent) (Thread)
[User Picture]From: t3knomanser
2004-02-16 03:33 pm (UTC)

Re:

That wasn't really the point though. Sorry, I've just been getting off on getting Windows progs working on *nix... mostly for my wife, who wants to switch to *nix but is going to miss several programs.
(Reply) (Parent) (Thread)
[User Picture]From: alexf
2004-02-19 05:15 am (UTC)

Re:

It's hard to tell which actual dll's you need to make the program works, because Regexp is part of VBS. I know that you can download it from M$ website somewhere but don't know where exactly and probably it does not worth the efforts. Easier to install Windows itself somewhere.
(Reply) (Parent) (Thread)
[User Picture]From: guil
2004-02-17 06:00 pm (UTC)
when I have more than 50 comments in a post, is there any way I can download all of them? because livejournal will group them in threads and won't show them all in the comments page...
I have this problem using ljsm and also using your alj program... it would be really nice to be able to solve this...

otherwise, I tried alj and everything seemed to be fine :)
great work!
(Reply) (Thread)
[User Picture]From: alexf
2004-02-18 06:49 am (UTC)

Re:

when I have more than 50 comments in a post, is there any way I can download all of them?

Have you tried my program? It should handle this. It will create big plain file with all posts and comments.
(Reply) (Parent) (Thread)
[User Picture]From: guil
2004-02-18 06:59 am (UTC)

Re:

Hi!
after I wrote that comment I found out that your program handles this... I was looking at the wrong files, not the big plain files but the other ones, one per post.
this looks really good! It seems to be working perfectly! :)

thanks! :)
(Reply) (Parent) (Thread)
[User Picture]From: guil
2004-02-18 12:24 pm (UTC)
Alex, two more things...
In the plain files that alj creates, is there a way you could organize the comments so that it would be poossible to know which ones are replies to others? I don't know how you could do this, but the fact is that the actual result is very confusing to read, because it's hard to see if a certain comment is an answer to a previous one.
Maybe if you could use some sort of tabs to indent the comments...
Something like this:

comment A
comment A.1
comment A.2
comment A.2.1
comment A.3
commment B
comment B.1

(in this example, the actual results look like this:
comment A
comment A.1
comment A.2
comment A.2.1
comment A.3
comment B
comment B.1
which is confusing, it's hard to understand the right order to read the comments)


Second question:
what is that song that plays when we go to the "About" tab? :)
(Reply) (Thread)
[User Picture]From: alexf
2004-02-19 05:05 am (UTC)

Re:

I am thinking about proper hierarchy for comments, but don't know how to do it right now. There are problems with parsing and there are problems with displaying.
Song is called "Yablochko" ("Little Apple"), it is Russian folklore song.
(Reply) (Parent) (Thread)
(Deleted comment)
[User Picture]From: alexf
2004-02-24 07:48 pm (UTC)
The program is using default IE cookies to download from LJ website, i.e. it "sees" exactly what you can see in some particular journal. If you want to download your own journal with all entries - login into LJ with persistent cookie and then use ALJ. If you want to download only public entries - log off before downloading.
(Reply) (Parent) (Thread)
[User Picture]From: wind_spirit
2004-02-29 09:44 am (UTC)
No matter which journal I try to Index it goes through a little process, and it comes up with this:

links - 0 completed 0.00%
Retrieving bin http://........
Bytes: 203

Then it goes back to just:

links - 0 completed 0.00%

And then it doesn't do anything when I say 'get'. I've tried this program on about seven different journals now on two different computers and it always does that same thing. Any suggestions? They're both Windows ME. Don't know if that matters.
(Reply) (Thread)
From: thenhewokeup
2004-02-29 02:49 pm (UTC)

The exact same problem, except I'm on XP Professional. When I start to index a journal, it appears to get stuck in a loop for a while when it's retrieving the following URL:

Retrieving bin http://www.livejournal.com/view/?type=month&user=thenhewokeup&y=2004&m=04&usescheme=lynx

This is in itself interesting since it's trying to retrieve the view for a month in the future but regardless, it does nothing after it comes out of the loop. Wish I had more info to report on this but there don't seem to be any logs or any other files generated as a result of its processing. The "current" folder contains nothing except the binary itself when it stops.
(Reply) (Parent) (Thread)
[User Picture]From: alexf
2004-03-01 08:57 am (UTC)
Looks like livejournal website currently forbids using my program. I am getting 403 error instead of calendar page.
(Reply) (Parent) (Thread)
[User Picture]From: yincrash
2004-03-30 11:47 pm (UTC)
you might have violated the bots policy, i'm not positive though.

http://www.livejournal.com/bots/
(Reply) (Parent) (Thread)
[User Picture]From: alexf
2004-04-01 03:12 pm (UTC)

Program is working again and it works very well! :) alj
(Reply) (Parent) (Thread)
[User Picture]From: belyay
2004-10-23 04:04 pm (UTC)
drying to download the programm, recieve "error 404: File not found"
(Reply) (Thread)
[User Picture]From: alexf
2004-10-23 08:45 pm (UTC)
(Reply) (Parent) (Thread)
[User Picture]From: belyay
2004-10-23 08:54 pm (UTC)
О, спасибо!
(Reply) (Parent) (Thread)