?

Log in

No account? Create an account
Archiving Entries? - LiveJournal Client Discussions [entries|archive|friends|userinfo]
LiveJournal Client Discussions

[ userinfo | livejournal userinfo ]
[ archive | journal archive ]

Archiving Entries? [Dec. 12th, 2006|06:47 pm]
LiveJournal Client Discussions

lj_clients

[rebeccael]
Hi,
I'm trying to find a way to mass download as many entries as possible with comments, which the LJ Exporter won't let me do. Also, it would be awesome if they downloaded in some readable form that preserved formatting, instead of with a bunch of HTML or other code inserted. Is there a client that will let me do that, or any other way for me to do it? Thanks!
Breca
linkReply

Comments:
[User Picture]From: int
2006-12-13 01:02 am (UTC)
Search for a prog called ljArchive; it's quite awesome and should do everything you want.
(Reply) (Thread)
[User Picture]From: int
2006-12-13 01:07 am (UTC)
PS. You have the exact same first/last names as my ex. I shall run now.
(Reply) (Parent) (Thread)
[User Picture]From: rebeccael
2006-12-13 01:09 am (UTC)
Your ex is Breca Halley? Well, I made it up, so no worries. :P And thanks for the program, I'm downloading it now. :)
(Reply) (Parent) (Thread)
[User Picture]From: int
2006-12-13 01:18 am (UTC)
No, real name, I did some 30 second profile stalking.
(Reply) (Parent) (Thread)
[User Picture]From: rebeccael
2006-12-13 01:20 am (UTC)
Hehehe! Well, I'm pretty sure I'm not your ex anyway. The program looks great too, by the way. Do you know if there's any way to export it into something like Microsoft Word?
(Reply) (Parent) (Thread)
[User Picture]From: int
2006-12-13 01:27 am (UTC)
I don't think so. It can export to a giant HTML file, or as XML.You could try LJBook if you want a giant PDF of your LJ.
(Reply) (Parent) (Thread)
[User Picture]From: rebeccael
2006-12-13 01:44 am (UTC)
Whoa, that's frickin' awesome. Thanks!
(Reply) (Parent) (Thread)
[User Picture]From: ati
2006-12-13 06:18 am (UTC)
(Reply) (Thread)
[User Picture]From: natf
2007-01-15 07:32 am (UTC)
Does that also backup comments as the OP requested?
(Reply) (Parent) (Thread)
[User Picture]From: ati
2007-01-15 09:17 am (UTC)
yes it does.
it should also run on mac, by the way
(Reply) (Parent) (Thread)
[User Picture]From: natf
2007-01-16 01:18 am (UTC)
On the mac I get:

"Can't locate LWP/UserAgent.pm in @INC (@INC contains: /System/Library/Perl/5.8.6/darwin-thread-multi-2level /System/Library/Perl/5.8.6 /Library/Perl/5.8.6/darwin-thread-multi-2level /Library/Perl/5.8.6 /Library/Perl /Network/Library/Perl/5.8.6/darwin-thread-multi-2level /Network/Library/Perl/5.8.6 /Network/Library/Perl /System/Library/Perl/Extras/5.8.6/darwin-thread-multi-2level /System/Library/Perl/Extras/5.8.6 /Library/Perl/5.8.1 .) at ljsm.pl line 92.
BEGIN failed--compilation aborted at ljsm.pl line 92."

:(
(Reply) (Parent) (Thread)
[User Picture]From: ati
2007-01-16 09:04 am (UTC)
It's ok.
You should install libwww module to use ljsm.
I don't have access to mac computer, but I think there should be some kind of package manager, for example fink

try typing at the command prompt
fink install libwww
and run ljsm again
(Reply) (Parent) (Thread)
[User Picture]From: natf
2007-01-17 07:50 am (UTC)
I downloaded fink and did that which succeeded. Now I get:

"Can't locate LWP/UserAgent.pm in @INC (@INC contains: /sw/lib/perl5 /sw/lib/perl5/darwin /System/Library/Perl/5.8.6/darwin-thread-multi-2level /System/Library/Perl/5.8.6 /Library/Perl/5.8.6/darwin-thread-multi-2level /Library/Perl/5.8.6 /Library/Perl /Network/Library/Perl/5.8.6/darwin-thread-multi-2level /Network/Library/Perl/5.8.6 /Network/Library/Perl /System/Library/Perl/Extras/5.8.6/darwin-thread-multi-2level /System/Library/Perl/Extras/5.8.6 /Library/Perl/5.8.1 .) at ljsm.pl line 92.
BEGIN failed--compilation aborted at ljsm.pl line 92."

Sorry to be so thick about this stuff - I used to understand all of this before multiple sclerosis get to me...
(Reply) (Parent) (Thread)
[User Picture]From: ati
2007-01-17 09:12 am (UTC)
ok, let's try it another way.
install libwww module using standard CPAN module:

perl -MCPAN -e "install Bundle::LWP;"
(Reply) (Parent) (Thread)
[User Picture]From: natf
2007-01-17 11:49 am (UTC)
Trying that as I type. I must admit to using autoconfigure (typing 'no' to manual configure, though, and it is saying this a lot (every few lines):
"LWP not available"
(Reply) (Parent) (Thread)
[User Picture]From: natf
2007-01-17 11:53 am (UTC)
OK - that ended up with this:

"Checking if your kit is complete...
Looks good
Writing Makefile for LWP
-- NOT OK
Running make test
Can't test without successful make
Running make install
make had returned bad status, install seems impossible
Bundle summary: The following items in bundle Bundle::LWP had installation
problems:
MIME::Base64 Digest::MD5 HTML::Tagset HTML::Parser HTML::HeadParser LWP
Running install for module HTML::Tagset
Running make for P/PE/PETDANCE/HTML-Tagset-3.10.tar.gz
Is already unwrapped into directory /Users/natalie/.cpan/build/HTML-Tagset-3.10
Has already been processed within this session
Running make test
Can't test without successful make
Running make install
make had returned bad status, install seems impossible
Running make for G/GA/GAAS/HTML-Parser-3.56.tar.gz
Is already unwrapped into directory /Users/natalie/.cpan/build/HTML-Parser-3.56

CPAN.pm: Going to build G/GA/GAAS/HTML-Parser-3.56.tar.gz

-- NOT OK
Running make test
Can't test without successful make
Running make install
make had returned bad status, install seems impossible"

I assume that that is not good...
(Reply) (Parent) (Thread)
[User Picture]From: ati
2007-01-17 02:44 pm (UTC)
I must confess that I don't know what is the right way to install perl modules in Mac.
If I were you, I will try to build it the unix way:
1. Download libwww-perl
2. Extract files from the archive: tar xvzf libwww-perl-5.805.tar.gz
3. cd to libwww-perl directory
4. perl Makefile.PL
5. make
6. make test
7. make install

But there must be a better way to install perl modules -- try to ask about it in mac communities.
(Reply) (Parent) (Thread)
[User Picture]From: natf
2007-01-17 03:30 pm (UTC)
Ty for your help. As I say, I used to *do* Perl but my brane got eaten by the multiple sclerosis...
(Reply) (Parent) (Thread)
[User Picture]From: ati
2007-01-17 03:39 pm (UTC)
Ty for giving it a try :)
(Reply) (Parent) (Thread)
[User Picture]From: 2shortplanks
2007-01-17 09:37 pm (UTC)
Nat, it looks like "make" isn't working. This is probably because it isn't installed - it's not by default on Mac OS X.

You need to install the developer tools. A version should have shipped on a separate disk with your mac, but that's probably out of date now (but will still work if you have it.)

I suggest you sign up for an ADC account from http://developer.apple.com/. Once you've got one (nothing more complicated than a username and password and email address to sign up) you'll be able to download the 938.2MB of developer tools as a DMG. Once you've got that installing it as simple as double clicking the image, and then double clicking the XCodeTool.mpkg inside that.

installing LWP should then be as simple as:

$ sudo cpan
(answer "no" to the "are you ready for manual setup" to use the defaults)
cpan> install LWP::UserAgent

If you have problems getting the developer tools then drop me a line and I'll burn you a DVD with them on and stick 'em in the post.
(Reply) (Parent) (Thread)
[User Picture]From: natf
2007-01-18 12:04 pm (UTC)
Ah hah! I had X11 installed and so I assumed that I had all of the developer tools installed! ;-p

I will give that a try!
(Reply) (Parent) (Thread)
[User Picture]From: natf
2007-01-18 04:10 pm (UTC)
Installed XCodeTools.mpkg then did:

$ sudo cpan
(answer "no" to the "are you ready for manual setup" to use the defaults)
cpan> install LWP::UserAgent


Then got:

"...
Checking for URI........... ok
Checking for HTML::Parser.. ok
Checking for MIME::Base64.. ok
Checking for Net::FTP...... ok
Checking for Digest::MD5 .. ok

Checking if your kit is complete...
Looks good
Writing Makefile for LWP
-- NOT OK
Running make test
Can't test without successful make
Running make install
make had returned bad status, install seems impossible"

Stuck again.
(Reply) (Parent) (Thread)
[User Picture]From: natf
2007-01-15 07:33 am (UTC)
Has anyone come back with a non-wondoze (I use a mac) solution to this question? I would love a ljArchive-a-like for the mac or a platform-independent version...
(Reply) (Thread)