June 29th, 2006

saxophone

Caching for bots?

I'm writing a few bots to poll friend data and friend RSS feeds. LJ very much encourages caching, and I will indeed cache (I don't want my bots to be blocked!) But how much caching is appropriate? For any one feed, how much time should pass before I poll the server for another? How long should I keep things cached (so that LJ doesn't block me?)