On Mon, 03 Oct 2016 22:49:17 -0400, notyet@here.now wrote:
>Hi Spike,
>
>I really appreciate the helpful tips from you and Mike. I don't mean
>to confuse anyone with too much verbosity about how I do what I do, as
>there are countless ways to do the same things. You asked if I marked
>headers "read" or deleted them. I delete them, and yes, I would get
>them again if I selected GetAll headers, but I only do that the first
>time, and use the sample headers afterwards, and specify the start
>date to avoid getting what I already processed.
>
>I learned something else about Agent, that I'm not sure what to make
>of, see attached image. The final paragraph in the text says, "If the
>total is more than 8 million headers, Agent will discard the oldest of
>the newly retrieved headers." So if I understand that, it was well
>that I stopped the retrival process, since if I had waited many days
>for it to complete, it would have still given me 8 million headers,
>but deceived me into thinking I had gotten everything, since I didn't
>know about this feature until now. I now wonder if it dropped things
>older than Sept 2009. I will check this when I'm ready for more
>headers, just to see how far back it goes.
>
>I know you are right, that once I get my kill filters figured out,
>this group will be managable. I don't care for the bulk of content on
>regular TV these days, but there is lots of stuff here that isn't
>found in the documentary group, so I plan to keep following teevee,
>now that you got me started there. Much thanks again!
>
>Yeah, I knew searching for BBC wouldn't get me much, but I'm just
>getting started. THANKS for the "c4tv" tip!
>
>THanks for mentioning the purge business. Currently, out of fear of
>the unknown, I set mine to never purge anything ever. But I've
>noticed that 40 GB dat file for teevee is still the same size after
>all I've deleted, so I need to make some changes there.
>
====================================================
As you say, we all have our own way of doing things. I have heard of
Agent having an 8GB Folder limit but not heard of the 8 Million header
limit... maybe they are the same thing.
I also mentioned that Agent wouldn't be able to handle headers going
back as far as you wanted to get them from (and So Many headers).
The reason I say that is because I have often tried to download ALL
headers from groups and have got the Agent Folder Full Error.
Have you actually tried getting posts from back in 2009 ? Are servers
anywhere near good enough to still have complete posts from 7 years
ago ?
You might want to test this out, you might be wasting your time.
My Tweaknews connection only pulls headers back from 2012 and its a
Push to expect Them to still be complete.
You might save yourself at least 3 years of headers to check (2009 to
2011).
Kill filters have helped to keep Me sane :) They DO start to take more
and more time for the system to process as you build the collection up
though, filtering a new 'string' after a new string will gradually
start to take more time... but is worth it.
I also killfile most of the TV programmes but have maybe a couple of
dozen that I like to watch.
After 'JC' stopped posting, teevee is the best (Usenet) place I have
found for documentaries, the 'moovee' group throws out a few but these
are few and far between.
Purging... its safe to purge 'read messages' after 1 day... after all
! You Have read them if they are marked 'read'! :)
You mention that the DAT file is still 40GB, this is confusing but I
would imagine that its probably down to Not Purging at all.
Like I say... I'm Not an Agent expert and each to their own.
There used to be a couple of Agent newsgroups that were geared just to
the use of Agent, one was for serious questions and the Real experts
would give advice, another was for Agent Tweaks/modifications.
I'm not sure how active they are these days but it might be worth
looking.
***************************************************
* 'There are only 10 types of people in the world... those *
* who understand Binary... and those who dont' *
***************************************************
|--Spike=-
|
|