Shawn,
If you're using a newer lustre with changelogs Robinhood has a very nice
feature in that it supports changelogs. This means you get a fairly
close to realtime picture of your filesystem, unlike routine scans.
For us, that's a great thing.
Scott
On 2/12/14 5:59 PM, Hall, Shawn wrote:
So just some background - we run a full ls on each of our file
systems every night in order to know about the files our users have
on the file systems, with file size being of particular importance
(so we know who the biggest space offenders are), so Lester looks
interesting to us.
From playing with it a little bit, it appears that Lester pulls what
it can from the MDT. It appears that file size is not one of these
things, which makes sense. It does appear that there may be
something configurable by some like a “lctl conf_param
$FSNAME.mdt.som” on the MDT, which puts file sizes on metadata (SOM).
Not much documentation on this that I can find, but is this something
that could be used by Lester to find file sizes?
My other option is to try out Robinhood and see if that will do what
we’re looking for as well, which I think it will.
Thanks, Shawn
On Feb 12, 2014, at 1:13 PM, Hall, Shawn<Shawn.Hall(a)bp.com> wrote:
> Thanks Rick. I had never stumbled across that tree on
>
downloads.whamcloud.com. I installed the e2fsprogs-devel rpm and
> that did the trick. For reference, I did not have to change the
> flags in lester.c either - the vanilla lester code works correctly
> if you have the Intel e2fsprogs-devel package installed.
>
> Thanks everyone!
>
> Shawn
>
> On Feb 12, 2014, at 12:31 PM, Mohr Jr, Richard Frank (Rick
> Mohr)<rmohr(a)utk.edu> wrote:
>
>>
>> On Feb 12, 2014, at 1:22 PM, "Hall, Shawn"<Shawn.Hall(a)bp.com>
>> wrote:
>>
>>> I’ve been using the sourceforge vanilla e2fsprogs as DDN does
>>> not seem so provide a e2fsprogs-devel package with their ISO.
>>> That may be part of the problem. Is
git.whamcloud.com the best
>>> place to retrieve the e2fsprogs code for this purpose?
>>
>> Is this the download URL you were using?
>>
>>
http://downloads.whamcloud.com/public/e2fsprogs/
>>
>> -- Rick Mohr Senior HPC System Administrator National Institute
>> for Computational Sciences
http://www.nics.tennessee.edu
>>
>>
>
> _______________________________________________ HPDD-discuss
> mailing list HPDD-discuss(a)lists.01.org
>
https://lists.01.org/mailman/listinfo/hpdd-discuss
_______________________________________________ HPDD-discuss mailing
list HPDD-discuss(a)lists.01.org
https://lists.01.org/mailman/listinfo/hpdd-discuss