LUG 2014: Register Today with Exclusive Early-Bird Discount
by OpenSFS Administration
<http://www.opensfs.org/events/lug14/>
Registration Opens Today: Lustre User Group 2014
Miami Marriott Biscayne Bay, April 8-10
Would you like to hear directly from industry thought leaders about the
latest Lustre file system trends? By attending the 12th Annual Lustre
<http://www.opensfs.org/lug14/> R User Group (LUG) Conference, you and your
associates will have the exclusive opportunity to collaborate with industry
leaders to advance the Lustre file system and contribute to new releases on
behalf of the open source community.
LUG 2014 will be held on April 8-10 at the
<http://www.marriott.com/hotels/travel/miabb-miami-marriott-biscayne-bay/>
Miami Marriott Biscayne Bay in Miami, Florida! The event will feature 25+
sessions on topics including:
* OpenSFS' first Lustre Annual Report
* Major technical sessions covering Exascale, coming features, deep
dives into Lustre 2.5 and more
* Wide range of smaller lightning poster sessions with topics like
LNET, ZFS, Enterprise storage systems and more
We are also happy to offer one complimentary event pass to each member
company of OpenSFS as a benefit of membership. The discount code will be
sent to the primary contact, but it may be transferred to another
representative at the same company if the primary contact will not be
attending.
Registration opens today!
<https://opensfs.wufoo.com/forms/lug-conference-2014/> Register now to take
advantage of the special early bird rate before March 17th. The early bird
registration price is $525.
Be sure to check back regularly, as speakers and session highlights will
also be posted over the coming weeks.
<https://opensfs.wufoo.com/forms/lug-conference-2014/> Register today for
LUG 2014! If you have any questions, please feel free to contact
<mailto:admin@opensfs.org> admin(a)opensfs.org.
Best regards,
OpenSFS LUG Planning Committee
_________________________
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97006 USA
Phone: +1 503-619-0561 | Fax: +1 503-644-6708
Twitter: <https://twitter.com/opensfs> @OpenSFS
Email: <mailto:admin@opensfs.org> admin(a)opensfs.org | Website:
<http://www.opensfs.org> www.opensfs.org
<http://www.opensfs.org/lug-2014-sponsorship/>
<http://www.opensfs.org/lug-2014-sponsorship/> Click here to learn how to
become a 2014 LUG Sponsor
Open Scalable File Systems, Inc. was founded in 2010 to advance Lustre
development, ensuring it remains vendor-neutral, open, and free. Since its
inception, OpenSFS has been responsible for advancing the Lustre file system
and delivering new releases on behalf of the open source community. Through
working groups, events, and ongoing funding initiatives, OpenSFS harnesses
the power of collaborative development to fuel innovation and growth of the
Lustre file system worldwide.
7 years, 3 months
Recent kernel versions and Lustre: support and status
by Alexey Shvetsov
Hi all!
I collected patches needed to run lustre servers with zfs backstorage on
linux 3.11. What is the status for more recent kernels?
--
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, NRC Kurchatov Institute, Gatchina,
Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum@gmail.com
mailto:alexxy@gentoo.org
mailto:alexxy@omrb.pnpi.spb.ru
7 years, 4 months
Lester, the Lustre lister
by David Dillow
I'd like to announce the availability of Lester, the Lustre lister. It
is available from github at https://github.com/ORNL-TechInt/lester
Lester is an extension of (n)e2scan for generating lists of files (and
potentially their attributes) from a ext2/ext3/ext4/ldiskfs filesystem.
We primarily use it for generating a purge candidate list, but it is
also useful for generating a list of files affected by an OST outage or
providing a name for an inode.
For example, to list files that have not been accessed in two weeks and
put the output in ne2scan format in $OUTFILE:
touch -d 'now - 2 weeks' /tmp/flag
lester -A fslist -a before=/tmp/flag -o $OUTFILE $BLOCKDEV
To do the same thing, but generate a full listing of the filesystem in
parallel:
touch -d 'now - 2 weeks' /tmp/flag
lester -A fslist -a before=/tmp/flag -a genhit=$UNACCESSED_LIST
\
-o $FULL_LIST $BLOCKDEV
To name inodes to stdout (when not using Lustre 2.4's LINKEA):
lester -A namei -a $INODE1 -a $INODE2 ... $BLOCKDEV
To get a list of files with objects on OSTs 999 and 1000:
lester -A lsost -a 999 -a 1000 -o $OUTFILE $BLOCKDEV
To get a list of options and actions, use 'lester -h'; to get a list of
options for a given action, use 'lester -A $ACTION -a help'.
Lester uses its own AIO-based IO engine by default, which is usually
much faster than the default Unix engine for large filesystems on
high-performance devices. The number of requests in flight, request
size, cache size, and read-ahead settings for various phases of the scan
are all configurable. I recommend experimenting with the settings to
find a balance between speed and resource usage for your situation.
More information about the gains we've seen in testing prototype version
of Lester are in my LUG 2011 presentation,
http://www.opensfs.org/wp-content/uploads/2012/12/500-530_David_Dillow_LU...
--
Dave Dillow
National Center for Computational Science
Oak Ridge National Laboratory
7 years, 4 months
The e2fsprogs git tree tagging is out of date
by Jay Lan
Hi,
Your web site showed the latest el6/RPMS/x86_64 e2fsprogs
version is 1.42.7-wc2-7.
However, the latest tag in the git repo seemed to me is v1.42.7.wc1.
Which commit is 1.42.7-wc2-7 tagged to ?
Thanks,
Jay
7 years, 4 months
Join us at LUG 2014!
by OpenSFS Administration
<http://www.opensfs.org/events/lug14/>
Registration Opens Next Week
Lustre User Group 2014 | Miami, FL | April 8-10
Registration for the <http://www.opensfs.org/lug14/> 12th annual LustreR
User Group (LUG) conference opens next week on February 18th. LUG attendees
will have the exclusive opportunity to hear directly from industry thought
leaders about the latest Lustre file system developments, case studies, best
practices, and more!
LUG 2014 will be held on April 8-10 at the
<http://www.marriott.com/hotels/travel/miabb-miami-marriott-biscayne-bay/>
Miami Marriott Biscayne Bay, located right on Biscayne Bay and just minutes
from South Beach and other famous Miami attractions.
The event will feature 25+ sessions offering insight into best practices in
deploying Lustre, case studies by Lustre users, experiences from members of
the business community who rely on Lustre, and more. The event will also
feature a number of key speakers from Lustre end-users, as well as a
networking reception for all attendees on April 8.
We are also happy to offer one complimentary event pass to each member
company of OpenSFS as a benefit of membership. The discount code will be
sent to the primary contact, but it may be transferred to another
representative at the same company.
Corporate Sponsorships Still Available!
Is your company interested in reaching more than 200+ focused Lustre
attendees? Then don't miss your chance to become a LUG 2014 Corporate
Sponsor! OpenSFS has a number of sponsorship opportunities available.
<http://www.opensfs.org/lug-2014-sponsorship/> Learn more about corporate
sponsorship opportunities for LUG 2014.
Be sure to check back regularly, as speakers and session highlights will be
posted over the coming weeks.
If you have any questions, please feel free to contact
<mailto:admin@opensfs.org> admin(a)opensfs.org.
Best regards,
OpenSFS LUG Planning Committee
_________________________
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97006 USA
Phone: +1 503-619-0561 | Fax: +1 503-644-6708
Twitter: <https://twitter.com/opensfs> @OpenSFS
Email: <mailto:admin@opensfs.org> admin(a)opensfs.org | Website:
<http://www.opensfs.org> www.opensfs.org
<http://www.opensfs.org/lug-2014-sponsorship/> Click here to learn how to
become a 2014 LUG Sponsor
Open Scalable File Systems, Inc. was founded in 2010 to advance Lustre
development, ensuring it remains vendor-neutral, open, and free. Since its
inception, OpenSFS has been responsible for advancing the Lustre file system
and delivering new releases on behalf of the open source community. Through
working groups, events, and ongoing funding initiatives, OpenSFS harnesses
the power of collaborative development to fuel innovation and growth of the
Lustre file system worldwide.
7 years, 4 months
Join us at LUG 2014!
by OpenSFS Administration
<http://www.opensfs.org/events/lug14/>
Registration Opens Next Week
Lustre User Group 2014 | Miami, FL | April 8-10
Registration for the <http://www.opensfs.org/lug14/> 12th annual LustreR
User Group (LUG) conference opens next week on February 18th. LUG attendees
will have the exclusive opportunity to hear directly from industry thought
leaders about the latest Lustre file system developments, case studies, best
practices, and more!
LUG 2014 will be held on April 8-10 at the
<http://www.marriott.com/hotels/travel/miabb-miami-marriott-biscayne-bay/>
Miami Marriott Biscayne Bay, located right on Biscayne Bay and just minutes
from South Beach and other famous Miami attractions.
The event will feature 25+ sessions offering insight into best practices in
deploying Lustre, case studies by Lustre users, experiences from members of
the business community who rely on Lustre, and more. The event will also
feature a number of key speakers from Lustre end-users, as well as a
networking reception for all attendees on April 8.
We are also happy to offer one complimentary event pass to each member
company of OpenSFS as a benefit of membership. The discount code will be
sent to the primary contact, but it may be transferred to another
representative at the same company.
Corporate Sponsorships Still Available!
Is your company interested in reaching more than 200+ focused Lustre
attendees? Then don't miss your chance to become a LUG 2014 Corporate
Sponsor! OpenSFS has a number of sponsorship opportunities available.
<http://www.opensfs.org/lug-2014-sponsorship/> Learn more about corporate
sponsorship opportunities for LUG 2014.
Be sure to check back regularly, as speakers and session highlights will be
posted over the coming weeks.
If you have any questions, please feel free to contact
<mailto:admin@opensfs.org> admin(a)opensfs.org.
Best regards,
OpenSFS LUG Planning Committee
_________________________
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97006 USA
Phone: +1 503-619-0561 | Fax: +1 503-644-6708
Twitter: <https://twitter.com/opensfs> @OpenSFS
Email: <mailto:admin@opensfs.org> admin(a)opensfs.org | Website:
<http://www.opensfs.org> www.opensfs.org
<http://www.opensfs.org/lug-2014-sponsorship/> Click here to learn how to
become a 2014 LUG Sponsor
Open Scalable File Systems, Inc. was founded in 2010 to advance Lustre
development, ensuring it remains vendor-neutral, open, and free. Since its
inception, OpenSFS has been responsible for advancing the Lustre file system
and delivering new releases on behalf of the open source community. Through
working groups, events, and ongoing funding initiatives, OpenSFS harnesses
the power of collaborative development to fuel innovation and growth of the
Lustre file system worldwide.
7 years, 4 months
Re: [HPDD-discuss] directories inaccessible after upgrade to, 2.4.2 (OI scrub missing)
by Chris Hunter
We saw similar behaviour after a MDT upgrade from 1.8.9 to 2.1.5, but
somewhat different error messages. We discovered we have to synchronize
user uids & group gids between our clients and MDT servers to honour
file ownership and access controls.
regards,
chris hunter
> All,
>
> we have got a test file system which had been created with Lustre 1.8
> (or even 1.6), then briefly updated to 2.3, 2.4.1 and now to 2.4.2. On
> this file system we now have a few directories that are inaccessible
> after the latest upgrade. I believe they were accessible when we were
> still running 2.4.1 but I'm not sure.
>
> All clients are currently running 1.8.9.
>
> Trying to ls one of the directories does generate an error on the
> command line, but nothing in any of the system logs that I could find.
>
> [bnh65367@p60-storage ~]$ ls -l /mnt/play01 |grep p60
> ls: cannot access /mnt/play01/p45: No such file or directory
> ls: cannot access /mnt/play01/p60: No such file or directory
> d?????????? ? ? ? ? ? p60
> [bnh65367@p60-storage ~]$ ls -l /mnt/play01/p60
> ls: cannot access /mnt/play01/p60: No such file or directory
> [bnh65367@p60-storage ~]$
>
> Trying to touch one of the missing directories results in this on the
> MDS and an input output error on the client command line.
>
> Feb 11 19:13:23 cs04r-sc-mds02-03 kernel: LustreError:
> 14367:0:(mdt_open.c:1694:mdt_reint_open()) play01-MDT0000: name p60
> present, but fid [0x45828f:0x7f3b41ef:0x0] invalid
>
> I'm currently trying to understand if this is something that is
> expected? Something we're likely to see if we upgrade directly from 1.8
> to 2.4.2 on our production file systems? And of course we need to fix
> it. To me it looks like LU-3934 could be related, though if I understand
> that bug correctly, it should be fixed? Maybe it'll fix itself (by
> automatically starting OI scrub?)?
>
> Is this sufficiently different from LU-3934 and unexpected that I should
> open a new ticket?
>
> The file system has been upgrade a few hours ago, lctl get_param
> 'osd-ldiskfs.\*.oi_scrub on the MDS reports the status init for both MDT
> and MGT (see below), does this mean it hasn't been started and I should
> start it? How would I start it?
7 years, 4 months
directories inaccessible after upgrade to 2.4.2 (OI scrub missing)
by Frederik Ferner
All,
we have got a test file system which had been created with Lustre 1.8
(or even 1.6), then briefly updated to 2.3, 2.4.1 and now to 2.4.2. On
this file system we now have a few directories that are inaccessible
after the latest upgrade. I believe they were accessible when we were
still running 2.4.1 but I'm not sure.
All clients are currently running 1.8.9.
Trying to ls one of the directories does generate an error on the
command line, but nothing in any of the system logs that I could find.
[bnh65367@p60-storage ~]$ ls -l /mnt/play01 |grep p60
ls: cannot access /mnt/play01/p45: No such file or directory
ls: cannot access /mnt/play01/p60: No such file or directory
d?????????? ? ? ? ? ? p60
[bnh65367@p60-storage ~]$ ls -l /mnt/play01/p60
ls: cannot access /mnt/play01/p60: No such file or directory
[bnh65367@p60-storage ~]$
Trying to touch one of the missing directories results in this on the
MDS and an input output error on the client command line.
Feb 11 19:13:23 cs04r-sc-mds02-03 kernel: LustreError:
14367:0:(mdt_open.c:1694:mdt_reint_open()) play01-MDT0000: name p60
present, but fid [0x45828f:0x7f3b41ef:0x0] invalid
I'm currently trying to understand if this is something that is
expected? Something we're likely to see if we upgrade directly from 1.8
to 2.4.2 on our production file systems? And of course we need to fix
it. To me it looks like LU-3934 could be related, though if I understand
that bug correctly, it should be fixed? Maybe it'll fix itself (by
automatically starting OI scrub?)?
Is this sufficiently different from LU-3934 and unexpected that I should
open a new ticket?
The file system has been upgrade a few hours ago, lctl get_param
'osd-ldiskfs.\*.oi_scrub on the MDS reports the status init for both MDT
and MGT (see below), does this mean it hasn't been started and I should
start it? How would I start it?
sudo lctl get_param 'osd-ldiskfs.\*.oi_scrub'
osd-ldiskfs.MGS.oi_scrub=
name: OI_scrub
magic: 0x4c5fd252
oi_files: 64
status: init
flags:
param:
time_since_last_completed: N/A
time_since_latest_start: N/A
time_since_last_checkpoint: N/A
latest_start_position: N/A
last_checkpoint_position: N/A
first_failure_position: N/A
checked: 0
updated: 0
failed: 0
prior_updated: 0
noscrub: 0
igif: 0
success_count: 0
run_time: 0 seconds
average_speed: 0 objects/sec
real-time_speed: N/A
current_position: N/A
osd-ldiskfs.play01-MDT0000.oi_scrub=
name: OI_scrub
magic: 0x4c5fd252
oi_files: 64
status: init
flags:
param:
time_since_last_completed: N/A
time_since_latest_start: N/A
time_since_last_checkpoint: N/A
latest_start_position: N/A
last_checkpoint_position: N/A
first_failure_position: N/A
checked: 0
updated: 0
failed: 0
prior_updated: 0
noscrub: 0
igif: 0
success_count: 0
run_time: 0 seconds
average_speed: 0 objects/sec
real-time_speed: N/A
current_position: N/A
[bnh65367@cs04r-sc-mds02-03 ~]$
I've also so far failed to find any good documentation on OI scrub, any
pointers will be welcome.
Kind regards,
Frederik
--
Frederik Ferner
Senior Computer Systems Administrator phone: +44 1235 77 8624
Diamond Light Source Ltd. mob: +44 7917 08 5110
(Apologies in advance for the lines below. Some bits are a legal
requirement and I have no control over them.)
--
This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom
7 years, 4 months
Lustre-2.4 VMs (EL6.4)
by San B
Hi,
The lustre service on MGS server throws following message.
# service lustre status
partial
This Lustre implementation is performed on VirtualBox VMs. Hence No
Infiniband connectivity. I tried to debug it further and found following
error messages:
The /var/log/messages :
Feb 4 18:02:11 ic2 kernel: LNet: HW CPU cores: 1, npartitions: 1
Feb 4 18:02:11 ic2 kernel: alg: No test for crc32 (crc32-table)
Feb 4 18:02:11 ic2 kernel: alg: No test for adler32 (adler32-zlib)
Feb 4 18:02:11 ic2 kernel: padlock: VIA PadLock Hash Engine not detected.
Feb 4 18:02:11 ic2 kernel: Lustre: Lustre: Build Version:
2.4.0-RC2-gd3f91c4-PRISTINE-2.6.32-358.6.2.el6_lustre.g230b174.x86_64
Feb 4 18:02:11 ic2 kernel: LNetError:
685:0:(socklnd.c:2822:ksocknal_startup()) Interface eth0 is down
Feb 4 18:02:11 ic2 kernel: LNetError: 105-4: Error -100 starting up LNI tcp
Feb 4 18:02:11 ic2 kernel: LustreError:
685:0:(events.c:806:ptlrpc_init_portals()) network initialisation failed
# cat /etc/modprobe.d/lustre.conf
options lnet networks="tcp0(eth0)"
# modprobe -v lnet
# modprobe -v lustre
insmod
/lib/modules/2.6.32-358.6.2.el6_lustre.g230b174.x86_64/updates/kernel/fs/lustre/mdc.ko
insmod
/lib/modules/2.6.32-358.6.2.el6_lustre.g230b174.x86_64/updates/kernel/fs/lustre/osc.ko
insmod
/lib/modules/2.6.32-358.6.2.el6_lustre.g230b174.x86_64/updates/kernel/fs/lustre/lov.ko
insmod
/lib/modules/2.6.32-358.6.2.el6_lustre.g230b174.x86_64/updates/kernel/fs/lustre/lustre.ko
# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup-lv_root
8.5G 2.9G 5.2G 36% /
tmpfs 246M 0 246M 0% /dev/shm
/dev/sda1 485M 57M 403M 13% /boot
/dev/sr0 3.5G 3.5G 0 100% /var/isoimages/rhel6.4
/dev/sdb 7.9G 344M 7.2G 5% /mgs
#
Can someone point out what could be the wrong here?
Thanks in advance
7 years, 4 months
