MDS/MDT sizing question
by Chris Hunter
Hello,
I had an enquiry about appropriate number of MDS & MDT volumes for a
filesystem that could potentially hold 4bn files. I expect the typical
"working size" will be much less than 1bn files.
My understanding for ldiskfs MDT volume has a ratio of 1 inode per 4096
bytes. So ldiskfs MDT volume with 1bn inodes would need a 4TB MDT size.
Using DNE, we could have 4 MDS servers, each with a 4TB MDT volume to
achieve a filesystem with 4bn inodes.
FYI, 4TB volume is a reasonable size when using SSD physical drives (ie.
16TB is not). Any recommendations for reasonable mix of number of DNE
MDS + MDT volume size to achieve 4bn files?
regards,
chris hunter
chuntera(a)gmail.com
5 years, 1 month
OSS failure not working for separate MGS and MDT
by Gibbins, Faye
Hi,
We took three RHEL 7.2 boxen and deployed Lustre 2.8.0. When we have a joint MGS+MDT on the same block device we can failover our OST's between the OSSs.
However when we tried to having the MGS and MDT on separate block devices (still on the same server) failover hangs.
Can you offer any assistance or advice?
Yours
Faye Gibbins
Snr Systems Administrator, Unix Lead Architect (Software)
Cirrus Logic | cirrus.com<http://www.cirrus.com/> | +44 131 272 7398
[cid:image003.png@01CFC5F0.FE149B60]
This message and any attachments may contain privileged and confidential information that is intended solely for the person(s) to whom it is addressed. If you are not an intended recipient you must not: read; copy; distribute; discuss; take any action in or make any reliance upon the contents of this message; nor open or read any attachment. If you have received this message in error, please notify us as soon as possible on the following telephone number and destroy this message including any attachments. Thank you. Cirrus Logic International (UK) Ltd and Cirrus Logic International Semiconductor Ltd are companies registered in Scotland, with registered numbers SC089839 and SC495735 respectively. Our registered office is at Westfield House, 26 Westfield Road, Edinburgh, EH11 2QB, UK. Tel: +44 (0)131 272 7000. cirrus.com
5 years, 1 month
LUG 2016: Final Day to Register
by OpenSFS Administration
<http://opensfs.org/events/lug-2016/>
LUSTRE USER GROUP 2016
ONLINE REGISTRATION
ENDS TODAY
TUESDAY 3.29
<http://events.r20.constantcontact.com/register/event?oeidk=a07ec4atvk2ca30d
f75&llr=c9ldpiwab>
HILTON PORTLAND & EXECUTIVE TOWER
921 SW 6th AVENUE, PORTLAND, OR 97204
Open Scalable File Systems, Inc. was founded in 2010 to advance Lustre
development, ensuring it remains vendor-neutral, open, and free. Since its
inception, OpenSFS has been responsible for advancing the Lustre file system
and delivering new releases on behalf of the open source community. Through
working groups, events, and ongoing funding initiatives, OpenSFS harnesses
the power of collaborative development to fuel innovation and growth of the
Lustre file system worldwide.
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97003 USA | Phone: +1 503-619-0561 | Fax:
+1 503-644-6708
Twitter: <https://twitter.com/opensfs> @OpenSFS | Email:
<mailto:admin@opensfs.org> admin(a)opensfs.org | Website:
<http://www.opensfs.org> www.opensfs.org
5 years, 1 month
Last Week to Register for LUG 2016
by OpenSFS Administration
<http://opensfs.org/events/lug-2016/>
ONE WEEK LEFT TO REGISTER FOR LUG 2016
Registration Closes March 29th
Time is running out to register for the
<http://opensfs.org/events/lug-2016/> 14th annual LustreR User Group (LUG)
conference. Don't miss the opportunity to join the 140+ already registered
attendees from over 60 different companies and organizations including Cray,
DataDirect Networks, HPE, Intel, Oak Ridge National Laboratory, Seagate
Technology, Warp Mechanics, and more.
EVENT OVERVIEW
LUG 2016 will be held on April 5th - 7th at the
<http://www3.hilton.com/en/hotels/oregon/hilton-portland-and-executive-tower
-PDXPHHH/index.html> Hilton Portland and Executive Tower in Portland, Oregon
and will bring together industry leaders, customers, developers, and vendors
to talk Lustre, contribute to the community, and move the technology
forward.
The event will feature over 35 sessions, including:
* Building Lustre Solutions with NVM Devices Today
* Lustre Update from Seagate
* Tiering Storage (around Lustre) for Big Data and Supercomputing:
Cray's Portfolio of Offerings
* Intel(r) Solutions for Lustre* Software: Update
* A New Approach to Lustre - Join HPE for a Look at the Future of
Optimized Lustre Environments
<http://events.r20.constantcontact.com/register/event?oeidk=a07ec4atvk2ca30d
f75&llr=c9ldpiwab>
We encourage you to review the complete LUG 2016 agenda
<http://opensfs.org/lug-2016-agenda/> , which includes many networking
opportunities and a breadth of Lustre related topics.
If you are a Lustre Developer, there is still time to register for the
supplemental Lustre Developer Day
<http://opensfs.org/events/lustre-developer-day/> * on Monday, April 4th.
This one-day event provides Lustre developers and those interested in doing
Lustre development a chance to meet face-to-face.
For more information and to view the agenda, visit the
<http://opensfs.org/events/lustre-developer-day/> Developer Day website.
We look forward to seeing you at LUG! If you have any questions, please feel
free to contact <mailto:admin@opensfs.org> admin(a)opensfs.org.
Best regards,
OpenSFS LUG Planning Committee
\
*Separate registration required for Lustre Developer Day. Registration is
$125 and is limited to 50 attendees.
Open Scalable File Systems, Inc. was founded in 2010 to advance Lustre
development, ensuring it remains vendor-neutral, open, and free. Since its
inception, OpenSFS has been responsible for advancing the Lustre file system
and delivering new releases on behalf of the open source community. Through
working groups, events, and ongoing funding initiatives, OpenSFS harnesses
the power of collaborative development to fuel innovation and growth of the
Lustre file system worldwide.
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97003 USA | Phone: +1 503-619-0561 | Fax:
+1 503-644-6708
Twitter: <https://twitter.com/opensfs> @OpenSFS | Email:
<mailto:admin@opensfs.org> admin(a)opensfs.org | Website:
<http://www.opensfs.org> www.opensfs.org
5 years, 1 month
Migration from Community version to IEEL
by Kumar, Amit
Dear All,
We recently purchased a new storage with IEEL. Currently in the migration process of shrinking number of OST's to release and reuse pretty new OSS servers for new storage. We are currently at v2.4.3 and as pointed out previously to me, we are running into https://jira.hpdd.intel.com/browse/LU-5931 issue. I wanted to know how I can mark an OST full/ENOSPC so that it can help the migration process a bit. I do not anticipate to have a downtime for the file system any time before we try to bring the new storage online with the re-purposed OSS servers. Please advise.
Thank you,
Amit
5 years, 1 month
LUG 2016: Early Bird Discount Ends Today!
by OpenSFS Administration
<http://opensfs.org/events/lug-2016/>
LUSTRE USER GROUP 2016
EARLY BIRD REGISTRATION
ENDS TODAY
FRIDAY 3.11
<http://events.r20.constantcontact.com/register/event?oeidk=a07ec4atvk2ca30d
f75&llr=c9ldpiwab>
HILTON PORTLAND & EXECUTIVE TOWER
921 SW 6th AVENUE, PORTLAND, OR 97204
Open Scalable File Systems, Inc. was founded in 2010 to advance Lustre
development, ensuring it remains vendor-neutral, open, and free. Since its
inception, OpenSFS has been responsible for advancing the Lustre file system
and delivering new releases on behalf of the open source community. Through
working groups, events, and ongoing funding initiatives, OpenSFS harnesses
the power of collaborative development to fuel innovation and growth of the
Lustre file system worldwide.
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97003 USA | Phone: +1 503-619-0561 | Fax:
+1 503-644-6708
Twitter: <https://twitter.com/opensfs> @OpenSFS | Email:
<mailto:admin@opensfs.org> admin(a)opensfs.org | Website:
<http://www.opensfs.org> www.opensfs.org
5 years, 1 month
LUG 2016 Early Bird Discount Ends Friday
by OpenSFS Administration
LUSTRE USER GROUP
LUG 2016
CONFERENCE
LUSTRE MATTERS.
APRIL 5-7, 2016
REGISTRATION
DON'T MISS YOUR CHANCE TO SAVE!
Early bird registration for the 14 <http://opensfs.org/events/lug-2016/> th
annual LustreR User Group (LUG) conference ends this Friday, March 11th.
Act now to take advantage of the special early bird registration discount
for LUG 2016. Register this week to receive a $50 discount on registration.
After March 11th, the LUG registration rate will be $575.
<http://events.r20.constantcontact.com/register/event?oeidk=a07ec4atvk2ca30d
f75&llr=c9ldpiwab>
EVENT OVERVIEW
The 14 <http://opensfs.org/events/lug-2016/> th annual LustreR User Group
(LUG) conference is the industry's primary venue for discussion and seminars
on the Lustre parallel file system and other open source file system
technologies.
LUG 2016 will be held at the Hilton Portland and Executive Tower
<http://www3.hilton.com/en/hotels/oregon/hilton-portland-and-executive-tower
-PDXPHHH/index.html> in Portland, Oregon on April 5th - 7th. The event
will feature 35+ sessions over two and a half days from industry leading
companies, including:
* Cray, DDN Storage, Hewlett Packard Enterprise, Intel, Lawrence
Livermore National Laboratory, San Diego Supercomputer Center, Seagate, Warp
Mechanics, and More!
<http://opensfs.org/lug-2016-agenda/> >> View the Full LUG 2016 Agenda <<
BOOK NOW & SAVE
Special hotel rates at the
<http://www3.hilton.com/en/hotels/oregon/hilton-portland-and-executive-tower
-PDXPHHH/index.html> Hilton Portland and Executive Tower are available until
March 21st.
General Attendee Room Rate:
$189 USD for single occupancy
Government Room Rate:
$151 USD for single occupancy
LUSTRE DEVELOPER DAY
Developers looking for a focused opportunity to present their ideas, share
current work, and learn from others will want to attend our 2nd annual
Lustre Developer Day on April 4th.
<http://opensfs.org/events/lustre-developer-day/> Learn More!
TAKE ADVANTAGE OF MEMBER BENEFITS
OpenSFS is pleased to offer one complimentary event pass to each member
company of OpenSFS as a benefit of membership.
Email <mailto:admin@opensfs.com> admin(a)opensfs.org for more information
about using your company pass.
Open Scalable File Systems, Inc. was founded in 2010 to advance Lustre
development, ensuring it remains vendor-neutral, open, and free. Since its
inception, OpenSFS has been responsible for advancing the Lustre file system
and delivering new releases on behalf of the open source community. Through
working groups, events, and ongoing funding initiatives, OpenSFS harnesses
the power of collaborative development to fuel innovation and growth of the
Lustre file system worldwide.
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97003 USA | Phone: +1 503-619-0561 | Fax:
+1 503-644-6708
Twitter: <https://twitter.com/opensfs> @OpenSFS | Email:
<mailto:admin@opensfs.org> admin(a)opensfs.org | Website:
<http://www.opensfs.org> www.opensfs.org
5 years, 2 months
LUG 2016 Agenda Now Available
by OpenSFS Administration
<http://opensfs.org/events/lug-2016/>
REGISTER FOR LUG 2016 & LUSTRE DEVELOPER DAY
Full Agenda Now Available
The <http://opensfs.org/events/lug-2016/> 14th annual LustreR User Group
(LUG) conference is just a month away and we hope to see you there! As
always, LUG is structured to allow ample time for discussion and
collaboration, while maintaining a strong list of topics.
EVENT OVERVIEW
LUG 2016 will be held at the
<http://www3.hilton.com/en/hotels/oregon/hilton-portland-and-executive-tower
-PDXPHHH/index.html> Hilton Portland and Executive Tower in Portland, Oregon
on April 5th - 7th. The event will feature 35+ sessions over two and a half
days on topics including:
* Lustre 2.9 and Beyond
* Developing an Open Source Object Storage Copytool for HSM on
Lustre
* An Architecture for Docker on Lustre
* Evaluating Progressive File Layouts for Lustre
* Lustre Deployed Three Different Ways to Meet Researchers' Needs
* Lustre Data Mover: Because File Systems are Rooted Trees and rsync
Must Die
<http://opensfs.org/lug-2016-agenda/> >> View the Full LUG 2016 Agenda <<
LUSTRE DEVELOPER DAY
OpenSFS is excited to be hosting our 2nd annual Lustre Developer Day on
April 4th. This one-day event provides Lustre developers and those
interested in doing Lustre development a chance to meet face to face.
We hope you will join us for technical discussion sessions surrounding
Lustre software development and detailed Lustre architecture. For more
information and to view the agenda, visit the
<http://opensfs.org/events/lustre-developer-day/> Developer Day website.
Registration is available online. Since registration is limited to 50
attendees, you are encouraged to register early.
<http://events.constantcontact.com/register/event?llr=c9ldpiwab&oeidk=a07ec4
2zs3207cd25f2> Register today for the Lustre Developer Day!
EARLY BIRD REGISTRATION
Act now to take advantage of the special early bird registration discount
for LUG 2016. If you register by March 11th, you will receive a $50 discount
on registration. After March 11th, the LUG registration rate will be $575.
<http://events.r20.constantcontact.com/register/event?oeidk=a07ec4atvk2ca30d
f75&llr=c9ldpiwab>
If you have any questions, please feel free to contact
<mailto:admin@opensfs.org> admin(a)opensfs.org.
We look forward to seeing you in Portland at LUG 2016!
Best regards,
OpenSFS LUG Planning Committee
BOOK NOW & SAVE
Special hotel rates at the
<http://www3.hilton.com/en/hotels/oregon/hilton-portland-and-executive-tower
-PDXPHHH/index.html> Hilton Portland and Executive Tower are available until
March 21st.
General Attendee Room Rate:
$189 USD for single occupancy
Government Room Rate:
$151 USD for single occupancy
MEMBER BENEFTIS
AT LUG
OpenSFS is pleased to offer one complimentary event pass to each member
company of OpenSFS as a benefit of membership.
Email <mailto:admin@opensfs.com> admin(a)opensfs.org for more information
about using your company pass.
\
Open Scalable File Systems, Inc. was founded in 2010 to advance Lustre
development, ensuring it remains vendor-neutral, open, and free. Since its
inception, OpenSFS has been responsible for advancing the Lustre file system
and delivering new releases on behalf of the open source community. Through
working groups, events, and ongoing funding initiatives, OpenSFS harnesses
the power of collaborative development to fuel innovation and growth of the
Lustre file system worldwide.
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97003 USA | Phone: +1 503-619-0561 | Fax:
+1 503-644-6708
Twitter: <https://twitter.com/opensfs> @OpenSFS | Email:
<mailto:admin@opensfs.org> admin(a)opensfs.org | Website:
<http://www.opensfs.org> www.opensfs.org
5 years, 2 months
