Running hive
by linux freaker
Hi,
I am curious to know if hive runs on lustre or not?
Thanks.
8 years, 7 months
China Lustre User Group (LUG), Full Agenda Available, Register by Oct 11th
by OpenSFS Administration
Proud Gold Sponsor:
intel-logo
The China Lustre User Group (LUG), hosted by OpenSFS and supported by
leading storage solution providers, will be held at the Lakeview Hotel
<http://www.thelakeviewhotel.com.cn/en/info.html> in Beijing on Tuesday,
October 15th. There's still time to register!
Covering a wide range of high-performance and data intensive application
topics, the China LUG is the ideal forum for learning about the breakthrough
features delivered with LustreR file system software, the fastest and most
scalable storage software. In particular, LUG events provide the opportunity
to meet with developers and leading edge end-users to hear how they're using
Lustre to solve important storage challenges.
Agenda and Registration
The full China LUG agenda is now available and includes a wide variety of
technical sessions including Lustre Roadmap and Features in Development,
Using Lustre at Tsinghua University, Running Hadoop in a High Performance
Environment, and much more: View full agenda
<http://www.opensfs.org/china-lug-2013/>
The China LUG is free but you must pre-register to attend. Registration
closes Friday, October 11th. Don't miss it, register now
<http://www.opensfs.org/china-lug-2013/> !
Open Scalable File Systems, Inc. is a strong and growing nonprofit
organization dedicated to the success of the Lustre file system. OpenSFS was
founded in 2010 to advance Lustre, ensuring it remains vendor-neutral, open,
and <http://lustre.opensfs.org/download-lustre/> free. Since its inception,
OpenSFS has been responsible for advancing Lustre and delivering
<http://lustre.opensfs.org/community-lustre-roadmap/> new releases on behalf
of the open source community. Through working groups, events, and ongoing
funding initiatives, <http://www.opensfs.org/> OpenSFS harnesses the power
of collaborative development to fuel innovation and growth of Lustre
worldwide.
_________________________
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97006 USA
Phone: +1 503-619-0561 | Fax: +1 503-644-6708
Twitter: @OpenSFS <https://twitter.com/opensfs>
Email: admin(a)opensfs.org | Website: www.opensfs.org
8 years, 7 months
Re: [HPDD-discuss] [Lustre-discuss] [Discuss] Registration Open - China LUG Conference
by Yong, Fan
Hi Karl,
Here is the Chinese version invitation letter. Thanks for helping to invite local customers.
--
Cheers,
Nasf
From: lustre-discuss-bounces(a)lists.lustre.org [mailto:lustre-discuss-bounces@lists.lustre.org] On Behalf Of Meng, Karl
Sent: Tuesday, October 08, 2013 9:39 AM
To: OpenSFS Administration; lustre-discuss(a)lists.lustre.org; discuss(a)lists.opensfs.org; hpdd-discuss(a)lists.01.org
Cc: Gong, Zhi; Fan, Cheng
Subject: Re: [Lustre-discuss] [Discuss] Registration Open - China LUG Conference
Hi.
Do you have a invitation letter in Chinese , so that we may invite local customers to join.
Thanks,
Karl Meng
Regional BDM Manager, PRC Geo
Infrastructure ,Enterprise and World Ahead Group
E-Mail: Karl.Meng(a)intel.com<mailto:Karl.Meng@intel.com>
Mobile: 86-13901243462
From: discuss-bounces(a)lists.opensfs.org<mailto:discuss-bounces@lists.opensfs.org> [mailto:discuss-bounces@lists.opensfs.org] On Behalf Of OpenSFS Administration
Sent: Tuesday, September 24, 2013 4:48 AM
To: lustre-discuss(a)lists.lustre.org<mailto:lustre-discuss@lists.lustre.org>; discuss(a)lists.opensfs.org<mailto:discuss@lists.opensfs.org>; hpdd-discuss(a)lists.01.org<mailto:hpdd-discuss@lists.01.org>
Subject: [Discuss] Registration Open - China LUG Conference
Proud Gold Sponsor:
[intel-logo]
APAC LUG 2013
Beijing, China
October 15, 2013
Mark your calendar for October 15th and make plans to spend the day with the leading developers and users of the Lustre file system. The China Lustre User Group (LUG) conference will be held at the Lakeview Hotel<http://www.thelakeviewhotel.com.cn/en/info.html>, located in the heart of Zhongguancun. Regarded as the "Silicon Valley of China" and close to leading universities and the Olympic Center, the Lakeview Hotel is close to an array of mass transit options, making it the ideal venue for LUG China 2013.
On behalf of the global Lustre community, OpenSFS has led the effort to define the future of Lustre, the premier file system for high-performance computing. Join OpenSFS and the worldwide Lustre community to learn how Lustre is being used to solve today's most demanding and important storage challenges.
Registration - Now Open
The LUG China event is free to attend but you must pre-register to attend. Don't miss the opportunity to hear the latest Lustre release updates, overview of the Lustre Test Infrastructure, details on the Exascale I/O and Fastforward product, and related vendor updates. Register now!<https://opensfs.wufoo.com/forms/z7x4m1/>
Technical Sessions - Call for abstracts is now open
LUG events are ideal opportunities to give a technical presentation about how you're using the Lustre file system. We encourage you to submit a brief abstract that describes the topic you'd like to present. Your presentation should be 30 minutes long and showcase what you've learned or how you're using Lustre. Presentation opportunities are limited, and nearly all of the technical sessions will be presented in Mandarin Chinese.
The agenda for this event is being finalized based on the abstracts received, but we invite you to take a look at the list of quality technical sessions from past LUG events<http://www.opensfs.org/past-events/> and consider submitting an abstract. Submit your abstract, topic title and your contact information to admin(a)opensfs.org<mailto:admin@opensfs.org>.
Panel Discussions
Panel discussions are the ideal forum for hearing from leading developers, vendors, and users of Lustre as they debate future requirements, explore upcoming enhancements, and share real world best practices. If you'd like to suggest a topic for a panel discussion - or be part of a panel, please contact admin(a)opensfs.org<mailto:panelist@opensfs.org>.
Sponsorship Opportunities
If your company or institution is interested in being a sponsor, OpenSFS has a number of sponsorship packages available. More details about sponsorship opportunities can be found on the APAC LUG event web page<http://www.opensfs.org/apac-lug-2013/>.
Together with leading institutions and vendors, these Lustre User Group events are the ideal opportunity for storage managers and IT directors to gather and share their expertise and experiences. We look forward to having you as our guest at the China Lustre User Group event.
Open Scalable File Systems, Inc. is a strong and growing nonprofit organization dedicated to the success of the Lustre file system. OpenSFS was founded in 2010 to advance Lustre, ensuring it remains vendor-neutral, open, and free<http://lustre.opensfs.org/download-lustre/>. Since its inception, OpenSFS has been responsible for advancing Lustre and delivering new releases<http://lustre.opensfs.org/community-lustre-roadmap/> on behalf of the open source community. Through working groups, events, and ongoing funding initiatives, OpenSFS<http://www.opensfs.org/> harnesses the power of collaborative development to fuel innovation and growth of Lustre worldwide.
_________________________
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97006 USA
Phone: +1 503-619-0561 | Fax: +1 503-644-6708
Twitter: @OpenSFS<https://twitter.com/opensfs>
Email: admin(a)opensfs.org<mailto:admin@opensfs.org> | Website: www.opensfs.org<http://www.opensfs.org>
8 years, 7 months
how to access the data in a given OST directly
by jyizheng
Hi,
If I have known a piece of data resides in a given OSS/OST. Is it possible to access it directly with using lustre client ?
To be specific, the problem is when I am on an OSS/OST, I want to access the local data of this OSS/OST without referring to lustre client.
Is it possible, how can I achieve that ?
Thanks in advance.
Yizheng
8 years, 7 months
Re: [HPDD-discuss] [PATCH 10/26] lustre: Convert ll_get_user_pages() to use get_user_pages_fast()
by Dilger, Andreas
On 2013/10/02 8:27 AM, "Jan Kara" <jack(a)suse.cz> wrote:
>CC: Greg Kroah-Hartman <greg(a)kroah.com>
>CC: Peng Tao <tao.peng(a)emc.com>
>CC: Andreas Dilger <andreas.dilger(a)intel.com>
>CC: hpdd-discuss(a)lists.01.org
>Signed-off-by: Jan Kara <jack(a)suse.cz>
Acked-by: Andreas Dilger <andreas.dilger(a)intel.com>
>---
> drivers/staging/lustre/lustre/llite/rw26.c | 7 ++-----
> 1 file changed, 2 insertions(+), 5 deletions(-)
>
>diff --git a/drivers/staging/lustre/lustre/llite/rw26.c
>b/drivers/staging/lustre/lustre/llite/rw26.c
>index 96c29ad2fc8c..7e3e0967993b 100644
>--- a/drivers/staging/lustre/lustre/llite/rw26.c
>+++ b/drivers/staging/lustre/lustre/llite/rw26.c
>@@ -202,11 +202,8 @@ static inline int ll_get_user_pages(int rw, unsigned
>long user_addr,
>
> OBD_ALLOC_LARGE(*pages, *max_pages * sizeof(**pages));
> if (*pages) {
>- down_read(¤t->mm->mmap_sem);
>- result = get_user_pages(current, current->mm, user_addr,
>- *max_pages, (rw == READ), 0, *pages,
>- NULL);
>- up_read(¤t->mm->mmap_sem);
>+ result = get_user_pages_fast(user_addr, *max_pages,
>+ (rw == READ), *pages);
> if (unlikely(result <= 0))
> OBD_FREE_LARGE(*pages, *max_pages * sizeof(**pages));
> }
Cheers, Andreas
--
Andreas Dilger
Lustre Software Architect
Intel High Performance Data Division
8 years, 7 months
Registration Open - Japan LUG Conference
by OpenSFS Administration
OpenSFS Lustre User Group (LUG), Tokyo Event
October 17, 2013, 10:00-17:00 Location: Midtown Conference
<http://www.tokyo-midtown.com/en/facilities/hall/conference.html>
Proud Event Sponsors:
Over the past few years, the annual Lustre® User Group (LUG) has been the
main event worldwide concerning Lustre, bringing together Lustre developers,
solution vendors, and Lustre users. OpenSFS has been organizing and
supporting Lustre User Group meetings in the US for the past few years. With
events in Japan and China, OpenSFS aims at better connecting Lustre users
and developers in APAC to the worldwide open source Lustre community.
The Japan workshop is aimed at existing and future Lustre users and will
provide a broad overview of the present state of the Lustre file system and
its application in high-performance computing, analytics, and cloud
environments. The event is free-of-charge.
To register for this event, either send an e-mail
<mailto:JLUG13@science-iris.org> including your name, address, affiliation
and position or register online <http://www.opensfs.org/apac-lug-2013/> .
Event outline:
· Conference Registration (9:30-10:00)
· Morning Session (10:00-12:30): Lustre Roadmap Status and
Update
· Afternoon Session (13:30-17:00): Lustre User Experiences and
Lustre Usability
Topics for the event will include the following
· Lustre roadmap update: Lustre 2.4 and beyond
· Lustre 2.4 performance valuation
· Case studies of large-scale Lustre deployments in Japan and
elsewhere
· Installation and management tools for Lustre
· Robinhood and Lustre HSM
· Lustre and clouds
· etc.
Speakers will include:
· Brent Gorda, General Manager, Intel High Performance Data
Division
· Shinji Sumimoto, Fujitsu
· Aurelien Degremont, Commissariat à l'énergie atomique et aux
énergies alternatives (CEA), France
· Dong Yang, Australian National University
· Peter Jones, Lustre Release Manager, Intel, HPDD
· etc.
Local organizing committee:
· Hitoshi Sato (TITECH)
· Naoyuki Fujita (JAXA)
· Shinji Sumimoto (Fujitsu)
· Tim Dyce (OIST)
· Shuichi Ihara (DDN)
About OpenSFS
Open Scalable File Systems, Inc. is a strong and growing nonprofit
organization dedicated to the success of the Lustre® file system. OpenSFS
was founded in 2010 to advance Lustre, ensuring it remains vendor-neutral,
open, and free. Since its inception, OpenSFS has been responsible for
advancing Lustre and delivering new releases on behalf of the open source
community. Through working groups, events, and ongoing funding initiatives,
OpenSFS harnesses the power of collaborative development to fuel innovation
and growth of Lustre worldwide.
For more information please visit: <http://www.opensfs.org>
http://www.opensfs.org
__________________________
OpenSFS Administration
3855 SW 153rd Drive Beaverton, OR 97006 USA
Phone: +1 503-619-0561 | Fax: +1 503-644-6708
Twitter: <https://twitter.com/opensfs> @OpenSFS
Email: <mailto:admin@opensfs.org> admin(a)opensfs.org | Website:
<http://www.opensfs.org> www.opensfs.org
8 years, 7 months
lfs_migrate failure
by Arman Khalatyan
Hello,
I wondered is lfs_migrate is only for striped files?
when I run on non striped one on lustre 2.4.1 I get following error:
lfs_migrate /lustre/arm2arm/tileimg_vis.png
lfs_migrate is currently NOT SAFE for moving in-use files.
Use it only when you are sure migrated files are unused.
If emptying OST(s) that are not disabled on the MDS, new
files may use them. To prevent MDS allocating any files on
OSTNNNN run 'lctl --device %{fsname}-OSTNNNN-osc deactivate'
on the MDS.
Continue? (y/n) y
/lustre/arm2arm/tileimg_vis.png: cannot swap layouts between
/lustre/arm2arm/tileimg_vis.png and a volatile file (Operation not
permitted)
error: migrate: migrate stripe file '/lustre/arm2arm/tileimg_vis.png' failed
Thanks,
Arman.
8 years, 7 months
