My list of missing dependencies is much larger for some reason:

 

error: Failed dependencies:

        zfs-kmod is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(__cv_broadcast) = 0x473952f6 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(arc_add_prune_callback) = 0x6fa427c8 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(arc_remove_prune_callback) = 0xd014a73b is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_assign_arcbuf) = 0xd4ce9943 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_buf_hold_array_by_bonus) = 0x330ef227 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_buf_rele) = 0x53e356d2 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_buf_rele_array) = 0x46d80b8c is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_free_long_range) = 0x389be439 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_free_range) = 0x90b66067 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_object_alloc) = 0x00b6fb3f is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_object_free) = 0x37337442 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_object_info_from_db) = 0x653f6c5a is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_object_next) = 0xe7e4b400 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_object_set_blocksize) = 0xdd72dc88 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_object_size_from_db) = 0x57b75eb4 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_objset_disown) = 0x27d01e19 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_objset_ds) = 0x25c947bd is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_objset_own) = 0x72859ff6 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_objset_pool) = 0xa8cb0bd0 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_objset_spa) = 0xd0d4ba5d is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_objset_space) = 0x0a5a5f8f is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_objset_userused_enabled) = 0x7f63a396 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_prefetch) = 0x7947c677 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_read) = 0x4f521623 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_request_arcbuf) = 0x12428829 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_return_arcbuf) = 0xbb5c175c is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_abort) = 0xa6835da4 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_assign) = 0xa7d102cc is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_callback_register) = 0xc10ae9f5 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_commit) = 0x9a88ba1e is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_create) = 0x5766b01d is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_get_txg) = 0xc2e7eba9 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_hold_bonus) = 0x15ec1afe is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_hold_free) = 0x513d69e5 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_hold_sa) = 0xe2257879 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_hold_sa_create) = 0x867b9689 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_hold_spill) = 0x6a0cfcb3 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_hold_write) = 0x08d8c736 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_tx_hold_zap) = 0xf617c183 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dmu_write) = 0xf6270318 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dsl_pool_config_enter) = 0x904c054e is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dsl_pool_config_exit) = 0xe8b19073 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dsl_prop_register) = 0xa6f021e0 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(dsl_prop_unregister) = 0x8611702e is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvlist_add_byte_array) = 0x4ea06afa is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvlist_alloc) = 0x75a78768 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvlist_free) = 0x9d9f80c4 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvlist_lookup_byte_array) = 0xcb59902f is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvlist_next_nvpair) = 0x29c88b11 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvlist_pack) = 0x424ac2e1 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvlist_remove) = 0xcf24ceff is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvlist_size) = 0x730e1886 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvlist_unpack) = 0x1cd81596 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(nvpair_name) = 0xd42a96fa is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_buf_hold) = 0x13e5ec7c is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_buf_rele) = 0xfb208743 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_bulk_lookup) = 0x29be42be is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_bulk_update) = 0x65ff4436 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_handle_destroy) = 0x20393eae is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_handle_get) = 0x9b0b81fd is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_lookup) = 0x4349aa0a is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_object_size) = 0xa7dee94a is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_replace_all_by_template) = 0x3e2fdfbc is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_setup) = 0x48da4662 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_size) = 0xef3e6514 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_spill_rele) = 0x3ae1b688 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(sa_update) = 0xa341f532 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(spa_freeze) = 0x58c6b5b2 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(spa_get_dsl) = 0x6077e511 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(spa_maxblocksize) = 0x588473de is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(spa_writeable) = 0x7ee456c6 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(spl_panic) = 0xbc32eee7 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(txg_wait_callbacks) = 0x90f50ab1 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(txg_wait_synced) = 0x769ff6de is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_add) = 0xefd09112 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_add_int) = 0xf266dd2c is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_add_uint64) = 0x8589c04d is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_create_flags) = 0xf357660a is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_cursor_advance) = 0x6bb73541 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_cursor_fini) = 0xa5814140 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_cursor_init) = 0x730b862a is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_cursor_init_serialized) = 0x662953e3 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_cursor_retrieve) = 0xd87504b1 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_cursor_serialize) = 0x3f455060 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_increment_int) = 0xa1b5abd7 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_lookup) = 0xeec0741f is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_lookup_uint64) = 0x5e3ba879 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_remove) = 0x3481f17f is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_remove_int) = 0xb0b9e33a is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_remove_uint64) = 0xe69d082e is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zap_update) = 0xf2bde2fb is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zfs_attr_table) = 0x7ae721f2 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zfs_prop_to_name) = 0xa483a8c3 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zio_buf_alloc) = 0x0c211976 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zio_buf_free) = 0x6e7a7166 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zrl_add) = 0xeac8a9a9 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

        ksym(zrl_remove) = 0x05836522 is needed by kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64

 

From: Marcin Dulak [mailto:marcin.dulak@gmail.com]
Sent: Monday, December 26, 2016 3:20 PM
To: Jeff Slapp <Jeff.Slapp@DataCore.com>
Cc: Mohr Jr, Richard Frank (Rick Mohr) <rmohr@utk.edu>; hpdd-discuss@lists.01.org
Subject: Re: [HPDD-discuss] Error when attempting to mount ZFS with Lustre

 

I'm having the same KSYM problem, CentOS 7.3, zfs-kmod repo enabled as described at https://github.com/zfsonlinux/zfs/wiki/RHEL-%26-CentOS
The missing dependencies from `yum -y install kmod-lustre-osd-zfs* lustre` look like:
...
Error: Package: kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64 (lustre-server)
           Requires: ksym(spa_get_dsl) = 0x6077e511
           Installed: kmod-zfs-0.6.5.8-1.el7_3.centos.x86_64 (@zfs-kmod)
               ksym(spa_get_dsl) = 0x62bac5c1
...

The 0.6.5.7 version of zfs-related RPMS from http://yum.tamu.edu/zfsonlinux/epel/7/kmod/x86_64/ seems to match kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64,

but apparently not fully kernel-3.10.0-514.el7_lustre, with the end result of: FATAL: Module zfs not found

Marcin

 

 

 

On Mon, Dec 26, 2016 at 3:31 PM, Jeff Slapp <Jeff.Slapp@datacore.com> wrote:

I just rebuilt the Lustre RPMs from source using rpmbuild. Interestingly, all RPMs were created except the one I need: kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64.rpm.

-----Original Message-----
From: Jeff Slapp
Sent: Sunday, December 25, 2016 3:46 PM
To: 'Mohr Jr, Richard Frank (Rick Mohr)' <rmohr@utk.edu>

Cc: 'hpdd-discuss@lists.01.org' <hpdd-discuss@lists.01.org>
Subject: RE: [HPDD-discuss] Error when attempting to mount ZFS with Lustre

I suppose I would need someone from Intel to tell me if ZFS 0.6.5.8-1 is compatible with Lustre 2.9.0-1.

I was able to build ZFS from source (SPL and ZFS modules) under the Lustre kernel and everything went perfect right up to this step:

rpm -ivh kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64.rpm. Same KSYM errors.

Please advise whether I should use a previous version of Lustre (i.e. 2.8).


-----Original Message-----
From: Jeff Slapp
Sent: Friday, December 23, 2016 12:18 PM
To: 'Mohr Jr, Richard Frank (Rick Mohr)' <rmohr@utk.edu>
Cc: hpdd-discuss@lists.01.org
Subject: RE: [HPDD-discuss] Error when attempting to mount ZFS with Lustre

The pre-built Lustre RPMs were obtained here: https://downloads.hpdd.intel.com/public/lustre/latest-release/el7.3.1611/server/RPMS/x86_64/

I will investigate your suggestion. Thank you.

-----Original Message-----
From: Mohr Jr, Richard Frank (Rick Mohr) [mailto:rmohr@utk.edu]
Sent: Friday, December 23, 2016 11:30 AM
To: Jeff Slapp <Jeff.Slapp@DataCore.com>
Cc: hpdd-discuss@lists.01.org
Subject: Re: [HPDD-discuss] Error when attempting to mount ZFS with Lustre


> On Dec 23, 2016, at 9:28 AM, Jeff Slapp <Jeff.Slapp@DataCore.com> wrote:
>
> ERROR 2 (in /var/log/messages):
>
> Dec 23 09:18:58 mds01 kernel: LustreError: 158-c: Can't load module 'osd-zfs'
>
> Dec 23 09:18:58 mds01 kernel: LustreError:
> 56472:0:(genops.c:314:class_newdev()) OBD: unknown type: osd-zfs
>
<snip>
>
> MODULES INSTALLED:
>
<snip>
> kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64
>
> zfs-release-1-3.el7.centos.noarch
>
> zfs-0.6.5.8-1.el7.centos.x86_64
>
> libzfs2-0.6.5.8-1.el7.centos.x86_64
>
> libzfs2-devel-0.6.5.8-1.el7.centos.x86_64
>
> zfs-dkms-0.6.5.8-1.el7.centos.noarch
>
>
> NOTE: In  order to get the ‘kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64’ module installed, I had to use ‘rpm -ihv kmod-lustre-osd-zfs-2.9.0-1.el7.x86_64 –nodeps’. Without –nodeps, Idependency warnings about missing nearly two pages references to KSYM.

Are you using the pre-built Lustre RPMs from OpenSFS?  If so, see if the version of ZFS you have installed matches what the RPMs were built against.

--
Rick Mohr
Senior HPC System Administrator
National Institute for Computational Sciences http://www.nics.tennessee.edu

_______________________________________________
HPDD-discuss mailing list
HPDD-discuss@lists.01.org
https://lists.01.org/mailman/listinfo/hpdd-discuss