Home

ZFS on Linux

Posted by colby
  • Notes on creating zeventd for ZFS on Linux
  • Development host: hood
  • OS: openSUSE 11.3 kernel: 2.6.34.8-0.2-default
  • github forks: https://github.com/colbygk/zfs https://github.com/colbygk/spl
  • Build area: ~/zfs
  • Build packages/projects: zfs and spl
  • git urls: git@github.com:colbygk/zfs.git git@github.com:colbygk/spl.git

      May 16th, 2011

    1. Building SPL:
      Requires non-PREEMPT kernel, easiest to install kernel-default package, modify /boot/grub/menu.lst to boot this kernel by default 
      $ ./configure
$ make
$ sudo make install

      Building ZFS:

        $ ./configure --with-spl=/home/colby/zfs/spl-0.6.0-rc4
  $ make

      Fails on

      ...
/home/colby/zfs/zfs/module/zfs/../../module/zfs/spa.c:672:14: error: ‘TASKQ_NORECLAIM’ undeclared (first use in this function)
...

      TASKQ_NORECLAIM is defined in zfs/include/sys/zfs_context.h which is included in spa.c
      This is part of a kernel module build, so the output is not very verbose, to make verbose output:

      $ make V=1
...
make -f /usr/src/linux-2.6.34-12/scripts/Makefile.build obj=/home/colby/zfs/zfs/module/zfs
  gcc -Wp,-MD,/home/colby/zfs/zfs/module/zfs/../../module/zfs/.spa.o.d  -nostdinc -isystem /usr/lib64/gcc/x86_64-suse-linux/4.5/include -I/usr/src/linux-2.6.34-12/arch/x86/include -Iinclude  -I/usr/src/linux-2.6.34-12/include -include include/generated/autoconf.h   -I/home/colby/zfs/zfs/module/zfs -D__KERNEL__ -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -fno-strict-aliasing -fno-common -Werror-implicit-function-declaration -Wno-format-security -fno-delete-null-pointer-checks -O2 -m64 -mtune=generic -mno-red-zone -mcmodel=kernel -funit-at-a-time -maccumulate-outgoing-args -DCONFIG_AS_CFI=1 -DCONFIG_AS_CFI_SIGNAL_FRAME=1 -pipe -Wno-sign-compare -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -Wframe-larger-than=2048 -fno-stack-protector -fomit-frame-pointer -fasynchronous-unwind-tables -g -Wdeclaration-after-statement -Wno-pointer-sign -fno-strict-overflow -fno-dwarf2-cfi-asm -fconserve-stack -Wno-unused-but-set-variable -DHAVE_SPL -D_KERNEL -DTEXT_DOMAIN=\"zfs-linux-kernel\" -DNDEBUG -include /home/colby/zfs/spl-0.6.0-rc4/spl_config.h -include /home/colby/zfs/zfs/zfs_config.h   -I/home/colby/zfs/zfs/include   -I/home/colby/zfs/spl-0.6.0-rc4/include   -I/home/colby/zfs/spl-0.6.0-rc4  -DMODULE -D"KBUILD_STR(s)=#s" -D"KBUILD_BASENAME=KBUILD_STR(spa)"  -D"KBUILD_MODNAME=KBUILD_STR(zfs)" -D"DEBUG_HASH=32" -D"DEBUG_HASH2=7" -c -o /home/colby/zfs/zfs/module/zfs/../../module/zfs/.tmp_spa.o /home/colby/zfs/zfs/module/zfs/../../module/zfs/spa.c
...

      On same command-line, add -save-temps. Looks like __KERNEL__ is defined during this part of the build, hiding the rest of the file away when building spa.c
      Sending question to maintainer...

      May 17th, 2011

    1. Response from developer, needed to check out latest copy of spl to build against. Did so, and working build now.
    2. Default kernel installed after PREEMPT issue found above, sources not installed, need to install specific devel package:
      zypper in kernel-default-devel 2.6.34.8-0.2
    3. Install of libraries went to /usr/local/lib, need to add that to ld.so.conf so that other programs pick them up. Noticed that when running zpool, new process is opened that does the mount, loses LD_LIBRARY_PATH. 
      # zpool create test1 mirror /dev/sdi /dev/sdj
/sbin/mount.zfs: error while loading shared libraries: libspl.so.0: cannot open shared object file: No such file or directory
cannot mount 'test1': Input/output error

      # echo "/usr/local/lib" > /etc/ld.so.conf.d/locallib.conf && ldconfig
# zpool destroy -f test1
# zpool create test1 mirror /dev/sdi /dev/sdj
# zpool list
NAME    SIZE  ALLOC   FREE    CAP  DEDUP  HEALTH  ALTROOT
test1   696G    84K   696G     0%  1.00x  ONLINE  -
# zpool status
  pool: test1
 state: ONLINE
 scan: none requested
config:

	NAME        STATE     READ WRITE CKSUM
	test1       ONLINE       0     0     0
	  mirror-0  ONLINE       0     0     0
	    sdi     ONLINE       0     0     0
	    sdj     ONLINE       0     0     0

errors: No known data errors