poudriere zfs setup help

[Anton Shterenlikht]

>From bsam at passap.ru Thu Oct 10 13:48:06 2013
>10.10.2013 13:16, Anton Shterenlikht пишет:
>> 
>> I'm getting this error:
>> 
>> # poudriere bulk -j ia64 -f /usr/local/etc/poudriere.d/pkglist
>> ====>> Creating the reference jail... done
>> ====>> Mounting system devices for ia64-default
>> ====>> Mounting ports/packages/distfiles
>> ====>> Mounting packages from: /pdr/data/packages/ia64-default
>> ====>> Logs: /pdr/data/logs/bulk/ia64-default/2013-10-10_09h53m58s
>> /etc/resolv.conf -> /pdr/data/build/ia64-default/ref/etc/resolv.conf
>> ====>> Starting jail ia64-default
>> ====>> Calculating ports order and dependencies
>> ====>> pkg package missing, skipping sanity
>> ====>> Cleaning the build queue
>> ====>> Recording filesystem state for prepkg... done
>> ====>> Building 3 packages using 2 builders
>> ====>> Starting/Cloning builders
>> ====>> Hit CTRL+t at any time to see build progress and stats
>> ====>> [01] Starting build of ports-mgmt/pkg
>> ====>> [01] Finished build of ports-mgmt/pkg: Failed: extract
>>                                               ^^^^^^^^^^^^^^^
>> 
>> ====>> [01] Skipping build of www/nginx: Dependent port ports-mgmt/pkg failed
>> ====>> [01] Skipping build of devel/pcre: Dependent port ports-mgmt/pkg failed
>> ====>> Stopping 2 builders
>> ====>> No package built, but repository needs to be created
>> ====>> Creating pkgng repository
>> ====>> Cleaning up
>> ====>> Umounting file systems
>> #
>> 
>> # cat /pdr/data/logs/bulk/ia64-default/latest/logs/pkg-1.1.4_7.log
>> *skip*
>> => SHA256 Checksum OK for pkg-1.1.4.tar.xz.
>> mkdir: /usr/ports/ports-mgmt/pkg/work: Read-only file system
>> *** Error code 1
>> 
>> So something is wrong with my setup?
>> Does this look all right:
>> 
>> # poudriere jails -l
>> JAILNAME             VERSION              ARCH    METHOD  PATH
>> ia64                 10.0-ALPHA5 r256218  ia64    svn+https /pdr/jails/ia64
>> # poudriere ports -l
>> PORTSTREE            METHOD     PATH
>> default              svn+https  /pdr/ports/default
>> # df
>> Filesystem                   1K-blocks     Used    Avail Capacity  Mounted on
>> /dev/da0p2                    60931274 49946430  6110344    89%    /
>> devfs                                1        1        0   100%    /dev
>> /dev/da0p1                      409504     1184   408320     0%    /efi
>> tank/poudriere/data           31736572     1290 31735281     0%    /pdr/data
>> tank/poudriere/jails/ia64     33931466  2196185 31735281     6%    /pdr/jails/ia64
>> tank/poudriere/ports/default  32633749   898468 31735281     3%    /pdr/ports/default
>> tank                          31735313       32 31735281     0%    /tank
>> tank/poudriere                31735314       33 31735281     0%    /tank/poudriere
>> tank/poudriere/jails          31735312       31 31735281     0%    /tank/poudriere/jails
>> tank/poudriere/ports          31735312       31 31735281     0%    /tank/poudriere/ports
>> # 
>> 
>> # grep "^[A-Z]" /usr/local/etc/poudriere.conf
>> ZPOOL=tank
>> FREEBSD_HOST=https://svn0.eu.freebsd.org
>> RESOLV_CONF=/etc/resolv.conf
>> BASEFS=/pdr
>> USE_PORTLINT=yes
>> USE_TMPFS=yes
>> DISTFILES_CACHE=/usr/ports/distfiles
>> SVN_HOST=svn0.eu.FreeBSD.org
>> CHECK_CHANGED_OPTIONS=verbose
>> CHECK_CHANGED_DEPS=yes
>> PKG_REPO_SIGNING_KEY=/root/pkg.key
>> CCACHE_DIR=/var/cache/ccache
>> SAVE_WRKDIR=yes
>> # 
>> 
>> What am I missing?
>> 
>> On another box I set up poudriere with no zfs
>> and it works all right. So I think I messed up
>> the zfs setup.
>
>You may try to use "poudriere testport -i ...". Then poudriere will
>not umount jail (it will be umounted when you exit the jail command
>propmt) and you may explore the system (i.e. mount, jls, etc.) to
>find out what's going on.

ok, so after a failure, still in a jail:

root at ia64-default:~ # df
Filesystem                            1K-blocks    Used    Avail Capacity  Mounted on
tank/poudriere/jails/ia64-default-ref  33930819 2198542 31732277     6%    /
root at ia64-default:~ # ls -al /usr/ports/ports-mgmt/pkg
total 15
drwxr-xr-x   3 root  wheel     8 Oct  9 13:23 .
drwxr-xr-x  85 root  wheel    86 Oct  9 13:23 ..
-rw-r--r--   1 root  wheel  2544 Oct  9 13:23 Makefile
-rw-r--r--   1 root  wheel   127 Oct  9 13:23 distinfo
drwxr-xr-x   2 root  wheel    13 Oct  9 13:23 files
-rw-r--r--   1 root  wheel    87 Oct  9 13:23 pkg-descr
-rw-r--r--   1 root  wheel    73 Oct  9 13:23 pkg-message
-rw-r--r--   1 root  wheel  1420 Oct  9 13:23 pkg-plist
root at ia64-default:~ # whoami
root
root at ia64-default:~ # mkdir /usr/ports/ports-mgmt/pkg/work
mkdir: /usr/ports/ports-mgmt/pkg/work: Read-only file system
root at ia64-default:~ # 

On ufs this would mean something is seriously wrong.
But on zfs, I'm not so sure.
Perhaps I'm not understanding it right.

Thanks

Anton