problems with ports-mgmt/poudriere-devel and NFS

[Joseph Mingrone]

I manage a cluster with a master node and lots of compute nodes.  Third
party software is installed in the default location, /usr/local, on the
master node and the compute nodes NFS mount master:/usr/local.  One
compute node (aw20) has 48 cores and 256 GiB or ram, so I've been
building packages with poudriere there.

Below are the contents of poudriere.conf.

ZPOOL=tank                          
ZROOTFS=/poudriere                  
FREEBSD_HOST=ftp://ftp.freebsd.org  
RESOLV_CONF=/etc/resolv.conf        
BASEFS=/poudriere/basefs            
USE_PORTLINT=no                     
USE_TMPFS=yes                       
DISTFILES_CACHE=/poudriere/distfiles

I also set the environment variable POUDRIERE_ETC to /poudriere/etc.

Only the master node has a routable IP, so I NFS mount aw20:/poudriere
to /poudriere on the master node to host the web content and the
repositories.  The problem is that master:/poudriere doesn't match
aw20:/poudriere.  I've verified that the appropriate sharenfs properties
are set on aw20.

aw20 # zfs get -r sharenfs,mountpoint tank/poudriere 
NAME                               PROPERTY    VALUE                                                SOURCE
tank/poudriere                     sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  local
tank/poudriere                     mountpoint  /poudriere                                           local
tank/poudriere/basefs              sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/basefs              mountpoint  /poudriere/basefs                                    inherited from tank/poudriere
tank/poudriere/data                sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/data                mountpoint  /poudriere/basefs/data                               local
tank/poudriere/data/.m             sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/data/.m             mountpoint  /poudriere/basefs/data/.m                            inherited from tank/poudriere/data
tank/poudriere/data/cache          sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/data/cache          mountpoint  /poudriere/basefs/data/cache                         inherited from tank/poudriere/data
tank/poudriere/data/logs           sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/data/logs           mountpoint  /poudriere/basefs/data/logs                          inherited from tank/poudriere/data
tank/poudriere/data/packages       sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/data/packages       mountpoint  /poudriere/basefs/data/packages                      inherited from tank/poudriere/data
tank/poudriere/data/wrkdirs        sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/data/wrkdirs        mountpoint  /poudriere/basefs/data/wrkdirs                       inherited from tank/poudriere/data
tank/poudriere/etc                 sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/etc                 mountpoint  /poudriere/etc                                       inherited from tank/poudriere
tank/poudriere/jails               sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/jails               mountpoint  /poudriere/jails                                     inherited from tank/poudriere
tank/poudriere/jails/9amd64        sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/jails/9amd64        mountpoint  /poudriere/basefs/jails/9amd64                       local
tank/poudriere/jails/9amd64 at clean  sharenfs    -                                                    -
tank/poudriere/jails/9amd64 at clean  mountpoint  -                                                    -
tank/poudriere/jails/9i386         sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/jails/9i386         mountpoint  /poudriere/basefs/jails/9i386                        local
tank/poudriere/jails/9i386 at clean   sharenfs    -                                                    -
tank/poudriere/jails/9i386 at clean   mountpoint  -                                                    -
tank/poudriere/ports               sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/ports               mountpoint  /poudriere/ports                                     inherited from tank/poudriere
tank/poudriere/ports/default       sharenfs    maproot=root,network 192.168.0.0,mask 255.255.255.0  inherited from tank/poudriere
tank/poudriere/ports/default       mountpoint  /poudriere/basefs/ports/default                      local

master # mount | grep poudriere 
aw20:/poudriere on /poudriere (nfs, asynchronous)

When I look in, for example, master:/poudriere/basefs/ it's empty, but
on aw20 it contains the repositories.

What am I missing?

Joseph