Re: An interesting anomaly in NFS client...

From: dark.initr0 <dark.initr0_at_yandex.ru>
Date: Fri, 08 Nov 2024 17:10:39 UTC
<div><div> </div><div>Hello!</div><div>Maybe some statistics will be usefull.</div><div> </div><div>I see only to 2 RPC calls to read directory</div><div>nfs and rpc.procedure == 16 and rpc.msgtyp == 0 (WireShark filter)</div><div>#16    2024-10-09 06:58:28.778343 --- READDIR Call (Reply In 18), FH: 0x83d2ee09</div><div>#109892    2024-10-09 06:58:42.613925 --- READDIR Call (Reply In 109894), FH: 0x17e3acee</div><div> </div><div>and 2 replies</div><div>nfs and rpc.procedure == 16 and rpc.msgtyp == 1</div><div> </div><div>#18    2024-10-09 06:58:28.778670 --- READDIR Reply (Call In 16)</div><div>. .. vtab_dirent.c vtab_proc.c vtab_tcp.c osdb_mod.h vtab_inode.c Makefile osdb.c vtab_file.c vtab_udp.h</div><div>vtab_common.h vtab_superblock.c osdb_value.h vtab_thread.h vtab_vnode.c vtab_dirent.h</div><div>vtab_tcp.h vtab_proc.h vtab_udp.c vtab_file.h osdb_mod.c vtab_inode.h osdb.h vtab_vnode.h vtab_superblock.h</div><div>vtab_common.c vtab_thread.c osdb_value.c osdb_ufs.h</div><div> </div><div>#109894    2024-10-09 06:58:42.614015 --- READDIR Reply (Call In 109892)</div><div>. .. beautify.c osdb_snapshot.c Makefile osdb_sample.c beautify.h osdb_query.c</div><div> </div><div>others procedures</div><div> </div><div>GETATTR (Get file attributes) calls and replies</div><div>nfs and rpc.procedure == 1</div><div>17292 packets</div><div> </div><div>SETATTR (Set file attributes) calls and replies</div><div>nfs and rpc.procedure == 2</div><div>80 packets</div><div> </div><div>LOOKUP (Lookup filename) calls and replies</div><div>nfs and rpc.procedure == 3</div><div>1122 packets</div><div> </div><div>ACCESS (Check Access Permission) calls and replies</div><div>nfs and rpc.procedure == 4</div><div>566 packets</div><div> </div><div>READLINK (Read from symbolic link) calls and replies</div><div>nfs and rpc.procedure == 5</div><div>2 packets</div><div> </div><div>READ (Read From file) calls and replies</div><div>nfs and rpc.procedure == 6</div><div>2052 packets</div><div> </div><div>WRITE (Write to file) calls and replies</div><div>nfs and rpc.procedure == 7</div><div>1038 packets</div><div> </div><div>CREATE (Create a file) calls and replies</div><div>nfs and rpc.procedure == 8</div><div>56 packets</div><div> </div><div>SYMLINK (Create a symbolic link) calls and replies</div><div>nfs and rpc.procedure == 10</div><div>2 packets</div><div> </div><div>REMOVE (Remove a File) calls and replies</div><div>nfs and rpc.procedure == 12</div><div>12 packets</div><div> </div><div>RENAME (Rename a File or Directory) calls and replies</div><div>nfs and rpc.procedure == 14</div><div>48 packets</div><div> </div><div>FSSTAT (Get dynamic file system information) calls and replies</div><div>nfs and rpc.procedure == 18</div><div>2 packets</div><div> </div><div>COMMIT (Commit cached data on a server to stable storage) calls and replies</div><div>nfs and rpc.procedure == 21</div><div>84 packets</div></div><div> </div><div>----------------<div>07.11.2024, 03:43, "George Neville-Neil" &lt;gnn@neville-neil.com&gt;:</div><div>Кому: FreeBSD Net (freebsd-net@freebsd.org);</div><div>Тема: An interesting anomaly in NFS client...;</div><div> </div><blockquote><div style="font-family:sans-serif"><div style="white-space:normal"><p>Howdy,</p><p>We've been digging into an interesting possible issue in the FreeBSD NFS client. Here is the scenario. I have a FreeBSD VM on my Mac, the Mac is the NFS server, the VM is the client. I then attempt to build an out of tree kernel module that I'm working on. The build looks like it's hanging for 1.5 seconds, and when we look at the packets (pcap file attached) we see a ton of GETATTRs over the first 1.5 seconds. I've put the pcap up here: <a href="https://people.freebsd.org/~gnn/oct_8_2024.pcapng" rel="noopener noreferrer" style="color:#3983c4">oct_8_2024.pcapng</a></p><p>I also note that an issue was raised on the forums that seems similar, way back between FreeBSD 10 and 11:</p><p><a href="https://forums.freebsd.org/threads/nfs-cache-misses-after-upgrading-to-11-1-from-10-3.65491/" rel="noopener noreferrer" style="color:#3983c4">https://forums.freebsd.org/threads/nfs-cache-misses-after-upgrading-to-11-1-from-10-3.65491/</a></p><p>I'm seeing this on 15 currentish (last few months).</p><p>Best,<br />George</p></div></div></blockquote><div> </div><div> </div><div> </div><div> </div></div><div>-- </div><div>best regards,</div><div>dark.initr0</div>