FedoraForum.org - Fedora Support Forums and Community
Results 1 to 2 of 2
  1. #1
    Join Date
    Dec 2012
    Location
    santa barbara, CA
    Posts
    883
    Linux (Fedora) Firefox 60.0

    my file server nfsstat , anything obviously off here ?

    Hello guys,

    OK, so I got my 2 partitions serving some hefty traffic. One partition is 11x RAID1's into a RAID10 (hardware), the other partition is 7x RAID1's into a RAID10 (also hardware). One client server writes, 3 client servers read. Read:write is about 10000:1 I guess (but maybe not initially). 64k html files, plus 2k-10m jpegs (most about 300k I guess).

    here is some current usage nfsstat for about 20 mins of activity. Anything here you can see that is obviously off kilter ?

    Code:
    [root@rat ~]# nfsstat -4 -s -S ZERO_NFS_DATA_HERE.dat
    Server rpc stats:
    calls      badcalls   badfmt     badauth    badclnt
    9109986    0          0          0          0       
    
    Server nfs v4:
    null             compound         
    0         0%     8891208 100%     
    
    Server nfs v4 operations:
    op0-unused       op1-unused       op2-future       access           close            
    0         0%     0         0%     0         0%     1633007   4%     1237197   3%     
    commit           create           delegpurge       delegreturn      getattr          
    175       0%     866       0%     0         0%     1203446   3%     6602769  19%     
    getfh            link             lock             lockt            locku            
    1678130   4%     0         0%     0         0%     0         0%     0         0%     
    lookup           lookup_root      nverify          open             openattr         
    1780027   5%     0         0%     0         0%     1237006   3%     0         0%     
    open_conf        open_dgrd        putfh            putpubfh         putrootfh        
    0         0%     16        0%     8889582  26%     0         0%     0         0%     
    read             readdir          readlink         remove           rename           
    940338    2%     26064     0%     0         0%     4         0%     0         0%     
    renew            restorefh        savefh           secinfo          setattr          
    0         0%     0         0%     0         0%     0         0%     9749      0%     
    setcltid         setcltidconf     verify           write            rellockowner     
    0         0%     0         0%     0         0%     29553     0%     0         0%     
    bc_ctl           bind_conn        exchange_id      create_ses       destroy_ses      
    0         0%     0         0%     0         0%     0         0%     0         0%     
    free_stateid     getdirdeleg      getdevinfo       getdevlist       layoutcommit     
    0         0%     0         0%     0         0%     0         0%     0         0%     
    layoutget        layoutreturn     secinfononam     sequence         set_ssv          
    0         0%     0         0%     0         0%     8894592  26%     0         0%     
    test_stateid     want_deleg       destroy_clid     reclaim_comp     allocate         
    0         0%     0         0%     0         0%     0         0%     0         0%     
    copy             copy_notify      deallocate       ioadvise         layouterror      
    0         0%     0         0%     0         0%     0         0%     0         0%     
    layoutstats      offloadcancel    offloadstatus    readplus         seek             
    0         0%     0         0%     0         0%     0         0%     0         0%     
    write_same       
    0         0%
    "monsters John ... monsters from the ID..."
    "ma vule teva maar gul nol naya"

  2. #2
    Join Date
    Dec 2012
    Location
    santa barbara, CA
    Posts
    883
    Linux (Fedora) Firefox 60.0

    Re: my file server nfsstat , anything obviously off here ?

    UPDATE:

    EXTREMELY ODD STUFF ! (sorry for the shouting, but I am excited when I see such obvious differences).

    I had temporarily set up a ramdisk by using "tmpfs", like this:

    Code:
    mkdir /ramdisk
    mount -t tmpfs -o size=32768m ramdisk /ramdisk
    mkdir -p /ramdisk/mydomain/thumbnail_pix
    chmod -R 777 /ramdisk
    exportfs -a
    Since I have 128GB ram , I decided to allocate 32GB for a nice thumbnail cache for the webservers. This was just using tmpfs, not the actual /dev/ram...
    Then in the /etc/exports I had the necessary fsid=1 in the options.

    Sooooo.... I let that run for like 6 hours, and it filled up to like 80%, but the most interesting situation was that doing
    nfsstat -s -S since_that_mounted_nfsdata.dat

    yielded 55% lookup !!!!!!!!!

    So, after my large unmount, destroy, kill the RAID0 NVME, remount, and now running the same cache on /NVME0 which is an ext4,

    after 4 hours so far, 2.1 million files,
    lookup 7440898 2%
    access 17902190 5%
    sequence 90658025 25%
    getattr 76943619 22%
    putfh 90639487 25%

    Looks a lot more standard now.
    But the difference in "lookup" , when exported as "tmpfs" is 55% , and then ext4 , 2%. !!! I wonder ....
    "monsters John ... monsters from the ID..."
    "ma vule teva maar gul nol naya"

Similar Threads

  1. VLC will not play video file from file server
    By JonathanA in forum Using Fedora
    Replies: 0
    Last Post: 21st January 2009, 08:50 PM
  2. Fedora Core 8 as File Sharing server and Printing server
    By lucazz in forum Servers & Networking
    Replies: 8
    Last Post: 14th June 2008, 08:28 PM
  3. Replies: 4
    Last Post: 11th December 2007, 04:42 PM
  4. Setting up a SOHO file/printer server & file permissions
    By byw in forum Servers & Networking
    Replies: 3
    Last Post: 23rd August 2004, 06:53 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •