Traffic Totals DB corruption



  • I've had this happen to me twice now. The database file that stores the Traffic Totals data becomes corrupted and all the of the data disappears. Also, the stats stop collecting all together you have to "Reset Graphing" to get it going again.

    UI displays this error message:

    
    Error: {"vnstatversion":"1.15","jsonversion":"1","interfaces":[Error: Database load failed even when using backup (No such file or directory). Aborting.
    [code]
    
    To my knowledge the traffic totals using vnstat. When I did a search for the database files they were all zero size:
    [code]
    drwxr-xr-x   2 root  wheel   512 Apr 29 20:38 .
    drwxr-xr-x  18 root  wheel  1024 Jul 17 08:18 ..
    -rw-r--r--   1 root  wheel     0 Jun 25 14:20 .cpsw1
    -rw-r--r--   1 root  wheel     0 Jun 25 14:20 .ovpns2
    -rw-r--r--   1 root  wheel     0 Jun 25 14:20 .pppoe0
    -rw-r--r--   1 root  wheel     0 Jun 25 14:20 cpsw1
    -rw-r--r--   1 root  wheel     0 Jun 25 14:20 ovpns2
    -rw-r--r--   1 root  wheel     0 Jun 25 14:20 pppoe0
    [/code]
    Calling vnstat from shell gives:
    [code]
    Error: Database load failed even when using backup (No such file or directory). Aborting.
    [/code]
    
    My current suspicion is that it is corrupted when I have to hard reset pfsense for another unrelated issue. But I cannot verify if a reset occurred on 25 June.
    
    Was wondering if anyone has had something similar so and any info that I could trace the problem better.
    
    Cheers
    


  • Are you using ZFS file system? What's your hardware?



  • Ah yes sorry I forgot to include that:
    Hardware: SG-1000
    Filesystem: UFS (SG-1000 does not support ZFS :( )
    Version: almost always latest 2.4 build



  • Try to make a backup and reinstall from zero. Then restore the backup. Maybe an update corrupted your install.



  • Traffic Totals is working for you?  It's been borked for me since updating from 2.3.x to 2.4.x



  • It's working for me about 4 weeks, but on clean install, upgraded every 1-3 days and I have no problems found.



  • Traffic Totals is working for you?  It's been borked for me since updating from 2.3.x to 2.4.x

    .

    Yup I installed it about two or three months ago and with the exception of the DB dying, it's been running fine.

    Try to make a backup and reinstall from zero. Then restore the backup. Maybe an update corrupted your install.

    Yeah I was worried about having to do that. I can't think of anything else to do especially when it claims it cannot recover the back up DB. I'll try monitoring it for a while longer and see if I catch any potential triggers.



  • I'm having the same issue. Every couple of months, the database gets corrupted. The hints from https://forum.pfsense.org/index.php?topic=123008.0 help to get it working, but usually at the expense of the database having been deleted and starting from scratch.

    Is there any solution to this problem, yet?