ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Unsolved Zabbix gone wild

    IT Discussion
    4
    32
    1.8k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • scottalanmillerS
      scottalanmiller @dafyre
      last edited by

      @dafyre said in Zabbix gone wild:

      @scottalanmiller said in Zabbix gone wild:

      @dafyre said in Zabbix gone wild:

      @scottalanmiller said in Zabbix gone wild:

      That's right in the middle. Seems like it might have been growing and shrinking. That's a fairly common thing to have happen during certain processes.

      Unless it's a busy VM, +/- 12% at a time is kinda crazy.

      Cache

      I could easily see 10/12% of RAM being a cache but 10% of your disk space... depending on the size of the disk, that could still be huge (not to mention slow).

      What if it is a cache of logs being compressed or something similar?

      1 Reply Last reply Reply Quote 0
      • scottalanmillerS
        scottalanmiller
        last edited by

        Or temporary database tables?

        1 Reply Last reply Reply Quote 0
        • Mike DavisM
          Mike Davis
          last edited by

          The plot thickens. This is the 12 hour graph:
          0_1489674914629_diskSpaceGraph.png

          You can see when I added space, but it still keeps going up and down. I'm going to restart the zabbix service.

          dafyreD 1 Reply Last reply Reply Quote 1
          • dafyreD
            dafyre @Mike Davis
            last edited by

            @Mike-Davis What kind of server is this?

            Mike DavisM 1 Reply Last reply Reply Quote 0
            • Mike DavisM
              Mike Davis @dafyre
              last edited by

              @dafyre It's a remote desktop server. I have one user on it now. I'm going to bounce it in a little bit when they are finished.

              1 Reply Last reply Reply Quote 0
              • scottalanmillerS
                scottalanmiller
                last edited by

                Users could be doing nearly anything in that case.

                dafyreD Mike DavisM 2 Replies Last reply Reply Quote 2
                • dafyreD
                  dafyre @scottalanmiller
                  last edited by

                  @scottalanmiller said in Zabbix gone wild:

                  Users could be doing nearly anything in that case.

                  Temporary Database Tables... or user causing issues... You can guess which one I'd pick as the problem.

                  1 Reply Last reply Reply Quote 0
                  • Mike DavisM
                    Mike Davis @scottalanmiller
                    last edited by

                    @scottalanmiller I would agree, except I don't think anyone was on at 3:00 AM, and there is only one user on now, and that is another Admin.

                    dafyreD dbeatoD 2 Replies Last reply Reply Quote 0
                    • dafyreD
                      dafyre @Mike Davis
                      last edited by dafyre

                      @Mike-Davis said in Zabbix gone wild:

                      @scottalanmiller I would agree, except I don't think anyone was on at 3:00 AM, and there is only one user on now, and that is another Admin.

                      You can track RD sessions for that in Zabbix. You have to nab them with perf_counter.

                      1 Reply Last reply Reply Quote 0
                      • Mike DavisM
                        Mike Davis
                        last edited by

                        The thing is, I'm on the server and I can see free space and it's not changing. The Zabbix graph thinks it is though. I'll launch perfmon to see if it's changing faster than I can see it.

                        1 Reply Last reply Reply Quote 0
                        • Mike DavisM
                          Mike Davis
                          last edited by

                          Perfmon shows it steady with 37% free. So it must be Zabbix.0_1489677125149_perfmon.png

                          1 Reply Last reply Reply Quote 0
                          • scottalanmillerS
                            scottalanmiller
                            last edited by

                            Weird.

                            1 Reply Last reply Reply Quote 1
                            • Mike DavisM
                              Mike Davis
                              last edited by

                              Even after a reboot, Zabbix is still seeing the same thing. It's not kicking out emails, which is also odd.
                              0_1489679409854_diskSpaceGraphrebooted.png

                              dafyreD 1 Reply Last reply Reply Quote 0
                              • dafyreD
                                dafyre @Mike Davis
                                last edited by dafyre

                                @Mike-Davis said in Zabbix gone wild:

                                Even after a reboot, Zabbix is still seeing the same thing. It's not kicking out emails, which is also odd.
                                0_1489679409854_diskSpaceGraphrebooted.png

                                What version of Zabbix Server & Agent?

                                Also, what is the Zabbix key (Configuration -> Hosts -> Host -> Items) it is looking at?

                                Mike DavisM 1 Reply Last reply Reply Quote 0
                                • Mike DavisM
                                  Mike Davis @dafyre
                                  last edited by

                                  @dafyre It looks like: Triggers 1 vfs.fs.size[C:,pfree]

                                  1 Reply Last reply Reply Quote 0
                                  • dafyreD
                                    dafyre
                                    last edited by dafyre

                                    What version of Zabbix agent and server?

                                    What version of Windows Server?

                                    Mike DavisM 1 Reply Last reply Reply Quote 0
                                    • Mike DavisM
                                      Mike Davis @dafyre
                                      last edited by

                                      @dafyre It's Zabbix Server 3.2
                                      Zabbix Agent Version 3.2.0.62444

                                      Windows Server 2012 R2 patched up to date. It has the RDS role and RDS gateway role installed on it.

                                      1 Reply Last reply Reply Quote 0
                                      • dafyreD
                                        dafyre
                                        last edited by dafyre

                                        From your Zabbix server...

                                        try to run this command a few times and see if it returns everything like it should:

                                        zabbix_get -s ipofyourhost -k "vfs.fs.size[C:,pfree]"
                                        

                                        Run it a few times back-to-back and see what you get... and then compare with the results of...

                                        zabbix_get -s ipofyourhost -k "vfs.fs.size[C:,free]"
                                        
                                        1 Reply Last reply Reply Quote 0
                                        • dbeatoD
                                          dbeato @Mike Davis
                                          last edited by

                                          @Mike-Davis what about Windows Updates? That will do those huge chnages of space.

                                          1 Reply Last reply Reply Quote 1
                                          • Mike DavisM
                                            Mike Davis
                                            last edited by

                                            @dafyre said in Zabbix gone wild:

                                            From your Zabbix server...

                                            try to run this command a few times and see if it returns everything like it should:

                                            zabbix_get -s ipofyourhost -k "vfs.fs.size[C:,pfree]"
                                            

                                            Run it a few times back-to-back and see what you get... and then compare with the results of...

                                            zabbix_get -s ipofyourhost -k "vfs.fs.size[C:,free]"
                                            

                                            Where do I find the zabbix_get command? I tried it and got "-bash: zabbix_get: command not found"
                                            I did:
                                            sudo find -name "zabbix_get"
                                            and it returned nothing.

                                            Mike DavisM 1 Reply Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 1 / 2
                                            • First post
                                              Last post