ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Port from SW - Salt master rsa key issue

    IT Discussion
    salt salt master salt minion rsa
    6
    60
    9.5k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • scottalanmillerS
      scottalanmiller
      last edited by

      What are the date times for the first two?

      D 1 Reply Last reply Reply Quote 0
      • D
        dgingerich @scottalanmiller
        last edited by

        @scottalanmiller said in Port from SW - Salt master rsa key issue:

        What are the date times for the first two?

        update previous post with that info

        1 Reply Last reply Reply Quote 0
        • D
          dgingerich
          last edited by

          Of course, trying the same sequence, I cannot reproduce the results. Looks like I'm going to have to rebuild the masters.

          Maybe copying the rsa key files to the new systems will be possible.

          scottalanmillerS 1 Reply Last reply Reply Quote 0
          • scottalanmillerS
            scottalanmiller @dgingerich
            last edited by

            @dgingerich said in Port from SW - Salt master rsa key issue:

            Of course, trying the same sequence, I cannot reproduce the results. Looks like I'm going to have to rebuild the masters.

            Maybe copying the rsa key files to the new systems will be possible.

            Possible. Or it might be worth accepting the pain of changing the keys on GIT.

            1 Reply Last reply Reply Quote 0
            • D
              dgingerich
              last edited by

              rebuilding the systems did not work. getting the same issue with brand new master under the same name.

              scottalanmillerS 1 Reply Last reply Reply Quote 0
              • scottalanmillerS
                scottalanmiller @dgingerich
                last edited by

                @dgingerich said in Port from SW - Salt master rsa key issue:

                rebuilding the systems did not work. getting the same issue with brand new master under the same name.

                You didn't do anything with the keys, you left the new system with its automatically created keys? The minions will not be able to rejoin with the same name, you'll need to remove them and add them again.

                D 1 Reply Last reply Reply Quote 0
                • D
                  dgingerich @scottalanmiller
                  last edited by

                  @scottalanmiller The other minions were not included in this. The masters would not even log into themselves after the keys were accepted. Total blank slate machines, install salt-master and salt-minion, configure them to point to themselves, (other minions were turned off) and they still failed the test.ping and salt-minion -l debug gave the exact same result. Could it be something with the DNS info?

                  1 Reply Last reply Reply Quote 0
                  • scottalanmillerS
                    scottalanmiller
                    last edited by

                    So the masters can't see THEMSELVES? What master name are you using? You could try using a straight IP address to test. Yes, DNS could do this.

                    1 Reply Last reply Reply Quote 0
                    • D
                      dgingerich
                      last edited by

                      root@QAICS-MAN-01:~# apt-get install salt-master salt-minion
                      ...
                      root@QAICS-MAN-01:/etc/salt# vi minion
                      root@QAICS-MAN-01:/etc/salt# vi master
                      root@QAICS-MAN-01:/etc/salt# service salt-master start
                      root@QAICS-MAN-01:/etc/salt# service salt-minion start
                      root@QAICS-MAN-01:/etc/salt# salt-key -L
                      Accepted Keys:
                      Denied Keys:
                      Unaccepted Keys:
                      QAICS-MAN-01
                      QAICS-MAN-02
                      Rejected Keys:
                      root@QAICS-MAN-01:/etc/salt# salt-key -L
                      Accepted Keys:
                      Denied Keys:
                      Unaccepted Keys:
                      QAICS-MAN-01
                      QAICS-MAN-02
                      Rejected Keys:
                      root@QAICS-MAN-01:/etc/salt# salt-key -A
                      The following keys are going to be accepted:
                      Unaccepted Keys:
                      QAICS-MAN-01
                      QAICS-MAN-02
                      Proceed? [n/Y] y
                      Key for minion QAICS-MAN-01 accepted.
                      Key for minion QAICS-MAN-02 accepted.
                      Key for minion QAICS-Proxy-01 accepted.
                      root@QAICS-MAN-01:/etc/salt# salt-key -L
                      Accepted Keys:
                      QAICS-MAN-01
                      QAICS-MAN-02
                      Denied Keys:
                      Unaccepted Keys:
                      Rejected Keys:
                      root@QAICS-MAN-01:/etc/salt# salt '*' test.ping
                      [WARNING ] Key 'file_ignore_glob' with value None has an invalid type of NoneType, a list is required for this value
                      [WARNING ] Key 'file_ignore_glob' with value None has an invalid type of NoneType, a list is required for this value
                      [WARNING ] Key 'file_ignore_glob' with value None has an invalid type of NoneType, a list is required for this value
                      [WARNING ] Key 'file_ignore_glob' with value None has an invalid type of NoneType, a list is required for this value
                      [WARNING ] jid does not exist
                      [WARNING ] Returner unavailable:
                      QAICS-MAN-02:
                      Minion did not return. [No response]
                      QAICS-MAN-01:
                      Minion did not return. [No response]
                      root@QAICS-MAN-01:/etc/salt#

                      1 Reply Last reply Reply Quote 0
                      • scottalanmillerS
                        scottalanmiller
                        last edited by

                        @dgingerich said in Port from SW - Salt master rsa key issue:

                        [WARNING ] Key 'file_ignore_glob' with value None has an invalid type of NoneType, a list is required for this value

                        maybe you have duplicate DNS entries and round robin is getting you?

                        1 Reply Last reply Reply Quote 0
                        • D
                          dgingerich
                          last edited by

                          @scottalanmiller said in Port from SW - Salt master rsa key issue:

                          @dgingerich said in Port from SW - Salt master rsa key issue:

                          [WARNING ] Key 'file_ignore_glob' with value None has an invalid type of NoneType, a list is required for this value

                          maybe you have duplicate DNS entries and round robin is getting you?

                          The DNS is just one address for each. I changed the to the new IPs while the systems were building at the authoritative servers. (Systems are housed at Packet.net, DNS handled through AWS) So, there should not be any DNS caching issues.

                          scottalanmillerS 1 Reply Last reply Reply Quote 0
                          • scottalanmillerS
                            scottalanmiller @dgingerich
                            last edited by

                            @dgingerich said in Port from SW - Salt master rsa key issue:

                            @scottalanmiller said in Port from SW - Salt master rsa key issue:

                            @dgingerich said in Port from SW - Salt master rsa key issue:

                            [WARNING ] Key 'file_ignore_glob' with value None has an invalid type of NoneType, a list is required for this value

                            maybe you have duplicate DNS entries and round robin is getting you?

                            The DNS is just one address for each. I changed the to the new IPs while the systems were building at the authoritative servers. (Systems are housed at Packet.net, DNS handled through AWS) So, there should not be any DNS caching issues.

                            Oh okay, this is all hosted. Still, best to be sure and rule out possibilities while testing. This is weird, we use Vultr for Salt Masters and have never seen anything like this. But we avoid Ubuntu, so if there is any bug there, we'd not have seen it.

                            D 1 Reply Last reply Reply Quote 0
                            • D
                              dgingerich @scottalanmiller
                              last edited by

                              @scottalanmiller said in Port from SW - Salt master rsa key issue:

                              @dgingerich said in Port from SW - Salt master rsa key issue:

                              @scottalanmiller said in Port from SW - Salt master rsa key issue:

                              @dgingerich said in Port from SW - Salt master rsa key issue:

                              [WARNING ] Key 'file_ignore_glob' with value None has an invalid type of NoneType, a list is required for this value

                              maybe you have duplicate DNS entries and round robin is getting you?

                              The DNS is just one address for each. I changed the to the new IPs while the systems were building at the authoritative servers. (Systems are housed at Packet.net, DNS handled through AWS) So, there should not be any DNS caching issues.

                              Oh okay, this is all hosted. Still, best to be sure and rule out possibilities while testing. This is weird, we use Vultr for Salt Masters and have never seen anything like this. But we avoid Ubuntu, so if there is any bug there, we'd not have seen it.

                              I was able to build another system, named QAICS-mastertest, that worked perfectly using the exact same methods. It's really weird.

                              scottalanmillerS 1 Reply Last reply Reply Quote 1
                              • scottalanmillerS
                                scottalanmiller @dgingerich
                                last edited by

                                @dgingerich said in Port from SW - Salt master rsa key issue:

                                @scottalanmiller said in Port from SW - Salt master rsa key issue:

                                @dgingerich said in Port from SW - Salt master rsa key issue:

                                @scottalanmiller said in Port from SW - Salt master rsa key issue:

                                @dgingerich said in Port from SW - Salt master rsa key issue:

                                [WARNING ] Key 'file_ignore_glob' with value None has an invalid type of NoneType, a list is required for this value

                                maybe you have duplicate DNS entries and round robin is getting you?

                                The DNS is just one address for each. I changed the to the new IPs while the systems were building at the authoritative servers. (Systems are housed at Packet.net, DNS handled through AWS) So, there should not be any DNS caching issues.

                                Oh okay, this is all hosted. Still, best to be sure and rule out possibilities while testing. This is weird, we use Vultr for Salt Masters and have never seen anything like this. But we avoid Ubuntu, so if there is any bug there, we'd not have seen it.

                                I was able to build another system, named QAICS-mastertest, that worked perfectly using the exact same methods. It's really weird.

                                Very weird. So the changing of the name played a role.

                                1 Reply Last reply Reply Quote 0
                                • D
                                  dgingerich
                                  last edited by

                                  OK. I've deleted the DNS entries and the systems from Packet.net. I'm going to try again tomorrow morning after all the DNS caching should have expired.

                                  scottalanmillerS 1 Reply Last reply Reply Quote 1
                                  • scottalanmillerS
                                    scottalanmiller @dgingerich
                                    last edited by

                                    @dgingerich said in Port from SW - Salt master rsa key issue:

                                    OK. I've deleted the DNS entries and the systems from Packet.net. I'm going to try again tomorrow morning after all the DNS caching should have expired.

                                    Okay. I'll be around.

                                    1 Reply Last reply Reply Quote 0
                                    • D
                                      dgingerich
                                      last edited by

                                      Thank you very much for your time on this.

                                      scottalanmillerS 1 Reply Last reply Reply Quote 0
                                      • scottalanmillerS
                                        scottalanmiller @dgingerich
                                        last edited by

                                        @dgingerich said in Port from SW - Salt master rsa key issue:

                                        Thank you very much for your time on this.

                                        No problem. Sorry that we've not gotten it all figured out yet.

                                        1 Reply Last reply Reply Quote 0
                                        • Emad RE
                                          Emad R
                                          last edited by Emad R

                                          I too, not an expert, more like playing with salt and you seem like you know more about it than me, but this one liner helps me when I feel something is cached in the setting, or command fails cause its already running:

                                          salt '*' saltutil.kill_all_jobs && salt-run cache.clear_all && salt '*' saltutil.clear_cache && salt '*' saltutil.sync_all
                                          
                                          1 Reply Last reply Reply Quote 1
                                          • D
                                            dgingerich
                                            last edited by

                                            @msff-amman-Itofficer said in Port from SW - Salt master rsa key issue:

                                            I too, not an expert, more like playing with salt and you seem like you know more about it than me, but this one liner helps me when I feel something is cached in the setting, or command fails cause its already running:

                                            salt '*' saltutil.kill_all_jobs && salt-run cache.clear_all && salt '*' saltutil.clear_cache && salt '*' saltutil.sync_all
                                            

                                            Yeah, that wouldn't work because the masters simply aren't talking to the minions.

                                            Over the weekend, I tried to delete the DNS and recreate the masters after 12 hours, and that did sort of work, for a bit. The masters would talk to themselves, but as soon as two minions were connected, the communication just stopped again. I don't have any idea what is causing this.

                                            1 Reply Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 3
                                            • 2 / 3
                                            • First post
                                              Last post