Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Stuck at "Seem you're not set up yet for access to xxx yet. Let's fix that.." #56

Open
yofreke opened this issue Dec 21, 2016 · 7 comments
Open

Stuck at "Seem you're not set up yet for access to xxx yet. Let's fix that.." #56

yofreke opened this issue Dec 21, 2016 · 7 comments

Comments

@yofreke
Copy link

yofreke commented Dec 21, 2016 •
edited
Loading

This just loops forever:

Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ ./iabak
From https://github.com/ArchiveTeam/IA.BAK
 * branch            master     -> FETCH_HEAD
Already up-to-date.
Welcome to iabak version 0.1
ALPHA TEST, use with caution

Already up-to-date.
Looks like this is a new IA backup. I'm going to put it in
/Volumes/ia.bak/IA.BAK/shard10
This will use some disk space. :)
Press Enter to confirm, or ctrl-C to cancel.
git-annex version: 6.20161211-gf58b134
build flags: Assistant Webapp Pairing Testsuite S3(multipartupload)(storageclasses) WebDAV FsEvents XMPP ConcurrentOutput TorrentParser MagicMime Feeds Quvi
key/value backends: SHA256E SHA256 SHA512E SHA512 SHA224E SHA224 SHA384E SHA384 SHA3_256E SHA3_256 SHA3_512E SHA3_512 SHA3_224E SHA3_224 SHA3_384E SHA3_384 SKEIN256E SKEIN256 SKEIN512E SKEIN512 SHA1E SHA1 MD5E MD5 WORM URL
remote types: git gcrypt p2p S3 bup directory rsync web bittorrent webdav tahoe glacier ddar hook external
local repository version: unknown
supported repository versions: 3 5 6
upgrade supported from repository versions: 0 1 2 3 4 5
operating system: darwin x86_64
Now we need to set up a service to regularly double-check the content of
your backup. This protects the backup against bit-rot.
Your system doesn't use systemd; falling back to an old-school cron job.
You've already got the cron job installed; I didn't need to do anything. Thanks!
Initialized empty Git repository in /Volumes/ia.bak/IA.BAK/shard10/.git/
init  ok
(recording state in git...)
Checking ssh to server at [email protected]:shard10...
Permission denied (publickey).
Seem you're not set up yet for access to [email protected]:shard10 yet. Let's fix that..
--2016-12-20 22:21:50--  http://iabak.archiveteam.org/cgi-bin/register.cgi?shard=SHARD10;uuid=6cacb8fa-044d-4243-a644-773dfd36b9d2;email=sparkyjoe94%40aim.com;pubkey=ssh-rsa%20AAAAB3NzaC1yc2EAAAADAQABAAABAQDD1iLax7FvU5hW46HBlnrk45Hk3IqlzppkPM1biOwRnwZG7YQDkKSy74toeR0Nn04jsFU89%2FN7luSG%2FOHNVgDsuItc8Kvs6GxOulcNk8F%2FGKEtGAF6PJmI9WtMGxJFlVHLcJfYRBZeYMVuAEpX9yRJf36pym4IayRicSC6rOyT9sRCcMCYrnLH_fka2rHvBW8rIEmEYOuixr8n4L_XjZaa1yCApLbyYE3LUJ8bgt62ZYvMao8xB8UsY_L4EQPVvDm0rQsK2vCJhJMlYDWi47%2FDGbzAPbgn5%2FeX3VJZhXm2OPiVCHiyl7pM3vv9nJ6oL0RLzMXOUJk5d6M_bJHuyk_p%20Brown%40jBrown-desktop
Resolving iabak.archiveteam.org... 124.6.40.235
Connecting to iabak.archiveteam.org|124.6.40.235|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/plain]
Saving to: 'STDOUT'

-                                                    [<=>                                                                                                       ]       0  --.-KB/s               [master 9a4bf81] registration of sparkyjoe94 on SHARD10
 1 file changed, 1 insertion(+)
-                                                    [  <=>                                                                                                     ]     116  49.7 B/s    in 2.3s

2016-12-20 22:21:54 (49.7 B/s) - written to stdout [116]

Checking ssh to server at [email protected]:shard10...
Permission denied (publickey).
Seem you're not set up yet for access to [email protected]:shard10 yet. Let's fix that..
--2016-12-20 22:22:00--  http://iabak.archiveteam.org/cgi-bin/register.cgi?shard=SHARD10;uuid=6cacb8fa-044d-4243-a644-773dfd36b9d2;email=sparkyjoe94%40aim.com;pubkey=ssh-rsa%20AAAAB3NzaC1yc2EAAAADAQABAAABAQDD1iLax7FvU5hW46HBlnrk45Hk3IqlzppkPM1biOwRnwZG7YQDkKSy74toeR0Nn04jsFU89%2FN7luSG%2FOHNVgDsuItc8Kvs6GxOulcNk8F%2FGKEtGAF6PJmI9WtMGxJFlVHLcJfYRBZeYMVuAEpX9yRJf36pym4IayRicSC6rOyT9sRCcMCYrnLH_fka2rHvBW8rIEmEYOuixr8n4L_XjZaa1yCApLbyYE3LUJ8bgt62ZYvMao8xB8UsY_L4EQPVvDm0rQsK2vCJhJMlYDWi47%2FDGbzAPbgn5%2FeX3VJZhXm2OPiVCHiyl7pM3vv9nJ6oL0RLzMXOUJk5d6M_bJHuyk_p%20Brown%40jBrown-desktop
Resolving iabak.archiveteam.org... 124.6.40.235
Connecting to iabak.archiveteam.org|124.6.40.235|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/plain]
Saving to: 'STDOUT'

-                                                    [<=>                                                                                                       ]       0  --.-KB/s               [master 6d8ec77] registration of sparkyjoe94 on SHARD10
 1 file changed, 1 insertion(+)
-                                                    [  <=>                                                                                                     ]     116  62.3 B/s    in 1.9s

2016-12-20 22:22:04 (62.3 B/s) - written to stdout [116]

Checking ssh to server at [email protected]:shard10...
Permission denied (publickey).
Seem you're not set up yet for access to [email protected]:shard10 yet. Let's fix that..
--2016-12-20 22:22:11--  http://iabak.archiveteam.org/cgi-bin/register.cgi?shard=SHARD10;uuid=6cacb8fa-044d-4243-a644-773dfd36b9d2;email=sparkyjoe94%40aim.com;pubkey=ssh-rsa%20AAAAB3NzaC1yc2EAAAADAQABAAABAQDD1iLax7FvU5hW46HBlnrk45Hk3IqlzppkPM1biOwRnwZG7YQDkKSy74toeR0Nn04jsFU89%2FN7luSG%2FOHNVgDsuItc8Kvs6GxOulcNk8F%2FGKEtGAF6PJmI9WtMGxJFlVHLcJfYRBZeYMVuAEpX9yRJf36pym4IayRicSC6rOyT9sRCcMCYrnLH_fka2rHvBW8rIEmEYOuixr8n4L_XjZaa1yCApLbyYE3LUJ8bgt62ZYvMao8xB8UsY_L4EQPVvDm0rQsK2vCJhJMlYDWi47%2FDGbzAPbgn5%2FeX3VJZhXm2OPiVCHiyl7pM3vv9nJ6oL0RLzMXOUJk5d6M_bJHuyk_p%20Brown%40jBrown-desktop
Resolving iabak.archiveteam.org... 124.6.40.235
Connecting to iabak.archiveteam.org|124.6.40.235|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/plain]
Saving to: 'STDOUT'

-                                                    [<=>                                                                                                       ]       0  --.-KB/s               [master 54c7a85] registration of sparkyjoe94 on SHARD10
 1 file changed, 1 insertion(+)
-                                                    [  <=>                                                                                                     ]     116  62.3 B/s    in 1.9s

2016-12-20 22:22:14 (62.3 B/s) - written to stdout [116]

^CCleaning up...
Cleaning up...

Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ ssh -i id_rsa -o BatchMode=yes -o StrictHostKeyChecking=no [email protected] -vv
OpenSSH_7.3p1, LibreSSL 2.4.1
debug1: Reading configuration data /Users/Brown/.ssh/config
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 20: Applying options for *
debug2: resolving "iabak.archiveteam.org" port 22
debug2: ssh_connect_direct: needpriv 0
debug1: Connecting to iabak.archiveteam.org [124.6.40.235] port 22.
debug1: Connection established.
debug1: identity file id_rsa type 1
debug1: key_load_public: No such file or directory
debug1: identity file id_rsa-cert type -1
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_7.3
debug1: Remote protocol version 2.0, remote software version OpenSSH_7.3p1 Debian-1
debug1: match: OpenSSH_7.3p1 Debian-1 pat OpenSSH* compat 0x04000000
debug2: fd 3 setting O_NONBLOCK
debug1: Authenticating to iabak.archiveteam.org:22 as 'SHARD18'
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug2: local client KEXINIT proposal
debug2: KEX algorithms: [email protected],ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group-exchange-sha256,diffie-hellman-group16-sha512,diffie-hellman-group18-sha512,diffie-hellman-group-exchange-sha1,diffie-hellman-group14-sha256,diffie-hellman-group14-sha1,ext-info-c
debug2: host key algorithms: [email protected],[email protected],[email protected],ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,[email protected],[email protected],ssh-ed25519,rsa-sha2-512,rsa-sha2-256,ssh-rsa
debug2: ciphers ctos: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected],aes128-cbc,aes192-cbc,aes256-cbc,3des-cbc
debug2: ciphers stoc: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected],aes128-cbc,aes192-cbc,aes256-cbc,3des-cbc
debug2: MACs ctos: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
debug2: MACs stoc: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
debug2: compression ctos: none,[email protected],zlib
debug2: compression stoc: none,[email protected],zlib
debug2: languages ctos:
debug2: languages stoc:
debug2: first_kex_follows 0
debug2: reserved 0
debug2: peer server KEXINIT proposal
debug2: KEX algorithms: [email protected],ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group-exchange-sha256,diffie-hellman-group16-sha512,diffie-hellman-group18-sha512,diffie-hellman-group14-sha256,diffie-hellman-group14-sha1
debug2: host key algorithms: ssh-rsa,rsa-sha2-512,rsa-sha2-256,ecdsa-sha2-nistp256
debug2: ciphers ctos: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected]
debug2: ciphers stoc: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected]
debug2: MACs ctos: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
debug2: MACs stoc: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
debug2: compression ctos: none,[email protected]
debug2: compression stoc: none,[email protected]
debug2: languages ctos:
debug2: languages stoc:
debug2: first_kex_follows 0
debug2: reserved 0
debug1: kex: algorithm: [email protected]
debug1: kex: host key algorithm: ecdsa-sha2-nistp256
debug1: kex: server->client cipher: [email protected] MAC: <implicit> compression: none
debug1: kex: client->server cipher: [email protected] MAC: <implicit> compression: none
debug1: expecting SSH2_MSG_KEX_ECDH_REPLY
debug1: Server host key: ecdsa-sha2-nistp256 SHA256:hej6o1e8uJ1RjxcA5Y6lF6rj3cdaFQcs0LQgZDIXWGY
debug1: Host 'iabak.archiveteam.org' is known and matches the ECDSA host key.
debug1: Found key in /Users/Brown/.ssh/known_hosts:45
debug2: set_newkeys: mode 1
debug1: rekey after 134217728 blocks
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug2: set_newkeys: mode 0
debug1: rekey after 134217728 blocks
debug1: SSH2_MSG_NEWKEYS received
debug2: key: id_rsa (0x7fad64000000), explicit
debug1: SSH2_MSG_EXT_INFO received
debug1: kex_input_ext_info: server-sig-algs=<rsa-sha2-256,rsa-sha2-512>
debug2: service_accept: ssh-userauth
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey
debug1: Next authentication method: publickey
debug1: Offering RSA public key: id_rsa
debug2: we sent a publickey packet, wait for reply
debug1: Authentications that can continue: publickey
debug2: we did not send a packet, disable method
debug1: No more authentication methods to try.
Permission denied (publickey).

On OSX 10.12.2

Is that normal?
@db48x
Copy link
Collaborator

db48x commented Dec 21, 2016

No, that's unusual. I can see your registrations on the server, but your public key isn't actually in place to allow you to authenticate.

@joeyh
Copy link
Contributor

joeyh commented Dec 21, 2016

Seems like an issue with pushing registrations to the gitlab repo.. After looking at the gitlab config, it started working. So, probably an interrmittent breakage in gitlab.

@db48x
Copy link
Collaborator

db48x commented Dec 21, 2016

We've also tweaked the process to be a bit more robust to failures of this type. I just double-checked and I can see that your registration is now in place. Thanks for the bug report, and my apologies for making you wait half a day!

@db48x db48x closed this as completed Dec 21, 2016
@yofreke
Copy link
Author

yofreke commented Dec 21, 2016 •
edited
Loading

After trying with same id_rsa:

Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ ./checkoutshard shard18
Initialized empty Git repository in /Volumes/ia.bak/IA.BAK/shard18/.git/
init  ok
(recording state in git...)
Checking ssh to server at [email protected]:shard18...
annex.uuid=d5e8a798-e7e5-472b-b931-800406c77ae4
core.gcrypt-id=
Warning: Identity file -i not accessible: No such file or directory.
Permission denied (publickey).
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
commit
On branch master

Initial commit

nothing to commit
ok
pull origin
Warning: Identity file [email protected] not accessible: No such file or directory.
Pseudo-terminal will not be allocated because stdin is not a terminal.
ssh: Could not resolve hostname git-upload-pack 'shard18': nodename nor servname provided, or not known
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
failed
git-annex: sync: 1 failed
Checked out shard18 for shard18 (from [email protected]:shard18). Current status: active

Tried removing id_rsa:

Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ rm id_rsa id_rsa.pub
Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ rm -rf shard18/
Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ ./iabak
From https://github.com/ArchiveTeam/IA.BAK
 * branch            master     -> FETCH_HEAD
Already up-to-date.
Welcome to iabak version 0.1
ALPHA TEST, use with caution

remote: Counting objects: 11, done.
remote: Compressing objects: 100% (7/7), done.
remote: Total 11 (delta 5), reused 10 (delta 4), pack-reused 0
Unpacking objects: 100% (11/11), done.
From https://github.com/ArchiveTeam/IA.BAK
   b38fa04..81e8d16  propellor  -> origin/propellor
   8b4c902..0b273f2  server     -> origin/server
Already up-to-date.
Looks like this is a new IA backup. I'm going to put it in
/Volumes/ia.bak/IA.BAK/shard18
This will use some disk space. :)
Press Enter to confirm, or ctrl-C to cancel.
git-annex version: 6.20161211-gf58b134
build flags: Assistant Webapp Pairing Testsuite S3(multipartupload)(storageclasses) WebDAV FsEvents XMPP ConcurrentOutput TorrentParser MagicMime Feeds Quvi
key/value backends: SHA256E SHA256 SHA512E SHA512 SHA224E SHA224 SHA384E SHA384 SHA3_256E SHA3_256 SHA3_512E SHA3_512 SHA3_224E SHA3_224 SHA3_384E SHA3_384 SKEIN256E SKEIN256 SKEIN512E SKEIN512 SHA1E SHA1 MD5E MD5 WORM URL
remote types: git gcrypt p2p S3 bup directory rsync web bittorrent webdav tahoe glacier ddar hook external
local repository version: unknown
supported repository versions: 3 5 6
upgrade supported from repository versions: 0 1 2 3 4 5
operating system: darwin x86_64
Now we need to set up a service to regularly double-check the content of
your backup. This protects the backup against bit-rot.
Your system doesn't use systemd; falling back to an old-school cron job.
You've already got the cron job installed; I didn't need to do anything. Thanks!
Initialized empty Git repository in /Volumes/ia.bak/IA.BAK/shard18/.git/
init  ok
(recording state in git...)
Checking ssh to server at [email protected]:shard18...
Permission denied (publickey).
Seem you're not set up yet for access to [email protected]:shard18 yet. Let's fix that..
--2016-12-21 15:14:33--  http://iabak.archiveteam.org/cgi-bin/register.cgi?shard=SHARD18;uuid=3e5b6458-78e1-4adb-bffb-917b6a9243cc;email=sparkyjoe94%40aim.com;pubkey=ssh-rsa%20AAAAB3NzaC1yc2EAAAADAQABAAABAQCapz9JRgMtumqpg2L6%2F7j8XHqTDJH2aYfePRUZIh9r_FD_Rz23Jz4tS9Kn_oO%2FjmsCb0RKanG%2F%2FtJcJ7M9sZWEvdLOwffr%2Fw5DO6UWDJTQiNH%2FnDGggmZp7VvXSELvzZN0A4ouYeIXSG3XPdoajTRSn0yKJNQYpS%2FaWCQWAe9Xfnh5uc9UwdmdSVkGowEqBjp7PRJeFrylrRaZAnhOttsDSFawYNNOS9qRtJV05PsONJiGHIP4Fv_BY%2F8q6c_SxDB9qDxz5vi81nA_X7ltxIks7AN4sAuqItSZ92jih9KO%2FqHWfLjAgXp075o9oZBtysgdWlO13ZfVPr52TyiLLA5l%20Brown%40jBrown-desktop
Resolving iabak.archiveteam.org... 124.6.40.235
Connecting to iabak.archiveteam.org|124.6.40.235|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/plain]
Saving to: 'STDOUT'

-                                                    [<=>                                                                                                       ]       0  --.-KB/s               Already up-to-date.
[master 968f0e3] registration of sparkyjoe94 on SHARD18
 1 file changed, 1 insertion(+)
-                                                    [  <=>                                                                                                     ]     136  28.8 B/s    in 4.7s

2016-12-21 15:14:40 (28.8 B/s) - written to stdout [136]

Checking ssh to server at [email protected]:shard18...
annex.uuid=d5e8a798-e7e5-472b-b931-800406c77ae4
core.gcrypt-id=
Warning: Identity file -i not accessible: No such file or directory.
Permission denied (publickey).
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
commit
On branch master

Initial commit

nothing to commit
ok
pull origin
Warning: Identity file [email protected] not accessible: No such file or directory.
Pseudo-terminal will not be allocated because stdin is not a terminal.
ssh: Could not resolve hostname git-upload-pack 'shard18': nodename nor servname provided, or not known
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
failed
git-annex: sync: 1 failed
Checked out shard18 for shard18 (from [email protected]:shard18). Current status: active

Filesystem                    Size   Used  Avail Capacity iused ifree %iused  Mounted on
192.168.1.6:/volume1/ia.bak   14Ti  638Gi   13Ti     5%       0     0  100%   /Volumes/ia.bak
How much of this disk space do you want to keep free, and not use for IA backup?
(You can free up space at any time by simply deleting files from the archives.)
To use entire disk, just hit Enter, or type in something like 100M, 200G, or 1T.
You must input a value of at least 100 megabytes.
./iabak-helper: line 289: read: -i: invalid option
read: usage: read [-ers] [-u fd] [-t timeout] [-p prompt] [-a array] [-n nchars] [-d delim] [name ...]
Cleaning up...

http://stackoverflow.com/questions/22634065/bash-read-command-does-not-accept-i-parameter-on-mac-any-alternatives

Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ bash --version
GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin16)

From here:

  • brew update && brew install bash
  • sudo bash -c 'echo /usr/local/bin/bash >> /etc/shells'
  • chsh -s /usr/local/bin/bash

Going to try the reboot and see if that fixes things, but it looks like there are still access problems?

@db48x
Copy link
Collaborator

db48x commented Dec 22, 2016 

Warning: Identity file -i not accessible: No such file or directory.

That seems to be the main problem at present, although installing bash is indeed necessary. Can you take a look at the id_rsa file and see why it might not be readable?

@db48x db48x reopened this Dec 22, 2016
@yofreke
Copy link
Author

yofreke commented Dec 22, 2016 •
edited
Loading

There is no reason that should be failing that I can tell. What specifically is causing that error? Worth noting that I am running this on an NFS mount.

My new best theory is that there is something broken with the NFS mount, because my shell will frequently stop responding as well (just noticed this today), and I have to: cd /Volumes && chown -R Brown ia.bak before I can start doing anything again. Seems like this might also be effecting the script, since a new bash shell almost always causes issues.

Going to investigate the NFS stuff on my side some more.

@db48x
Copy link
Collaborator

db48x commented Dec 22, 2016

Yes, NFS is very problematic; I doubt we've even seen all the problems it can cause.

@smammy smammy mentioned this issue May 1, 2021
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@joeyh @db48x @yofreke