SFTP File Transfer not being received by client - sftp

We recently performed a new deployment of our system which included an upgrade of Apache Commons VFS from 1.1 to 2.0. Since the deployment our client has said they are no longer receiving a file that is generated by our system on a daily basis and transferred to their server over sftp. All of our logs seem to indicate no problem:
DEBUG 2019-05-06 16:30:22,237 VfsLog:70 debug-> Using "/home/tomcat/var/tomcat/temp/vfs_cache" as temporary files store.
DEBUG 2019-05-06 16:30:22,248 VfsLog:70 debug-> Skipping provider "org.apache.commons.vfs2.provider.webdav.WebdavFileProvider" because required class "org.apache.jackrabbit.webdav.client.methods.DavMethod" is not available.
DEBUG 2019-05-06 16:30:22,250 VfsLog:70 debug-> Skipping provider "org.apache.commons.vfs2.provider.hdfs.HdfsFileProvider" because required class "org.apache.hadoop.fs.FileSystem" is not available.
DEBUG 2019-05-06 16:30:22,262 Transporter:525 getFSOptions-> Not using strict host checking
DEBUG 2019-05-06 16:30:22,262 Transporter:528 getFSOptions-> user dir as root? true
DEBUG 2019-05-06 16:30:22,263 Transporter:214 transportOutbound-> Attempting to write to remote file [server]/[file].pgp
DEBUG 2019-05-06 16:30:22,264 VfsLog:70 debug-> Using "/home/tomcat/var/tomcat/temp/vfs_cache" as temporary files store.
DEBUG 2019-05-06 16:30:22,267 VfsLog:70 debug-> Skipping provider "org.apache.commons.vfs2.provider.webdav.WebdavFileProvider" because required class "org.apache.jackrabbit.webdav.client.methods.DavMethod" is not available.
DEBUG 2019-05-06 16:30:22,268 VfsLog:70 debug-> Skipping provider "org.apache.commons.vfs2.provider.hdfs.HdfsFileProvider" because required class "org.apache.hadoop.fs.FileSystem" is not available.
INFO 2019-05-06 16:30:22,372 SftpClientFactory$JSchLogger:324 log-> Connecting to [server] port 22
INFO 2019-05-06 16:30:22,394 SftpClientFactory$JSchLogger:324 log-> Connection established
INFO 2019-05-06 16:30:22,398 SftpClientFactory$JSchLogger:324 log-> Remote version string: SSH-2.0-Maverick_SSHD
INFO 2019-05-06 16:30:22,398 SftpClientFactory$JSchLogger:324 log-> Local version string: SSH-2.0-JSCH-0.1.54
INFO 2019-05-06 16:30:22,399 SftpClientFactory$JSchLogger:324 log-> CheckCiphers: aes256-ctr,aes192-ctr,aes128-ctr,aes256-cbc,aes192-cbc,aes128-cbc,3des-ctr,arcfour,arcfour128,arcfour256
INFO 2019-05-06 16:30:22,430 SftpClientFactory$JSchLogger:324 log-> CheckKexes: diffie-hellman-group14-sha1,ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521
INFO 2019-05-06 16:30:22,525 SftpClientFactory$JSchLogger:324 log-> CheckSignatures: ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521
INFO 2019-05-06 16:30:22,535 SftpClientFactory$JSchLogger:324 log-> SSH_MSG_KEXINIT sent
INFO 2019-05-06 16:30:22,536 SftpClientFactory$JSchLogger:324 log-> SSH_MSG_KEXINIT received
INFO 2019-05-06 16:30:22,536 SftpClientFactory$JSchLogger:324 log-> kex: server: diffie-hellman-group1-sha1,diffie-hellman-group-exchange-sha1
INFO 2019-05-06 16:30:22,537 SftpClientFactory$JSchLogger:324 log-> kex: server: ssh-rsa
INFO 2019-05-06 16:30:22,537 SftpClientFactory$JSchLogger:324 log-> kex: server: aes256-cbc,aes192-cbc,aes128-cbc
INFO 2019-05-06 16:30:22,538 SftpClientFactory$JSchLogger:324 log-> kex: server: aes256-cbc,aes192-cbc,aes128-cbc
INFO 2019-05-06 16:30:22,539 SftpClientFactory$JSchLogger:324 log-> kex: server: hmac-sha1,hmac-sha1-96,hmac-md5-96
INFO 2019-05-06 16:30:22,539 SftpClientFactory$JSchLogger:324 log-> kex: server: hmac-sha1,hmac-sha1-96,hmac-md5-96
INFO 2019-05-06 16:30:22,540 SftpClientFactory$JSchLogger:324 log-> kex: server: none
INFO 2019-05-06 16:30:22,540 SftpClientFactory$JSchLogger:324 log-> kex: server: none
INFO 2019-05-06 16:30:22,541 SftpClientFactory$JSchLogger:324 log-> kex: server:
INFO 2019-05-06 16:30:22,541 SftpClientFactory$JSchLogger:324 log-> kex: server:
INFO 2019-05-06 16:30:22,542 SftpClientFactory$JSchLogger:324 log-> kex: client: ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group14-sha1,diffie-hellman-group-exchange-sha256,diffie-hellman-group-exchange-sha1,diffie-hellman-group1-sha1
INFO 2019-05-06 16:30:22,543 SftpClientFactory$JSchLogger:324 log-> kex: client: ssh-rsa,ssh-dss,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521
INFO 2019-05-06 16:30:22,543 SftpClientFactory$JSchLogger:324 log-> kex: client: aes128-ctr,aes128-cbc,3des-ctr,3des-cbc,blowfish-cbc,aes192-ctr,aes192-cbc,aes256-ctr,aes256-cbc
INFO 2019-05-06 16:30:22,544 SftpClientFactory$JSchLogger:324 log-> kex: client: aes128-ctr,aes128-cbc,3des-ctr,3des-cbc,blowfish-cbc,aes192-ctr,aes192-cbc,aes256-ctr,aes256-cbc
INFO 2019-05-06 16:30:22,544 SftpClientFactory$JSchLogger:324 log-> kex: client: hmac-md5,hmac-sha1,hmac-sha2-256,hmac-sha1-96,hmac-md5-96
INFO 2019-05-06 16:30:22,545 SftpClientFactory$JSchLogger:324 log-> kex: client: hmac-md5,hmac-sha1,hmac-sha2-256,hmac-sha1-96,hmac-md5-96
INFO 2019-05-06 16:30:22,545 SftpClientFactory$JSchLogger:324 log-> kex: client: none
INFO 2019-05-06 16:30:22,546 SftpClientFactory$JSchLogger:324 log-> kex: client: none
INFO 2019-05-06 16:30:22,547 SftpClientFactory$JSchLogger:324 log-> kex: client:
INFO 2019-05-06 16:30:22,547 SftpClientFactory$JSchLogger:324 log-> kex: client:
INFO 2019-05-06 16:30:22,548 SftpClientFactory$JSchLogger:324 log-> kex: server->client aes128-cbc hmac-sha1 none
INFO 2019-05-06 16:30:22,548 SftpClientFactory$JSchLogger:324 log-> kex: client->server aes128-cbc hmac-sha1 none
INFO 2019-05-06 16:30:22,567 SftpClientFactory$JSchLogger:324 log-> SSH_MSG_KEX_DH_GEX_REQUEST(1024<2048<2048) sent
INFO 2019-05-06 16:30:22,568 SftpClientFactory$JSchLogger:324 log-> expecting SSH_MSG_KEX_DH_GEX_GROUP
INFO 2019-05-06 16:30:22,591 SftpClientFactory$JSchLogger:324 log-> SSH_MSG_KEX_DH_GEX_INIT sent
INFO 2019-05-06 16:30:22,592 SftpClientFactory$JSchLogger:324 log-> expecting SSH_MSG_KEX_DH_GEX_REPLY
INFO 2019-05-06 16:30:22,620 SftpClientFactory$JSchLogger:324 log-> ssh_rsa_verify: signature true
INFO 2019-05-06 16:30:22,622 SftpClientFactory$JSchLogger:324 log-> Host '[server]' is known and matches the RSA host key
INFO 2019-05-06 16:30:22,623 SftpClientFactory$JSchLogger:324 log-> SSH_MSG_NEWKEYS sent
INFO 2019-05-06 16:30:22,624 SftpClientFactory$JSchLogger:324 log-> SSH_MSG_NEWKEYS received
INFO 2019-05-06 16:30:22,632 SftpClientFactory$JSchLogger:324 log-> SSH_MSG_SERVICE_REQUEST sent
INFO 2019-05-06 16:30:22,635 SftpClientFactory$JSchLogger:324 log-> SSH_MSG_SERVICE_ACCEPT received
INFO 2019-05-06 16:30:22,642 SftpClientFactory$JSchLogger:324 log-> Authentications that can continue: publickey,keyboard-interactive,password
INFO 2019-05-06 16:30:22,642 SftpClientFactory$JSchLogger:324 log-> Next authentication method: publickey
INFO 2019-05-06 16:30:22,719 SftpClientFactory$JSchLogger:324 log-> Authentications that can continue: password
INFO 2019-05-06 16:30:22,719 SftpClientFactory$JSchLogger:324 log-> Next authentication method: password
INFO 2019-05-06 16:30:22,736 SftpClientFactory$JSchLogger:324 log-> Authentication succeeded (password).
DEBUG 2019-05-06 16:30:22,758 SoftRefFilesCache:130 putFile-> putFile: sftp://[user]:***#[server]/[filename].pgp
DEBUG 2019-05-06 16:30:23,143 SoftRefFilesCache:130 putFile-> putFile: sftp://[user]:***#[server]/
DEBUG 2019-05-06 16:30:23,181 SoftRefFilesCache:130 putFile-> putFile: sftp://[user]:***#[server]/TO_HR
DEBUG 2019-05-06 16:30:23,443 Transporter:220 transportOutbound-> Completed write to remote file [server]/TO_HR/[file].pgp
INFO 2019-05-06 16:30:23,444 SftpClientFactory$JSchLogger:324 log-> Disconnecting from [server] port 22
And this is the generic piece of code we have to perform transfers like this:
String safeUri = escapePassword(uriString, events);
String hostPath = getHostPath(uriString);
FileSystemManager fsManager = getFileSystemManager();
try {
FileSystemOptions opts = getFSOptions();
FileObject remoteFile = fsManager.resolveFile(safeUri + remoteFilename, opts);
IOUtils.copy(new FileInputStream(localFile), remoteFile.getContent().getOutputStream());
catch(IOException ioe) {
log.error("", ioe);
} finally {
close(fsManager);
}
The file is generated and stored on the server successfully, and we can manually transfer the file to the client using the server's sftp command (the server is CentOS 6 so I assume it's OpenSSH) using the same user credentials used by the application.
Any ideas on what might be going wrong?

Ended up rewriting our sftp file transfer code using the answer here: https://stackoverflow.com/a/14830708/3415090

Related

JSch: How to configure diffie-hellman-group14-sha256?

I am trying to connect to a ssh server with diffie-hellman-group14-sha256#ssh.com, diffie-hellman-group-exchange-sha256 algorithm.
But my JSch client always encrypts with diffie-hellman-group14-sha1.
What can I do to setup the sha256 algorithm?
The problem occurs on our test environment only. The settings there are same as prod environments. Just OpenSSH version differs - it is newer on test.
Java version: 1.8.0_151
Server logs: "The JCE Unlimited Strength Jurisdiction Policy File was found"
Available in server lib: jce_policy-8/US_export_policy.jar, jce_policy-8/local_policy.jar
My code looks like:
JSch jsch = new JSch();
Session session = null;
Channel channel = null;
ChannelSftp c = null;
//Now connect and SFTP to the SFTP Server
try {
//Create a session sending through our username and password
session = jsch.getSession(ftpUserName, ftpHost, ftpPort);
session.setPassword(ftpPassword);
Properties config = new Properties();
config.put("StrictHostKeyChecking", "no");
session.setConfig(config);
session.connect();
//
//Open the SFTP channel
//
channel = session.openChannel("sftp");
channel.connect();
c = (ChannelSftp)channel;
status = "OK";
}
catch (Exception e) {
status = "Unable to connect to FTP server. "+e.toString();
}
Log out is:
INFO: Connecting to X.X.X.X port 22
INFO: Connection established
INFO: Remote version string: SSH-2.0-6.4.13.36 SSH Tectia Server
INFO: Local version string: SSH-2.0-JSCH-0.1.53
INFO: CheckCiphers: aes256-ctr,aes192-ctr,aes128-ctr,aes256-cbc,aes192-cbc,aes128-cbc,3des-ctr,arcfour,arcfour128,arcfour256
**INFO**: CheckKexes: diffie-hellman-group14-sha1,ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521
CheckKexes: diffie-hellman-group14-sha1,ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521
INFO: CheckSignatures: ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521
INFO: SSH_MSG_KEXINIT sent
INFO: SSH_MSG_KEXINIT received
**INFO: kex: server**: diffie-hellman-group14-sha256#ssh.com,diffie-hellman-group-exchange-sha256,diffie-hellman-group1-sha1,diffie-hellman-group14-sha1,diffie-hellman-group-exchange-sha1
INFO: kex: server: ssh-rsa,ssh-rsa-sha256#ssh.com
INFO: kex: server: aes128-ctr,aes192-ctr,aes256-ctr,3des-cbc,crypticore128#ssh.com
INFO: kex: server: aes128-ctr,aes192-ctr,aes256-ctr,3des-cbc,crypticore128#ssh.com
INFO: kex: server: hmac-sha2-256,hmac-sha2-512,hmac-md5,hmac-sha256-2#ssh.com,hmac-sha224#ssh.com,hmac-sha256#ssh.com,hmac-sha384#ssh.com,hmac-sha512#ssh.com,crypticore-mac#ssh.com
INFO: kex: server: hmac-sha2-256,hmac-sha2-512,hmac-md5,hmac-sha256-2#ssh.com,hmac-sha224#ssh.com,hmac-sha256#ssh.com,hmac-sha384#ssh.com,hmac-sha512#ssh.com,crypticore-mac#ssh.com
INFO: kex: server: none,zlib
INFO: kex: server: none,zlib
INFO: kex: server:
INFO: kex: server:
**INFO: kex: client**: ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group14-sha1,diffie-hellman-group-exchange-sha256,diffie-hellman-group-exchange-sha1,diffie-hellman-group1-sha1
INFO: kex: client: ssh-rsa,ssh-dss,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521
INFO: kex: client: aes256-ctr,aes192-ctr,arcfour,arcfour128,arcfour256,aes128-ctr,aes128-cbc,3des-ctr,3des-cbc,blowfish-cbc,aes192-cbc,aes256-cbc
INFO: kex: client: aes256-ctr,aes192-ctr,arcfour,arcfour128,arcfour256,aes128-ctr,aes128-cbc,3des-ctr,3des-cbc,blowfish-cbc,aes192-cbc,aes256-cbc
INFO: kex: client: hmac-md5,hmac-sha1,hmac-sha2-256,hmac-sha1-96,hmac-md5-96
INFO: kex: client: hmac-md5,hmac-sha1,hmac-sha2-256,hmac-sha1-96,hmac-md5-96
INFO: kex: client: none
INFO: kex: client: none
INFO: kex: client:
INFO: kex: client:
INFO: kex: server->client aes256-ctr hmac-md5 none
INFO: kex: client->server aes256-ctr hmac-md5 none
INFO: SSH_MSG_KEXDH_INIT sent
INFO: expecting SSH_MSG_KEXDH_REPLY
INFO: ssh_rsa_verify: signature true
INFO: Permanently added '160.58.9.72' (RSA) to the list of known hosts.
INFO: SSH_MSG_NEWKEYS sent
INFO: SSH_MSG_NEWKEYS received
INFO: SSH_MSG_SERVICE_REQUEST sent
INFO: SSH_MSG_SERVICE_ACCEPT received
INFO: Authentications that can continue: publickey,keyboard-interactive,password
INFO: Next authentication method: publickey
INFO: Authentications that can continue: keyboard-interactive,password
INFO: Next authentication method: keyboard-interactive
INFO: Authentication succeeded (keyboard-interactive).
I've tried to set the SHA256 algorithm by putting the same algorithms in the same order as the server logs without success:
config.put("kex", "diffie-hellman-group14-sha256#ssh.com,diffie-hellman-group-exchange-sha256,diffie-hellman-group1-sha1,diffie-hellman-group14-sha1,diffie-hellman-group-exchange-sha1");
Log when algorithm order is the same
INFO: Connecting to X.X.X.X port 22
INFO: Connection established
INFO: Remote version string: SSH-2.0-6.4.13.36 SSH Tectia Server
INFO: Local version string: SSH-2.0-JSCH-0.1.53
INFO: CheckCiphers: aes256-ctr,aes192-ctr,aes128-ctr,aes256-cbc,aes192-cbc,aes128-cbc,3des-ctr,arcfour,arcfour128,arcfour256
INFO: CheckKexes: diffie-hellman-group14-sha1,ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521
INFO: CheckSignatures: ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521
INFO: SSH_MSG_KEXINIT sent
INFO: SSH_MSG_KEXINIT received
INFO: kex: server: diffie-hellman-group14-sha256#ssh.com,diffie-hellman-group-exchange-sha256,diffie-hellman-group1-sha1,diffie-hellman-group14-sha1,diffie-hellman-group-exchange-sha1
INFO: kex: server: ssh-rsa,ssh-rsa-sha256#ssh.com
INFO: kex: server: aes128-ctr,aes192-ctr,aes256-ctr,3des-cbc,crypticore128#ssh.com
INFO: kex: server: aes128-ctr,aes192-ctr,aes256-ctr,3des-cbc,crypticore128#ssh.com
INFO: kex: server: hmac-sha2-256,hmac-sha2-512,hmac-md5,hmac-sha256-2#ssh.com,hmac-sha224#ssh.com,hmac-sha256#ssh.com,hmac-sha384#ssh.com,hmac-sha512#ssh.com,crypticore-mac#ssh.com
INFO: kex: server: hmac-sha2-256,hmac-sha2-512,hmac-md5,hmac-sha256-2#ssh.com,hmac-sha224#ssh.com,hmac-sha256#ssh.com,hmac-sha384#ssh.com,hmac-sha512#ssh.com,crypticore-mac#ssh.com
INFO: kex: server: none,zlib
INFO: kex: server: none,zlib
INFO: kex: server:
INFO: kex: server:
INFO: kex: client: ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group14-sha1,diffie-hellman-group-exchange-sha256,diffie-hellman-group-exchange-sha1,diffie-hellman-group1-sha1
INFO: kex: client: ssh-rsa,ssh-dss,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521
INFO: kex: client: aes256-ctr,aes192-ctr,arcfour,arcfour128,arcfour256,aes128-ctr,aes128-cbc,3des-ctr,3des-cbc,blowfish-cbc,aes192-cbc,aes256-cbc
INFO: kex: client: aes256-ctr,aes192-ctr,arcfour,arcfour128,arcfour256,aes128-ctr,aes128-cbc,3des-ctr,3des-cbc,blowfish-cbc,aes192-cbc,aes256-cbc
INFO: kex: client: hmac-md5,hmac-sha1,hmac-sha2-256,hmac-sha1-96,hmac-md5-96
INFO: kex: client: hmac-md5,hmac-sha1,hmac-sha2-256,hmac-sha1-96,hmac-md5-96
INFO: kex: client: none
INFO: kex: client: none
INFO: kex: client:
INFO: kex: client:
INFO: kex: server->client aes256-ctr hmac-md5 none
INFO: kex: client->server aes256-ctr hmac-md5 none
INFO: SSH_MSG_KEXDH_INIT sent
INFO: expecting SSH_MSG_KEXDH_REPLY
INFO: ssh_rsa_verify: signature true
INFO: Permanently added 'X.X.X.X' (RSA) to the list of known hosts.
INFO: SSH_MSG_NEWKEYS sent
INFO: SSH_MSG_NEWKEYS received
INFO: SSH_MSG_SERVICE_REQUEST sent
INFO: SSH_MSG_SERVICE_ACCEPT received
INFO: Authentications that can continue: publickey,keyboard-interactive,password
INFO: Next authentication method: publickey
INFO: Authentications that can continue: keyboard-interactive,password
INFO: Next authentication method: keyboard-interactive
INFO: Authentication succeeded (keyboard-interactive).
INFO: Disconnecting from X.X.X.X port 22
INFO: Caught an exception, leaving main loop due to Socket closed

Firebase Deploy "An unexpected error has occurred"

Trying to deploy a new site to Firebase (as I've done a dozen times, though haven't for a few months). Everything is going fine, but then when I get to "Firebase Deploy", I get "Error: An unexpected error has occurred". I've tried the suggestions given where a similar question was asked earlier ("An unexpected error has occurred" after firebase deploy) but none of them have done any good (keep getting the same error). Firebase is updated. Running on a Linux 64-bit (if it matters). I ran a debug on the deploy, and got the following log:
[debug] [2018-12-11T21:45:26.441Z] ----------------------------------------------------------------------
[debug] [2018-12-11T21:45:26.443Z] Command: /home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/node/bin/node /home/myName/.nvm/versions/node/v8.9.4/bin/firebase deploy
[debug] [2018-12-11T21:45:26.443Z] CLI Version: 3.18.5
[debug] [2018-12-11T21:45:26.443Z] Platform: linux
[debug] [2018-12-11T21:45:26.443Z] Node Version: v10.3.0
[debug] [2018-12-11T21:45:26.443Z] Time: Tue Dec 11 2018 14:45:26 GMT-0700 (MST)
[debug] [2018-12-11T21:45:26.443Z] ----------------------------------------------------------------------
[debug]
[debug] [2018-12-11T21:45:26.448Z] > command requires scopes: ["email","openid","https://www.googleapis.com/auth/cloudplatformprojects.readonly","https://www.googleapis.com/auth/firebase","https://www.googleapis.com/auth/cloud-platform"]
[debug] [2018-12-11T21:45:26.448Z] > authorizing via signed-in user
[debug] [2018-12-11T21:45:26.449Z] > refreshing access token with scopes: ["email","https://www.googleapis.com/auth/cloud-platform","https://www.googleapis.com/auth/cloudplatformprojects.readonly","https://www.googleapis.com/auth/firebase","open
[debug] [2018-12-11T21:45:26.450Z] >>> HTTP REQUEST POST https://www.googleapis.com/oauth2/v3/token
{ refresh_token: '1/9RM51tbmmz5VrjkpAxad-5CElD29bDNC-Dyu-L6-9hw',
client_id:
'563584335869-fgrhgmd47bqnekij5i8b5pr03ho849e6.apps.googleusercontent.com',
client_secret: 'j9iVZfS8kkCEFUPaAeJV0sAi',
grant_type: 'refresh_token',
scope:
'email https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/cloudplatformprojects.readonly https://www.googleapis.com/auth/firebase openid' }
Tue Dec 11 2018 14:45:26 GMT-0700 (MST)
[debug] [2018-12-11T21:45:26.674Z] <<< HTTP RESPONSE 200
[debug] [2018-12-11T21:45:27.581Z] >>> HTTP REQUEST GET https://admin.firebase.com/v1/projects/my-home-page-ed336
Tue Dec 11 2018 14:45:27 GMT-0700 (MST)
[debug] [2018-12-11T21:45:27.871Z] <<< HTTP RESPONSE 200
[debug] [2018-12-11T21:45:27.873Z] >>> HTTP REQUEST GET https://admin.firebase.com/v1/database/my-home-page-ed336/tokens
Tue Dec 11 2018 14:45:27 GMT-0700 (MST)
[debug] [2018-12-11T21:45:28.270Z] <<< HTTP RESPONSE 200
[info]
[info] === Deploying to 'my-home-page-ed336'...
[info]
[info] i deploying hosting
[info] i hosting: preparing . directory for upload...
[debug] [2018-12-11T21:45:28.733Z] >>> HTTP REQUEST PUT https://deploy.firebase.com/v1/hosting/my-home-page-ed336/uploads/-LTUDqAhHObNxZ0HsRuG?fileCount=114&message=
Tue Dec 11 2018 14:45:28 GMT-0700 (MST)
[debug] [2018-12-11T21:45:36.863Z] <<< HTTP RESPONSE 410
[debug] [2018-12-11T21:45:36.864Z] <<< HTTP RESPONSE BODY undefined
[debug] [2018-12-11T21:45:36.867Z] TypeError: Cannot read property 'error' of undefined
at module.exports (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/lib/responseToError.js:10:13)
at Request._callback (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/lib/api.js:47:25)
at Request.self.callback (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/node_modules/request/request.js:185:22)
at Request.emit (events.js:182:13)
at Request.EventEmitter.emit (domain.js:442:20)
at Request.<anonymous> (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/node_modules/request/request.js:1157:10)
at Request.emit (events.js:182:13)
at Request.EventEmitter.emit (domain.js:442:20)
at IncomingMessage.<anonymous> (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/node_modules/request/request.js:1079:12)
at Object.onceWrapper (events.js:273:13)
[error]
[error] Error: An unexpected error has occurred.
[debug] [2018-12-11T21:45:49.697Z] ----------------------------------------------------------------------
[debug] [2018-12-11T21:45:49.699Z] Command: /home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/node/bin/node /home/myName/.nvm/versions/node/v8.9.4/bin/firebase deploy --debug
[debug] [2018-12-11T21:45:49.700Z] CLI Version: 3.18.5
[debug] [2018-12-11T21:45:49.700Z] Platform: linux
[debug] [2018-12-11T21:45:49.700Z] Node Version: v10.3.0
[debug] [2018-12-11T21:45:49.700Z] Time: Tue Dec 11 2018 14:45:49 GMT-0700 (MST)
[debug] [2018-12-11T21:45:49.700Z] ----------------------------------------------------------------------
[debug]
[debug] [2018-12-11T21:45:49.705Z] > command requires scopes: ["email","openid","https://www.googleapis.com/auth/cloudplatformprojects.readonly","https://www.googleapis.com/auth/firebase","https://www.googleapis.com/auth/cloud-platform"]
[debug] [2018-12-11T21:45:49.705Z] > authorizing via signed-in user
[debug] [2018-12-11T21:45:49.707Z] >>> HTTP REQUEST GET https://admin.firebase.com/v1/projects/my-home-page-ed336
Tue Dec 11 2018 14:45:49 GMT-0700 (MST)
[debug] [2018-12-11T21:45:50.018Z] <<< HTTP RESPONSE 200
[debug] [2018-12-11T21:45:50.021Z] >>> HTTP REQUEST GET https://admin.firebase.com/v1/database/my-home-page-ed336/tokens
Tue Dec 11 2018 14:45:50 GMT-0700 (MST)
[debug] [2018-12-11T21:45:50.315Z] <<< HTTP RESPONSE 200
[info]
[info] === Deploying to 'my-home-page-ed336'...
[info]
[info] i deploying hosting
[info] i hosting: preparing . directory for upload...
[debug] [2018-12-11T21:45:50.768Z] >>> HTTP REQUEST PUT https://deploy.firebase.com/v1/hosting/my-home-page-ed336/uploads/-LTUDvYyTmVMnTOVgYO3?fileCount=114&message=
Tue Dec 11 2018 14:45:50 GMT-0700 (MST)
[debug] [2018-12-11T21:45:57.867Z] <<< HTTP RESPONSE 410
[debug] [2018-12-11T21:45:57.868Z] <<< HTTP RESPONSE BODY undefined
[debug] [2018-12-11T21:45:57.871Z] TypeError: Cannot read property 'error' of undefined
at module.exports (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/lib/responseToError.js:10:13)
at Request._callback (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/lib/api.js:47:25)
at Request.self.callback (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/node_modules/request/request.js:185:22)
at Request.emit (events.js:182:13)
at Request.EventEmitter.emit (domain.js:442:20)
at Request.<anonymous> (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/node_modules/request/request.js:1157:10)
at Request.emit (events.js:182:13)
at Request.EventEmitter.emit (domain.js:442:20)
at IncomingMessage.<anonymous> (/home/myName/.nvm/versions/node/v8.9.4/lib/node_modules/firebase-tools/node_modules/request/request.js:1079:12)
at Object.onceWrapper (events.js:273:13)
[error]
[error] Error: An unexpected error has occurred.
Thanks for everyone's help!
Your Firebase CLI is very old. Update it with npm install -g firebase-tools. Latest version at this moment is 6.1.2.
update your firebase CLI with this command
npm install -g firebase-tools
then initialize your firebase with
firebase init
Now its time to deploy the project
firebase deploy

Openstack unable to create instance due neutron connection error

I am trying to do a manual install of openstack. I am not able to create an instance. I followed the documention but i am still getting errors. Anyone willing to help me getting openstack started. Much appreciated
If i reload the website it does show up
apache error.log
Timeout when reading response headers from daemon process 'horizon': /usr/share/openstack-dashboard/openstack_dashboard/wsgi.py, referer: http://192.168.1.100/horizon/project/instances/
Neutron-server.log
2018-11-07 18:07:52.655 31285 DEBUG neutron.wsgi [-] (31285) accepted ('192.168.1.100', 35802) server /usr/local/lib/python2.7/dist-packages/eventlet/wsgi.py:956
2018-11-07 18:07:52.799 31285 DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b499140-3f8f-471c-8bdf-2c377170e782 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] Attributes excluded by policy engine: [u'is_default', u'vlan_transparent'] _exclude_attributes_by_policy /usr/lib/python2.7/dist-packages/neutron/pecan_wsgi/hooks/policy_enforcement.py:256
2018-11-07 18:07:52.801 31285 INFO neutron.wsgi [req-9b499140-3f8f-471c-8bdf-2c377170e782 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] 192.168.1.100 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 866 time: 0.1453359
2018-11-07 18:07:52.817 31286 DEBUG neutron.wsgi [-] (31286) accepted ('192.168.1.100', 35808) server /usr/local/lib/python2.7/dist-packages/eventlet/wsgi.py:956
2018-11-07 18:07:52.959 31286 INFO neutron.wsgi [req-044501ca-4e30-4871-81f1-5b979b859277 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] 192.168.1.100 "GET /v2.0/ports?network_id=fb280ae3-bc89-4922-bd85-391c79967ae8 HTTP/1.1" status: 200 len: 1804 time: 0.1413569
2018-11-07 18:08:03.763 31286 INFO neutron.wsgi [req-b48c285d-e875-4a93-ad2e-d810e407d46c b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] 192.168.1.100 "GET /v2.0/security-groups?fields=id&id=26ee0adb-06a9-49a1-a134-7058131ad216 HTTP/1.1" status: 200 len: 267 time: 0.0607591
2018-11-07 18:08:03.819 31286 INFO neutron.wsgi [req-959eb0d0-b302-4aa0-a57f-226133b7c9d3 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] 192.168.1.100 "GET /v2.0/security-groups/26ee0adb-06a9-49a1-a134-7058131ad216 HTTP/1.1" status: 200 len: 2631 time: 0.0522490
2018-11-07 18:08:03.989 31286 DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514f65e7-6aed-42c5-aef8-9863650f8253 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] Attributes excluded by policy engine: [u'is_default', u'vlan_transparent'] _exclude_attributes_by_policy /usr/lib/python2.7/dist-packages/neutron/pecan_wsgi/hooks/policy_enforcement.py:256
2018-11-07 18:08:03.991 31286 INFO neutron.wsgi [req-514f65e7-6aed-42c5-aef8-9863650f8253 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] 192.168.1.100 "GET /v2.0/networks?id=fb280ae3-bc89-4922-bd85-391c79967ae8 HTTP/1.1" status: 200 len: 866 time: 0.1661508
2018-11-07 18:08:04.007 31286 INFO neutron.wsgi [req-ff26e06a-3ec7-4232-a1f8-0ddbcdafead1 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] 192.168.1.100 "GET /v2.0/quotas/85ee25734f664d6d822379674c93da44 HTTP/1.1" status: 200 len: 341 time: 0.0136049
2018-11-07 18:08:04.085 31286 INFO neutron.wsgi [req-b5797013-aab1-440f-b7c4-f0e8f8571a30 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] 192.168.1.100 "GET /v2.0/ports?fields=id&tenant_id=85ee25734f664d6d822379674c93da44 HTTP/1.1" status: 200 len: 255 time: 0.0731540
2018-11-07 18:08:04.998 31286 DEBUG neutron.wsgi [req-f3e3f7d8-daa4-4464-ab4a-430cbf2dee58 5673e5fcc9ff4029b9a72e32310570fb 6e60623ffbbe49fb94cc0eade1d4f6e3 - default default] http://controller:9696/v2.0/extensions returned with HTTP 200 __call__ /usr/lib/python2.7/dist-packages/neutron/wsgi.py:715
2018-11-07 18:08:05.000 31286 INFO neutron.wsgi [req-f3e3f7d8-daa4-4464-ab4a-430cbf2dee58 5673e5fcc9ff4029b9a72e32310570fb 6e60623ffbbe49fb94cc0eade1d4f6e3 - default default] 192.168.1.100 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 7807 time: 0.3759091
2018-11-07 18:08:05.118 31286 INFO neutron.wsgi [req-c8c02b81-6a39-4a1a-813c-8eeaffee2d53 5673e5fcc9ff4029b9a72e32310570fb 6e60623ffbbe49fb94cc0eade1d4f6e3 - default default] 192.168.1.100 "GET /v2.0/networks/fb280ae3-bc89-4922-bd85-391c79967ae8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1159072
2018-11-07 18:08:05.243 31286 INFO neutron.wsgi [req-17890f41-07cc-4e53-998d-feb6443e3515 5673e5fcc9ff4029b9a72e32310570fb 6e60623ffbbe49fb94cc0eade1d4f6e3 - default default] 192.168.1.100 "GET /v2.0/networks/fb280ae3-bc89-4922-bd85-391c79967ae8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1205151
2018-11-07 18:08:19.218 31289 DEBUG neutron.db.agents_db [req-68b39ef4-218e-442f-ab21-f2b8442bdb65 - - - - -] Agent healthcheck: found 0 active agents agent_health_check /usr/lib/python2.7/dist-packages/neutron/db/agents_db.py:326
2018-11-07 18:08:56.222 31289 DEBUG neutron.db.agents_db [req-68b39ef4-218e-442f-ab21-f2b8442bdb65 - - - - -] Agent healthcheck: found 0 active agents agent_health_check /usr/lib/python2.7/dist-packages/neutron/db/agents_db.py:326
neutron log file after trying to create a floating ip
0dfe9c3 HTTP/1.1" status: 200 len: 825 time: 0.0563171
2018-11-07 18:20:54.655 31285 DEBUG neutron.wsgi [-] (31285) accepted ('192.168.1.100', 37282) server /usr/local/lib/python2.7/dist-packages/eventlet/wsgi.py:956
2018-11-07 18:20:54.660 31285 WARNING neutron.pecan_wsgi.controllers.root [req-6081c61f-abf0-4f97-9f00-5a2a4870fca4 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] No controller found for: floatingips - returning response code 404: PecanNotFound
2018-11-07 18:20:54.661 31285 INFO neutron.pecan_wsgi.hooks.translation [req-6081c61f-abf0-4f97-9f00-5a2a4870fca4 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] POST failed (client error): The resource could not be found.
2018-11-07 18:20:54.661 31285 DEBUG neutron.pecan_wsgi.hooks.notifier [req-6081c61f-abf0-4f97-9f00-5a2a4870fca4 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] Skipping NotifierHook processing as there was no resource associated with the request after /usr/lib/python2.7/dist-packages/neutron/pecan_wsgi/hooks/notifier.py:74
2018-11-07 18:20:54.662 31285 INFO neutron.wsgi [req-6081c61f-abf0-4f97-9f00-5a2a4870fca4 b2e32e162a664ad0afd1a0c34643cd0c 85ee25734f664d6d822379674c93da44 - default default] 192.168.1.100 "POST /v2.0/floatingips HTTP/1.1" status: 404

firebase init gives EPROTO error

Running firebase init command gives an EPROTO error. Same error when I try firebase list. I can successfully use firebase login though. Here is the output of the firebase.debug.log:
[debug] ----------------------------------------------------------------------
[debug] Command: C:\Program Files\nodejs\node.exe C:\Users\andre\AppData\Roaming\npm\node_modules\firebase-tools\bin\firebase init
[debug] CLI Version: 3.13.1
[debug] Platform: win32
[debug] Node Version: v8.8.1
[debug] Time: Sat Oct 28 2017 12:35:18 GMT+0100 (GMT Summer Time)
[debug] ----------------------------------------------------------------------
[debug]
[debug] > command requires scopes: ["email","openid","https://www.googleapis.com/auth/cloudplatformprojects.readonly","https://www.googleapis.com/auth/firebase"]
[debug] [2017-10-28T11:35:18.899Z] > authorizing via signed-in user
You're about to initialize a Firebase project in this directory:
C:\Users\andre\Documents\cake-poly20-test
[info]
=== Project Setup
[info]
[info] First, let's associate this project directory with a Firebase project.
[info] You can create multiple project aliases by running firebase use --add,
[info] but for now we'll just set up a default project.
[info]
[debug] > refreshing access token with scopes: ["email","https://www.googleapis.com/auth/cloudplatformprojects.readonly","https://www.googleapis.com/auth/firebase","openid"]
[debug] >>> HTTP REQUEST POST https://www.googleapis.com/oauth2/v3/token { refresh_token: '<token>',
client_id: '<clientid>.apps.googleusercontent.com',
client_secret: '<secret>',
grant_type: 'refresh_token',
scope: 'email https://www.googleapis.com/auth/cloudplatformprojects.readonly https://www.googleapis.com/auth/firebase openid' }
Sat Oct 28 2017 12:35:25 GMT+0100 (GMT Summer Time)
[debug] <<< HTTP RESPONSE 200
[debug] >>> HTTP REQUEST GET https://admin.firebase.com/v1/projects
Sat Oct 28 2017 12:35:25 GMT+0100 (GMT Summer Time)
[debug] Error: write EPROTO 101057795:error:140773E8:SSL routines:SSL23_GET_SERVER_HELLO:reason(1000):openssl\ssl\s23_clnt.c:772:
at _errnoException (util.js:1024:11)
at WriteWrap.afterWrite [as oncomplete] (net.js:870:14)
[error]
[error] Error: Server Error. write EPROTO 101057795:error:140773E8:SSL routines:SSL23_GET_SERVER_HELLO:reason(1000):openssl\ssl\s23_clnt.c:772:
Cause:
Eventually I found that my ISP had updated its so-called Kids Safe security settings and was treating admin.firebase.com as a blocked file sharing site.
Solution:
I updated my settings in the ISPs config, so that access to firebase.com was always allowed. Now firebase init, firebase list etc are working fine.

Plone Switching to ZRS using plone.recipe.zeoserver on Plone 4.3.1

I'm working on setting up a Zope Replicated Storage (ZRS) based deployment. I currently have two servers (east and west)
west will be the primary
east will be the secondary
I haven't touched the west box yet. On the east box I've edited my buildout as follows (I had to pin plone.recipe.zeoserver to 1.2.6 because the zrs features didn't exist before version 1.2.6):
[zeoserver]
recipe = plone.recipe.zeoserver[zrs]
replicate-from = ${hosts:zeoserver-west}:${ports:zeoserver-zrs}
[versions]
plone.recipe.zeoserver = 1.2.6
After running
bin/buildout
I try to start my cluster and the instances seem to hang. A debugging instance now gives me the following output:
2013-09-11 08:24:00 INFO ZServer HTTP server started at Wed Sep 11 08:24:00 2013
Hostname: localhost
Port: 7680
2013-09-11 08:24:02 INFO Products.PloneFormGen gpg_subprocess initialized, using /usr/bin/gpg
2013-09-11 08:24:02 INFO DeadlockDebugger Not activated, you must change ACTIVATED in custom.py
2013-09-11 08:24:02 INFO ZEO.ClientStorage zeostorage ClientStorage (pid=22802) created RW/normal for storage: '1'
2013-09-11 08:24:02 INFO ZEO.cache created temporary cache file '<fdopen>'
2013-09-11 08:24:02 INFO ZEO.ClientStorage zeostorage Testing connection <ManagedClientConnection ('127.0.0.1', 7600)>
2013-09-11 08:24:02 INFO ZEO.zrpc.Connection(C) (127.0.0.1:7600) received handshake 'Z3101'
2013-09-11 08:24:02 INFO ZEO.ClientStorage zeostorage Server authentication protocol None
2013-09-11 08:24:02 INFO ZEO.zrpc.Connection(C) (127.0.0.1:7600) received handshake 'Z3101'
2013-09-11 08:24:02 INFO ZEO.ClientStorage zeostorage Testing connection <ManagedClientConnection ('127.0.0.1', 7600)>
2013-09-11 08:24:02 INFO ZEO.ClientStorage zeostorage Server authentication protocol None
2013-09-11 08:24:02 INFO ZEO.zrpc.Connection(C) (127.0.0.1:7600) received handshake 'Z3101'
2013-09-11 08:24:02 INFO ZEO.ClientStorage zeostorage Testing connection <ManagedClientConnection ('127.0.0.1', 7600)>
2013-09-11 08:24:02 INFO ZEO.ClientStorage zeostorage Server authentication protocol None
2013-09-11 08:24:07 INFO ZEO.ClientStorage zeostorage Testing connection <ManagedClientConnection ('127.0.0.1', 7600)>
2013-09-11 08:24:07 INFO ZEO.zrpc.Connection(C) (127.0.0.1:7600) received handshake 'Z3101'
2013-09-11 08:24:07 INFO ZEO.ClientStorage zeostorage Server authentication protocol None
2013-09-11 08:24:07 INFO ZEO.zrpc.Connection(C) (127.0.0.1:7600) received handshake 'Z3101'
2013-09-11 08:24:07 INFO ZEO.ClientStorage zeostorage Testing connection <ManagedClientConnection ('127.0.0.1', 7600)>
2013-09-11 08:24:07 INFO ZEO.ClientStorage zeostorage Server authentication protocol None
2013-09-11 08:24:07 INFO ZEO.zrpc.Connection(C) (127.0.0.1:7600) received handshake 'Z3101'
2013-09-11 08:24:07 INFO ZEO.ClientStorage zeostorage Testing connection <ManagedClientConnection ('127.0.0.1', 7600)>
2013-09-11 08:24:07 INFO ZEO.ClientStorage zeostorage Server authentication protocol None
I've copied the Data.fs over so it's available on east.
I'm wondering if this has anything to do with the primary ZRS not being up yet.
This is my first initial test and I just wanted to see the secondary working before setting up the primary.
If I removing the zrs settings and rebuild buildout the cluster starts without issue.
Make sure that you also set the "east" clients read-only. That option was added to plone.recipe.zope2instance in version 4.2.12.
It's the "read-only" option in the definition of a basic ZEO storage.
Anything in the zeoserver log?
I assume that's not your full zeoserver configuration correct? The ZRS replication runs on an additional port to the zeoserver so you still need to specify zeoserver host and port.
Additionally, run the replicated server in read-only mode and start from an empty database--you don't need to sync the database to start off, zrs will sync all up once it's running.

Resources