scrapy shell 'https://www.amazon.com/'
I got an error like below:
twisted.internet.error.DNSLookupError: DNS lookup failed: address "'https:" [![enter image description here][1]][1]not found: [Errno 11004] getaddrinfo failed.
and this is my below version of my scrapy version:
C:\>scrapy version -v
Scrapy : 1.1.0
lxml : 3.6.0.0
libxml2 : 2.9.0
Twisted : 16.2.0
Python : 2.7.11 (v2.7.11:6d1b6a68f775, Dec 5 2015, 20:32:19) [MSC v.1500 32
bit (Intel)]
pyOpenSSL : 16.0.0 (OpenSSL 1.0.2h 3 May 2016)
Platform : Windows-7-6.1.7601-SP1
help is appreciated, Thank you.
Related
I have installed the Snowflake ODBC driver on Ubuntu 20 (Focal) successfully before, and it works fine. After installing the same packages on a new Ubuntu 22 (Jammy) system, the Snowflake ODBC driver refuses to connect, with this error:
$ isql -v snowflake-dev <redacted> <redacted>
[S1000][unixODBC][Snowflake][ODBC] (11560) Unable to locate SQLGetPrivateProfileString function.
[ISQL]ERROR: Could not SQLConnect
The same command works fine on Ubuntu 20.
Here are the relevant bits of my config files (which of course are the same on the two systems):
/etc/odbc.ini:
[snowflake-dev]
Description=SnowflakeDB
Driver=SnowflakeDSIIDriver
Locale=en-US
SERVER=<redacted>.east-us-2.azure.snowflakecomputing.com
PORT=443
SSL=on
ACCOUNT=<redacted>
/etc/odbcinst.ini:
[SnowflakeDSIIDriver]
APILevel=1
ConnectFunctions=YYY
Description=Snowflake DSII
Driver=/usr/lib/snowflake/odbc/lib/libSnowflake.so
DriverODBCVer=03.52
SQLLevel=1
UsageCount=1
and the driver file does exist in that directory:
$ ls -l /usr/lib/snowflake/odbc/lib/libSnowflake.so*
-rwxr-xr-x 1 root root 177405464 Aug 1 15:14 /usr/lib/snowflake/odbc/lib/libSnowflake.so
$ file /usr/lib/snowflake/odbc/lib/libSnowflake.so*
/usr/lib/snowflake/odbc/lib/libSnowflake.so: ELF 64-bit LSB shared object, x86-64, version 1 (GNU/Linux), dynamically linked, BuildID[sha1]=61282db74b8db4d446540d7f53458245a6ef6997, with debug_info, not stripped
Am I missing something essential? Is there something new required on Ubuntu 22 that wasn't before?
I found that the file /usr/lib/x86_64-linux-gnu/libodbcinst.so.1 did not exist on my system. I changed the file <snowflake path>/lib/simba.snowflake.ini to point to /usr/lib/x86_64-linux-gnu/libodbcinst.so.2 instead, and now it works.
I am doing an upgrade from Cloudera CM 5.16 to CM 7.1.2. There is an instruction to enter userid:password in the url in the /etc/yum.repos.d/cloudera-manager.repo file when using the Cloudera public repository:
Substitute your USERNAME and PASSWORD in the Package Repository URL where indicated in the URL:
baseurl=https://USERID:PASSWORD#archive.cloudera.com/p/cm7/7.1.2/redhat6/yum/.
After setting this and running the command: yum deplist cloudera-manager-agent
it gives an error below:
........#archive.cloudera.com/p/cm7/7.1.2/redhat6/yum/repodata/repomd.xml: [Errno 14] PYCURL ERROR 6 - "Couldn't resolve host 'xyz.com:password#archive.cloudera.com'"
Anyone seen this error and how to resolve. Thanks!
Found out that the USERID:PASSWORD in the url will be provided by Cloudera after license is purchased.
I try to connect with Selenium in R using the Chrome browser on Win10.
I installed Chrome 74.0.3729.61 and added the chrome.exe path to the Environment Variables.
devtools::install_github("johndharrison/seleniumPipes")
devtools::install_github("ropensci/Rselenium")
#start selenium
selServ <- selenium()
# check ports
selServ$log()$stderr
# conect using port
sel <- remoteDr(browserName = "chrome", port = 4567)
gives me the following error message:
Called newSession - Try no: 1 of 3
Called newSession - Try no: 2 of 3
Called newSession - Try no: 3 of 3
Error detected:
Response status code : 500
Selenium Status code: 13
Selenium Status summary: UnknownError
Selenium Status detail: An unknown server-side error occurred while processing the command.
Selenium message: unknown error: cannot find Chrome binary
(Driver info: chromedriver=74.0.3729.6 (255758eccf3d244491b8a1317aa76e1ce10d57e9-refs/branch-heads/3729#{#29}),platform=Windows NT 10.0.17134 x86_64) (WARNING: The server did not provide any stacktrace information)
Command duration or timeout: 40 milliseconds
Build info: version: '3.141.59', revision: 'e82be7d358', time: '2018-11-14T08:25:53'
System info: host: ... , os.name: 'Windows 10', os.arch: 'amd64', os.version: '10.0', java.version: '1.8.0_201'
Driver info: driver.version: unknown
Please check the response with errorResponse()
Please check the content returned with errorContent()
I found some guidance for Python (Cannot find Chrome binary with Selenium in Python for older versions of Google Chrome) and c# (Selenium WebDriver - Could not find Chrome binary), however, I do not know how to implement it in R.
IMHO you need to download and run chomedriver.exe(if you are using Windows 10, as you mentioned) before to use selenium.
Could you try below solution?
Solution 1. on command window
java -Dwebdriver.chrome.driver="C:/{yourPath}/selenium/chromedriver.exe" -jar "C:/{yourPath}/selenium/selenium-server-standalone-3.141.59.jar" -port 4567
or
Solution 2. direct use R script
rstudioapi::terminalExecute('java -Dwebdriver.chrome.driver="C:/{yourPath}/selenium/chromedriver.exe" -jar "C:/{yourPath}/selenium/selenium-server-standalone-3.141.59.jar" -port 4567')
Yes, both are same command exactly. You are able to use anyone you want.
After following the instructions from http://crashthatch.tumblr.com/post/66957708538/teradata-odbc-connection-using-python-on-ubuntu, installed 15.00.05.14 version of teradata odbc version.
>>> import pyodbc
>>> pyodbc.pooling = False
>>> pyodbc.connect('DRIVER={Teradata};DBCNAME=teradata.xx.xxx.com;UID=myname;PWD=pwd;QUIETMODE=YES;')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
pyodbc.OperationalError: ('HYT00', '[HYT00] [Teradata][Unix system error] 110 Socket error - No response received when attempting to connect to the Teradata server (110) (SQLDriverConnect)')
$ odbcinst -j
unixODBC 2.2.14
odbcinst: symbol lookup error: odbcinst: undefined symbol: odbcinst_system_file_name
$ python -c "import pyodbc; print pyodbc.version"
3.0.6
what should be the workaround for this problem?
Check if the Teradata machine is reachable via the network.
I'm running into some trouble to get my intel i965 driver working with vaapi support.
Currently the vaapi support is only working as root user. If I run vaainfo as non root user I get the following message:
[heiko#localhost ~]$ /bin/vainfo
libva info: VA-API version 0.34.0
libva info: va_getDriverName() returns 1
libva error: va_getDriverName() failed with operation failed,driver_name=i965
vaInitialize failed with error code 1 (operation failed),exit
with root permissions (everything looks fine vlc is working fine with vaapi):
[heiko#localhost ~]$ sudo vainfo
libva info: VA-API version 0.34.0
libva info: va_getDriverName() returns 0
libva info: Trying to open /usr/lib/dri/i965_drv_video.so
libva info: Found init function __vaDriverInit_0_34
libva info: va_openDriver() returns 0
vainfo: VA-API version: 0.34 (libva 1.2.1)
vainfo: Driver version: Intel i965 driver - 1.2.1.pre1
vainfo: Supported profile and entrypoints
VAProfileMPEG2Simple : VAEntrypointVLD
VAProfileMPEG2Main : VAEntrypointVLD
VAProfileH264Baseline : VAEntrypointVLD
VAProfileH264Main : VAEntrypointVLD
VAProfileH264High : VAEntrypointVLD
whats wrong with my installation??
[heiko#localhost ~]$ getfacl /dev/dri/card0
getfacl: Entferne führende '/' von absoluten Pfadnamen
# file: dev/dri/card0
# owner: root
# group: video
user::rw-
user:heiko:rw-
group::rw-
mask::rw-
other::rw-
I had the same problem when using E18 as my desktop environment.
Using gnome-shell solved the issue with vainfo for me.
Another workaround that I found was to unset the variable $XDG_RUNTIME_DIR.
unset XDG_RUNTIME_DIR
I have no idea why this helps, but it did make a difference for me.
I also found another possible workaround, but it did not work on my case:
https://software.intel.com/en-us/forums/topic/490090
Maybe it does work for you.
Add yourself to the video group and log in again:
sudo usermod -a -G video $USER
Then retest.