Closed. This question is not written in English. It is not currently accepting answers.
Stack Overflow is an English-only site. The author must be able to communicate in English to understand and engage with any comments and/or answers their question receives. Don't translate this post for the author; machine translations can be inaccurate, and even human translations can alter the intended meaning of the post.
Closed 3 days ago.
Improve this question
Hallo zusammen ich habe eine Homepage bei Typo3 über plsek als provider und würde gerne ein musterprojekt ohne ssh zugang hochladen und das extasions modul mit einspielen ?
wie geht das ohne ssh?
würde dieses jamnd machen können
es soll nicht für umsonstsein
die gänigen anleitung im internett versucht
Related
Hello StackOverflow community,
a few months ago, I created a scraper with python3 and html-requests together with BeautifulSoup in order to scrape car ads from https://www.mobile.de. The scraper uses the following search URL to fetch a list of all available car ads and later on iterates through the detail pages.
Please find below the code:
from bs4 import BeautifulSoup, SoupStrainer
from requests_html import HTMLSession
import re
url = 'https://suchen.mobile.de/fahrzeuge/search.html?&damageUnrepaired=NO_DAMAGE_UNREPAIRED&isSearchRequest=true&makeModelVariant1.makeId=25200&makeModelVariant1.modelId=g29&scopeId=C&sfmr=false'
session = HTMLSession()
r = session.get(url)
only_a_tags = SoupStrainer("a")
soup = BeautifulSoup(r.content,'lxml', parse_only=only_a_tags)
for link in soup.find_all('a', attrs={'href': re.compile("^https://suchen.mobile.de/fahrzeuge/details.html")}):
print (link.get("href"))
Since a few days, the scraper is not able to fetch car ads from the website anymore. When iterating through all tags in order to fetch the detail pages of the car ads (always like https://suchen.mobile.de/fahrzeuge/details.html), currently no results are shown. In the past, links to the car ad detail pages were printed.
I only receive following error message when printing the html content:
b'<!DOCTYPE html>\n<html>\n <!--\nLeider koennen wir Dir an dieser Stelle keinen Zugriff auf unsere Daten gewaehren.\nSolltest Du weiterhin Interesse an einem Bezug unserer Daten haben, wende Dich bitte an:\n\nUnfortunately, automated access to this page was denied.\nIf you are interested in accessing our data, please contact us:\n\nPhone:\n+49 (0) 30 8109-7573\n\nMail:\nDatenpartner#team.mobile.de\n -->\n <head>\n <meta charset="UTF-8">\n\n <title>Ups, bist Du ein Mensch? / Are you a human?</title>\n <link rel="stylesheet" href="https://static.classistatic.de/shared/mde-style/2.1.0/style.css">\n <link rel="icon" type="image/x-icon" href="data:image/x-icon;base64,AAABAAEAEBAAAAAAAABoBAAAFgAAACgAAAAQAAAAIAAAAAEAIAAAAAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAbJ7yGTV+7Msdbuv/hKzr6/347tLw8O/S8vLy0vPz89Ly8vLS8PDw0vDw79Lt7e3S6urqnNDQ0AQAAAAAXpbwGih27MEfcOv/DWbr/4iv7P//+vD/8vLy//X19f/29vb/9fX1//Pz8//y8vL/7+/v/+3t7f3q6em05OTkGTR97c4fcOv/H3Dr/w5m6/+Ir+z///rw//Ly8v/19fX/9vb2//X19f/z8/P/8vLy/+/v7//t7e3/6urq/+fn5s8hcev/H3Dr/x9w6/8OZuv/iK/s///67/////////////X19f////////////Hx8f/6+vr//v7+/+vr6//n5+f/H3Dr/x9w6/8fcOv/Dmbr/4iw7f///fX/nJ2d/5mamf/6+vr/pqen/4+Qj//4+Pj/ra6u/4WGhv/m5ub/6urq/x9w6/8fcOv/H3Dr/w5m6/+IsO3////8/y0vL/8iJCT//////0FCQv8OEBD//////1laWv8AAgL/4eHh/+3t7f8fcOv/H3Dr/x9w6/8OZuv/iLDt////+/88Pj7/MjQ0//////9PUFD/HyEh//////9kZWX/EhQU/+Li4v/t7e3/H3Dr/x9w6/8fcOv/Dmbr/4iw7f////v/PD4+/zI0NP//////T1BQ/x8hIf//////ZGVl/xIUFP/i4uL/7e3t/x9w6/8fcOv/H3Dr/w5m6/+IsO3////7/zw+Pv80Njb//////1JTU/8gIiL//////2hpaf8RExP/4uLi/+3t7f8fcOv/H3Dr/x9w6/8OZuv/iLDt////+/8/QED/ERMT/8XGxv8/QUH/BggI/7+/v/9KTEz/ExUV/+Tk5P/t7Oz/H3Dr/x9w6/8fcOv/Dmbr/4iw7f////r/SktL/y0vL/8oKir/AgMD/2FiYv82Nzf/AAAA/2BhYf/19fT/6Ojo/x9w6/8fcOv/H3Dr/w5m6/+Ir+z///rx/+jo6P/y8vL/7O3t/87Ozv/8/Pz/7e3t/8nJyf/v7u7/7Ozs/+fn5/8fcOv/H3Dr/x9w6/8OZuv/iK/s///68P/19fX/9/f3//n5+f/9/f3/9PT0//X19f/39/f/7u7u/+rq6v/n5+f/MXvs4x5w6/8fcOv/Dmbr/4iv7P//+vD/8vLy//X19f/29vb/9fX1//Pz8//y8vL/7+/v/+3t7f/q6ur/5+fmwU2M7yUoduzGH3Dr/w5m6/+Ir+z///rw//Ly8v/19fX/9vb2//X19f/z8/P/8vLy/+/v7//t7e3/6urpu+Pj4hMAAAAAc6PyGDN87McRaOv/hq7r//347f/v7+//8fHx//Ly8v/x8fH/8PDw/+/v7//t7e386+vqtuLi4RAAAAAAwAMAAIABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAQAAwAMAAA==">\n <script src=\'https://www.google.com/recaptcha/api.js\'></script>\n </head>\n <body>\n <header id="mdeHeader" class="header">\n <div class="header-meta-container header-hidden-small">\n <!-- placeholder for desktop meta -->\n </div>\n <div class="header-navbar clearfix">\n <div class="header-corporate">\n <i class="gicon-mobilede-logo"></i>\n <span class="claim header-hidden-small">Deutschlands gr\xc3\xb6\xc3\x9fter Fahrzeugmarkt</span>\n </div>\n </div>\n </header>\n <div class="g-container">\n <h2 class="u-pad-bottom-18 u-margin-top-18">Ups, bist Du ein Mensch? / Are you a human?</h2>\n\n\n <div id="root"></div>\n <div class="cBox cBox--content">\n <p><b>\n Um fortzufahren muss dein Browser Cookies unterst\xc3\xbctzen und JavaScript aktiviert sein.<br>\n To continue your browser has to accept cookies and has to have JavaScript enabled.</b>\n </p>\n\n <p>\n Bei Problemen wende Dich bitte an:<br>\n In case of problems please contact:\n </p>\n <p>\n Phone: 030 81097-601<br>\n Mail: service#team.mobile.de\n </p>\n\n <p>\n Sollte grunds\xc3\xa4tzliches Interesse am Bezug von mobile.de Daten bestehen, wende Dich bitte an:<br/>\n If you are primarily interested in purchasing data from mobile.de, please contact:\n </p>\n <p>\n Mail: Datenpartner#team.mobile.de\n </p>\n </div>\n <hr class="u-pad-top-9 u-pad-bottom-18"/>\n <div id="footer"></div>\n <script async src="https://www.mobile.de/api/consent/static/js/consentBanner.js"></script>\n <script type="text/javascript" src="https://www.mobile.de/youre-blocked/app.js"></script><script type="text/javascript" >var _cf = _cf || []; _cf.push([\'_setFsp\', true]); _cf.push([\'_setBm\', true]); _cf.push([\'_setAu\', \'/static/16b9372bb8fti233b6fc758bf7a4291f0\']); </script><script type="text/javascript" src="/static/16b9372bb8fti233b6fc758bf7a4291f0"></script></body>\n</html>\n'
When creating the scraper, I also received the "Unfortunately, automated access to this page was denied." message when using urrlib, hence I switched over to html-requests and everything worked great.
I already tried to solve it with following approaches, but none of them worked so far :(
proxy rotation (I thought my IP address might have been blocked)
different user agent in header via fake_useragent library
I hope you are able to help as I am currently don't know what else I could try.
Thanks a lot in advance for helping me with this issue :)
Use a Selenium Webdriver to first navigate to the search page and then run the query from there.
I just got the same message on my own machine when running your code. When I visit the site manually, I also see a reCAPTCHA. Even opening it directly with Selenium generates the reCAPTCHA.
Were I working to defeat you, I would just require the reCAPTCHA whenever a direct connection was made to search results. That would be my guess for how you are being blocked. When I use a WebDriver to first navigate to the search page, I do not get challenged.
Here is the code that I used.
from selenium import webdriver
driver = webdriver.Chrome()
driver.get("https://suchen.mobile.de/fahrzeuge/search.html")
driver.implicitly_wait(5000) #not good practice, but quick and easy
driver.find_element_by_id("gdpr-consent-accept-button").click()
driver.implicitly_wait(2000) #not good practice, but quick and easy
driver.find_element_by_id("fuels-PETROL-ds").click()
driver.implicitly_wait(2000) #not good practice, but quick and easy
driver.find_element_by_id("dsp-upper-search-btn").click()
This is not going to work forever, but it works at least for now.
EASON FOR SUSPENSION: Alleged trademark infringement.
Google has been notified that aspects of your app, TAMIL WHATSAPP STICKERS -STICKER POTTI WASTICKERS, allegedly infringe upon the trademarks of others, and it has been removed from Google Play due to a violation of the Developer Program Policies.
All violations are tracked. Serious or repeated violations of any nature will result in the termination of your developer account, and investigation and possible termination of related Google accounts. If your account is terminated, payments will cease and Google may recover the proceeds of any past sales and the cost of any associated fees (such as chargebacks and payment transaction fees) from you.
You may contact WhatsApp at gp.enforcements.prod#gmail.com. If WhatsApp contacts us specifically authorizing your app to be re-published, and your app does not otherwise violate the Developer Distribution Agreement and Developer Program Policies, we will reinstate the app.
Please note that we have included a text copy of the Infringement Notice we received for your reference. If you have any further concerns about this issue, please address them directly to the complainant in the Infringement Notice provided below.
The Google Play Team
Text Copy of Infringement Notice:
country_residence: US
full_name: Alexis Meghrouni Rivas
your_title: Director, Enforcement Strategies and Services
companyname: WhatsApp
contact_email_noprefill: enf.whatsapp.55116#enfappdetex.com
login_email: gp.enforcements.prod#gmail.com
address: 501 W. Grove Street
Boise
ID
83702
US
phone: +18722402777
trademark_relationship: Note: AppDetex is authorized by WhatsApp to
facilitate the submission of and correspondence regarding complaints.
tm_work: WHATSAPP (stylized) (in color)
901609: BX
909148: BX
IR 1095940: EU
IR 1095940: WO
WHATS APP
3.02E+11: DE
WHATSAPP (in Korean characters)
450045582: KR
WHATSAPP
IR 1085539: AM
IR 1085539: AU
IR 1085539: AZ
IR 1085539: BH
IR 1085539: BY
IR 1085539: BW
831031522: BR
TMA838338: CA
952130: CL
952131: CL
IR 1085539: CN
437692: CO
437693: CO
213297: CR
213530: CR
IR 1085539: HR
189284: DO
464: EC
595: EC
IR 1085539: EG
21: SV
9986514: EU
IR 1085539: GH
191874: GT
196084: GT
117116: HN
127543: HN
301926874: HK
IR 1085539: IS
IDM000385654: ID
IDM000397555: ID
IR 1085539: IL
IR 1085539: JP
118722: JO
118723: JO
IR 1085539: KZ
IR 1085539: KE
100921: KW
136006: LB
57024: MO
57025: MO
IR 1085539: MK
IR 1085539: MG
2011051331: MY
2011051332: MY
1241811: MX
1241812: MX
IR 1085539: MD
842482: NZ
2013099494: NI
IR 1085539: NO
IR 1085539: OM
302143: PK
200843: PA
201630: PA
4569: PE
42011005919: PH
69181: QA
69182: QA
IR 1085539: RU
146924: SA
146925: SA
IR 1085539: SG
201111980: ZA
201111981: ZA
IR
android_app_url:
https://play.google.com/store/apps/details?id=com.stickerapp.developers.whatsapp.sticker
trademark_explain: The app uses the trademarks, banners, badges and logos
of WhatsApp without authorization.
tm_sworn_statement1: tm_good_faith
tm_sworn_statement2: tm_swear
NoticeToDeveloper: agree1
signature: Alexis Meghrouni Rivas
signature_date: Mon, 25 Feb 2019
subject_lr_trademark: Your Request to Google
hidden_product: googleplay
geolocation: US
hidden_uraw:
:---- Automatically added fields ----:
Language: en
IIILanguage: en
country_code: US
auto-helpcenter-id: 1647639
auto-helpcenter-name: legal
auto-internal-helpcenter-name: legal
auto-full-url:
https://support.google.com/legal/contact/lr_trademark?product=googleplay
auto-user-logged-in: true
auto-user-was-internal: false
IssueType: lr_trademark
form-id: lr_trademark
form: lr_trademark
subject-line-field-id: subject_lr_trademark
body-text-field-id:
AutoDetectedBrowser: HeadlessChrome 72.0.3617.0
AutoDetectedOS: Linux x86_64
MendelExperiments: 10800170,10800177
Form.support-content-visit-id: 636867285175836789-1244039086
They say that your app is removed for the WhatsApp srickers used.
I will give you tip, from your app and it's description remove tge name WhatsApp and remove any WhatsApp logo n republish.
I think the issue is in your description. Appdetex is a Mobile Apps brand and trade marks infringement monitoring firm. And Whatsapp also deals here with this company. If you make description of your app correct, then it will be able to be republish.
First line generating an exception when run at remote server.
No error when running the code via IIS Express at my development notebook.
if (Session["LdapData"] == null) {
// do something
}
Exception:
[ArgumentOutOfRangeException: Der Index lag außerhalb des Bereichs. Er
darf nicht negativ und kleiner als die Sammlung sein. Parametername:
index] System.Collections.ArrayList.get_Item(Int32 index) +14539412
System.DirectoryServices.ResultPropertyValueCollection.get_Item(Int32
index) +93
Microsoft does it exactly the same way:
https://msdn.microsoft.com/de-de/library/03sekbw5(v=vs.100).aspx
if (Session["City"] == null)
// No such value in session state; take appropriate action.
Any ideas for debugging?
Edit:
Also read this articles, but didn´t get the point:
Difference between Session and HttpContext.Current.Session
How to use sessions in an ASP.NET MVC 4 application?
The exception was not related to the quoted line.
Don´t know why, but the displayed line number generated by the IIS is incorrect. Indeed the exception was caused by an ldap query some lines below in the code.
We have enables Google Autocomplete on our Website but we have found some zip codes do not register with the API. 60514 will populate Clarendon Hills, IL 60514, but the follow zip codes do not work.
32312 – Tallahassee, FL
48260 – Detroit, MI
10510 – Westchester County, NY
29302 – Spartanburg, SC
24001 – Roanoke, VA
All these zip codes are active and verified from Zip-codes.com. You can even find the zip code in Google Maps but not in the Google API Autocomplete.
Occasionally - rarely - a Nominatim search will return a hit with a key "address29" or "address26". There is no mention of such a key in osm, and I can't find any explanation in Nominatim.
Here's an example. Search nominatim for bamako (the capital city of Mali). Among others you'll see:
{"place_id":"104544188","licence":"Data © OpenStreetMap contributors, ODbL 1.0. http://www.openstreetmap.org/copyright",
"osm_type":"way","osm_id":"197528638","boundingbox":["47.4519905","47.4523668","-0.5565341","-0.5561207"],"lat":"47.4519905","lon":"-0.5565341",
"display_name":"Bamako, Angers, Maine-et-Loire, Pays de la Loire, Metropolitan France, 49000;49100, France",
"class":"highway","type":"platform","importance":0.2,
"address":{"address26":"Bamako","city":"Angers","county":"Angers","state":"Pays de la Loire","country":"France","postcode":"49000;49100","country_code":"fr"},"namedetails":{"name":"Bamako"}},
In the address field/object you see "address26":"Bamako". What does that mean? the other keys all make sense.
If you access the osm id: (eg, http://nominatim.openstreetmap.org/details?osmtype=W&osmid=197528638), there is no mention of address26.
At the website: https://thefive.sabic.uberspace.de/ they have a number of address26 entries pointing to Nominatim. I don't know what their database represents.
I have come across other Nominatim search results with address29 instead of address26.
If you look at http://taginfo.openstreetmap.org/, you won't find address26 or address29 as keys or tags...
Once in a while you will see a city named "fixme" on an osm map, but at least you have an idea of what's going on there, address2[69] stumps me. Does anyone know why?