Good morning from Santo Domingo
What is the best time to set in the expire web content ? 7 days , 1 month ?
Related
Does anyone know whether the HERE Isoline Routing API has a limit on how many hours you can plug in?
For example, 6 hours works perfectly fine and has a service area output:
'https://isoline.router.hereapi.com/v8/isolines?transportMode=car&origin=52.51578,13.37749&range[type]=distance&range[values]=21600&routingMode=fast'
However, I get a error if I try and do 12 hours
'https://isoline.router.hereapi.com/v8/isolines?transportMode=car&origin=52.51578,13.37749&range[type]=distance&range[values]=43200&routingMode=fast'
In .parse_response(i, out$responses()[[i]]) :
https://isoline.router.hereapi.com/v8/isolines: Request 'id = 1' failed.
Status 400; Bad Request; Bad request syntax or unsupported method.
Is there a max time you can use on the API?
Thanks!
The maximum value for the time is 9 hours.
Everytime I pick up a date (through datetimepicker), I wait 300ms with Observable-debounceTime if there is another input, and after that I send a http requests to get data from the server.
REQ 1: 2.10.2020 --> Response : 530 units --> needs 4 seconds on slow 3G internet.
REQ 2: 3.10.2020 --> Response : 12 units --> needs 1.2 seconds on slow 3G internet
It shows REQ 1 because it thinks it's the last request, but I wanna show "12 units" in that example.
I wanna show always the lastest request-response I get, but I have no idea how.
I tried with promises, but the problem I have there is that I can't set debounceTime. So I am using Observables now and I have this problem.
Any ideas?
I'm trying to scrape the website of Fitch Ratings and until now I can't get what I wanted: the list of ratings. When I scrape with R it returns the header of the website and in the body it gets an "iframe" from googleTagManager the "hide" the content that matters.
website: https://www.fitchratings.com/site/search?content=research&filter=RESEARCH%20LANGUAGE%5EPortuguese%2BGEOGRAPHY%5EAmericas%2BREPORT%20TYPE%5EHeadlines%5ERating%20Action%20Commentary
return:
[1] <head>\n<title>Search - Fitch Ratings</title>\n<!-- headerScripts --><!-- --><meta http-equiv="Content-Type" content="text/html; chars ...
[2] <body id="search-results">\n <div id="privacy-policy-tos-modal-container"></div>\n <!-- Google Tag Manager (noscript) -- ...
_____________
What I want:
Date;Research;Type;Text
04 Sep 2019; Fitch afirma Rating de Qualidade(...);Rating Action Commentary;Fitch Ratings-Sao Paulo - 04 September 2019: A Fitch Ratings Afirmou hoje, o Rating de Qualidade de Gestão de Ivnestimento 'Excelente' (...)
02 Sep 2019; Fitch Eleva Rating (...); Rating Action Commentary; Fitch Ratings - Sao Paulo - 02 September 2019: A Fitch Ratings elevou hoje (...)
Code below
html_of_site <- read_html(url("https://www.fitchratings.com/site/search?content=research&filter=RESEARCH%20LANGUAGE%5EPortuguese%2BGEOGRAPHY%5EAmericas%2BREPORT%20TYPE%5EHeadlines%5ERating%20Action%20Commentary"))
html_of_site
Short Answer: Don't scrape this website.
Long Answer: Technically it is possible to scrape this site, but you need your code to act like a human. What this means is that you would need to convince Fitch Group's server that you are indeed a human visitor and not a bot.
To do this you need to:
Send the same headers that your browser would send to the site
Keep track of any cookies the site sends back to you and return them in subsequent requests if necessary
Evaluate any scripts sent back by the server (to actually load the data you want).
I wasn't able to access the site policy for the thefitchgroup.com, but I assume it includes clauses about what bots are and are not allowed to do on the site. Since this company likely sells the data you are trying to scrape, you should probably avoid scraping this site.
In general, don't scrape sites without reading the site policies first. If the data you are scraping is not free without scraping it, then you probably shouldn't be scraping it.
I have created as Yahoo Calender link and it doesn't seem to be respecting the timezone for the end date:
https://calendar.yahoo.com/?v=60&TITLE=Chapter%20Luncheon%20-%20CO%20-&ST=20151022T170000Z&ET=20151022T190000Z&URL=tma.utdev.com&in_loc=Maggiano%27s%20Little%20Italy%20500%2016th%20St%20Ste%20150%20Pavilions%20Mall%2C%20Denver%2C%20CO%2080202%2C%20United%20States&desc=
This displays 1:00PM to 7:00PM. I am in the EST Timezone which is GMT-4:00, so 17:00:00 (aka 5:00) - 4 hours = 1:00 PM. But for the end time, 19:00:00 (7:00), its not converting and its leaving it at 7:00
For google it does work:
https://www.google.com/calendar/render?action=TEMPLATE&text=Chapter+Luncheon+-+CO+-&dates=20151022T170000Z/20151022T190000Z&sprop=website:tma.utdev.com&location=Maggiano%27s+Little+Italy+500+16th+St+Ste+150+Pavilions+Mall,+Denver,+CO+80202,+United+States&details&website=http://tma.utdev.com/event/chapter-luncheon-co&pli=1&sf=true&output=xml#eventpage_6
This displays the date 1:00PM to 3:00PM
From what I can tell, Yahoo Calendar doesn't support an ET parameter. (If it does, it's undocumented and buggy). I'd therefore recommend using the DUR parameter instead, to specify the duration:
https://calendar.yahoo.com/?v=60&TITLE=Chapter%20Luncheon%20-%20CO%20-&ST=20151022T170000Z&DUR=0200&URL=tma.utdev.com&in_loc=Maggiano%27s%20Little%20Italy%20500%2016th%20St%20Ste%20150%20Pavilions%20Mall%2C%20Denver%2C%20CO%2080202%2C%20United%20States&desc=
See http://chris.photobooks.com/tests/calendar/Notes.html or http://taskboy.com/blog/Creating_events_for_Yahoo_and_Google_calendars.html for more information on the supported parameters.
I am using the following BlackBerry Java code for parsing the Date by setting its time zone too.
The Default timezone is +01:00 Europe/Belgrade Yugoslavia(YU)
I am using the following code :
Date formatter11 = new Date(HttpDateParser.parse("2013-08-02T14:00:00+04:00"));
Output comes as :
Fri Aug 02 12:00:00 Europe/Belgrade Yugoslavia(YU) 2013
which is wrong . Please let me know the error why parsing is not been correct.
It comes as one hour extra .
Actually , I was concerned for DayLight event that happens with Blackberry phones ... what is that issue .
Are you sure this is one hour extra?
The time seems to saying it is 14:00, and the time zone is UTC + 4 hours, So UTC time is 10:00, Yugoslavia is 1 hour ahead of that, plus daylight saving means 12:00.
Most likely I have missed something.