Styjun

Rational Number RNG

Why do the new Star Trek series have so few episodes in each season?

What is the difference between democracy and ochlocracy?

Is This Constraint Convex?

Fiducial placement

Renaming environment variables by changing variable name prefix

Is there a high level reason why the inverse square law of gravitation yields periodic orbits without precession?

Does recycling lead to less jobs?

Avoid showing cancel button on dialog

Number Equation Matrix

Dragons have an armor that is similar to that of sungazer lizards. Why would the dragons have the spikes as well?

How to play a devious character when you are not personally devious?

Is CR12 too difficult for two level 4 players?

Explanation for why nickel turns green in hydrochloric acid

My professor has no direction

Mutate my DNA sequence

How does this template code to get the size of an array work?

What are modes in real world?

Create a box using the tcolorbox package or any other? (image)

Why are Buddhist concepts so difficult?

Make a haystack (with a needle)

Do European politicians typically put their pronouns on their social media pages?

In the Cl vs Cd graph, Why the drag coefficient decreases initially with the small increment in lift coefficient?

What's the origin of the trope that dragons used to be common but aren't any more?

'NULL' and 'NA' issue when scraping websites with ContentScraper in R?

How to write trycatch in RWebscraping in R, “… does not exist in current working directory” errorOptions for HTML scraping?Scrape An Entire WebsiteWhy my Scrapy project stop scraping, but still scrawling website wellNull results from readHTMLTable in RHow to return a set of urls with more accuracy that returns relevant result, using web scraping?Website scraping: python requests not downloading full site?How to fix “connection timed out after 10000 milliseconds” while scraping in R?Web crawling URLs that match certain pattern in R using RCrawlerHow to scrape multiple websites using Rcrawler in R?

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty
margin-bottom:0;

0

I have a very long list of websites that I'd like to scrape for its title, description, and keywords.

I'm using ContentScraper from Rcrawler package, and I know it's working, but there are certain URLs that it can't do and just generate the error message below. Is there anyway that it can skip that particular URL instead of stopping the entire execution?

Error: 'NULL' does not exist in current working directory

I've looked at this, but I don't think it has any answer to it. Here is the code I'm using. Any advice is greatly appreciated.

Web_Info <- ContentScraper(Url = Websites_List, 
 XpathPatterns = c('/html/head/title', '//meta[@name="description"]/@content', '//meta[@name="keywords"]/@content'), 
 PatternsName = c("Title", "Description", "Keywords"), 
 asDataFrame = TRUE)

r web-scraping rcrawler

share|improve this question

asked Mar 28 at 21:39

cheklapkokcheklapkok

12966 bronze badges

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  check this: stackoverflow.com/questions/12193779/how-to-write-trycatch-in-r
  
  – Cettt
  Mar 28 at 21:40
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Exactly what I needed. Thank you. @Cettt
  
  – cheklapkok
  Mar 29 at 14:44
  

  
  
  
  

add a comment
 | 

0

I have a very long list of websites that I'd like to scrape for its title, description, and keywords.

I'm using ContentScraper from Rcrawler package, and I know it's working, but there are certain URLs that it can't do and just generate the error message below. Is there anyway that it can skip that particular URL instead of stopping the entire execution?

Error: 'NULL' does not exist in current working directory

I've looked at this, but I don't think it has any answer to it. Here is the code I'm using. Any advice is greatly appreciated.

Web_Info <- ContentScraper(Url = Websites_List, 
 XpathPatterns = c('/html/head/title', '//meta[@name="description"]/@content', '//meta[@name="keywords"]/@content'), 
 PatternsName = c("Title", "Description", "Keywords"), 
 asDataFrame = TRUE)

r web-scraping rcrawler

share|improve this question

asked Mar 28 at 21:39

cheklapkokcheklapkok

12966 bronze badges

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  check this: stackoverflow.com/questions/12193779/how-to-write-trycatch-in-r
  
  – Cettt
  Mar 28 at 21:40
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Exactly what I needed. Thank you. @Cettt
  
  – cheklapkok
  Mar 29 at 14:44
  

  
  
  
  

add a comment
 | 

I have a very long list of websites that I'd like to scrape for its title, description, and keywords.

I'm using ContentScraper from Rcrawler package, and I know it's working, but there are certain URLs that it can't do and just generate the error message below. Is there anyway that it can skip that particular URL instead of stopping the entire execution?

Error: 'NULL' does not exist in current working directory

I've looked at this, but I don't think it has any answer to it. Here is the code I'm using. Any advice is greatly appreciated.

Web_Info <- ContentScraper(Url = Websites_List, 
 XpathPatterns = c('/html/head/title', '//meta[@name="description"]/@content', '//meta[@name="keywords"]/@content'), 
 PatternsName = c("Title", "Description", "Keywords"), 
 asDataFrame = TRUE)

r web-scraping rcrawler

share|improve this question

asked Mar 28 at 21:39

cheklapkokcheklapkok

12966 bronze badges

Web_Info <- ContentScraper(Url = Websites_List, 
 XpathPatterns = c('/html/head/title', '//meta[@name="description"]/@content', '//meta[@name="keywords"]/@content'), 
 PatternsName = c("Title", "Description", "Keywords"), 
 asDataFrame = TRUE)

share|improve this question

asked Mar 28 at 21:39

cheklapkokcheklapkok

12966 bronze badges

share|improve this question

asked Mar 28 at 21:39

cheklapkokcheklapkok

12966 bronze badges

asked Mar 28 at 21:39

cheklapkokcheklapkok

12966 bronze badges

asked Mar 28 at 21:39

cheklapkokcheklapkok

12966 bronze badges