Styjun

I have built a web scraper that is successfully pulling almost everything I need out of the web page I'm looking at. The goal is to pull the URL for a particular image associated with all the coffees found at a particular URL.

The rake task I have defined to complete the scraping is as follows:

mechanize = Mechanize.new
mechanize.get(url) do |page|
 page.links_with(:href => /products/).each do |link|
 coffee_page = link.click

 bean = Bean.new

 bean.acidity = coffee_page.css('[data-id="acidity"]').text.strip.gsub("acidity ","")
 bean.elevation = coffee_page.css('[data-id="elevation"]').text.strip.gsub("elevation ","")
 bean.roaster_id = "2"
 bean.harvest_season = coffee_page.css('[data-id="harvest"]').text.strip.gsub("harvest ","")
 bean.price = coffee_page.css('.price-wrap').text.gsub("$","")
 bean.roast_profile = coffee_page.css('[data-id="roast"]').text.strip.gsub("roast ","")
 bean.processing_type = coffee_page.css('[data-id="process"]').text.strip.gsub("process ","")
 bean.cultivar = coffee_page.css('[data-id="cultivar"]').text.strip.gsub("cultivar ","")
 bean.flavor_profiles = coffee_page.css('.price-wrap+ p').text.strip
 bean.country_of_origin = coffee_page.css('#pdp-order h1').text.strip
 bean.image_url = coffee_page.css('img data-featured-product-image').attr('src')

 if bean.country_of_origin == "Origin Set" || bean.country_of_origin == "Gift Card (online use only)"
 bean.destroy
 else
 ap bean
 end
 end
end

Now the information I need is all on the page, and I'm looking for the image URL that is found like the below, but for all the individual coffee_pages at the source page. It needs to be generic enough to pull this picture source but nothing else. I've tried a number of different css selectors but everything pulls either nil or blank.

<img src="//cdn.shopify.com/s/files/1/2220/0129/products/ceremony-product-gummy-bears_480x480.jpg?v=1551455589" alt="Burundi Kiryama" data-product-featured-image style="display:none">

The coffee_page I'm on is here: https://shop.ceremonycoffee.com/products/burundi-kiryama

You need to change

bean.image_url = coffee_page.css('img data-featured-product-image').attr('src')

to

bean.image_url = coffee_page.css('#mobile-only>img').attr('src')

If you can, always use nearby identifiers to locate the element you want to access.