Processing scraped text

[nyamadori]

Proposal

For example when we need to treats comma separated integer, we want to text processing before populating DB (e.g. using ActiveRecord).
So we need text processing methods after data scraping.

class Juknife::Scraper
  scraping do
    item :cost, '#cost'
    items :list, 'ul' do
      item :item1, 'li:nth-of-type(1)'
      item :item2, 'li:nth-of-type(2)'
    end
  end

  process :cost do |text|
    text.delete(',') # something processing to `text`
  end

  process :item1 do |text|
    text.delete(',') # something processing to `text`
  end
  # or 
  process :list, :item1 do |text|
    text.delete(',') # something processing to `text`
  end
end