Method: Apollo::Crawler::BaseCrawler.try_get_doc

Defined in:
lib/apollo_crawler/crawler/base_crawler.rb

.try_get_doc(root, url) ⇒ Object 



62
63
64
65
66
67
68
69
70
 
# File 'lib/apollo_crawler/crawler/base_crawler.rb', line 62

def self.try_get_doc(root, url)
	doc = BaseCrawler.try_get_url(root, url)
	
	# TODO: Set experition header
	return {
		:doc => doc,
		:url => url
	}
end