Class: SynonymScrapper::Educalingo

Inherits:
Scrapper
  • Object
show all
Defined in:
lib/synonym_scrapper/educalingo.rb

Overview

Scrapper for Educalingo's website

Constant Summary

Constants inherited from Scrapper

Scrapper::USER_AGENTS

Instance Attribute Summary

Attributes inherited from Scrapper

#base_url, #max_retries, #retries_left

Instance Method Summary collapse

Methods inherited from Scrapper

#call, #retry_call

Constructor Details

#initialize ⇒ Educalingo

Initialize the parent Scrapper Class



14
15
16
 
# File 'lib/synonym_scrapper/educalingo.rb', line 14

def initialize()
  super(5, "https://educalingo.com/en/dic-es/")
end

Instance Method Details

#build_call_url(word) ⇒ Object

Build the url to be called using this class' base_url and a word. Returns an url to where +word+'s synonyms can be obtained.



22
23
24
 
# File 'lib/synonym_scrapper/educalingo.rb', line 22

def build_call_url(word)
  URI.parse(URI.escape(base_url + word))
end

#synonyms(word, options = {}) ⇒ Object

Obtain synonyms of a word from Educalingo.



29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
 
# File 'lib/synonym_scrapper/educalingo.rb', line 29

def synonyms(word, options = {})
  response = call(word)
  doc = Nokogiri.HTML(response)
  synonyms = Array.new
  doc.css('#wordcloud1 > span').each do |synonym|
    score = Integer(synonym.values[0])

    synonyms.push({
      word: synonym.inner_html,
      score: score
    }) unless score < 75
    # A minimum score of 75 is considered because educalingo

    # tends to have completely unrelated words around this score

  end

  return synonyms
end