Class: ProxyFetcher::Providers::Proxypedia

Inherits:
Base
  • Object
show all
Defined in:
lib/proxy_fetcher/providers/proxypedia.rb

Overview

FreeProxyList provider class.

Instance Method Summary collapse

Methods inherited from Base

#fetch_proxies, fetch_proxies!, #provider_headers, #provider_method, #provider_params

Instance Method Details

#provider_url ⇒ Object

Provider URL to fetch proxy list



8
9
10
 
# File 'lib/proxy_fetcher/providers/proxypedia.rb', line 8

def provider_url
  "https://proxypedia.org"
end

#to_proxy(html_node) ⇒ ProxyFetcher::Proxy

Converts HTML node (entry of N tags) to ProxyFetcher::Proxy object.]

Parameters:

  • html_node (Object) —

    HTML node from the ProxyFetcher::Document DOM model.

Returns:



26
27
28
29
30
31
32
33
34
35
36
 
# File 'lib/proxy_fetcher/providers/proxypedia.rb', line 26

def to_proxy(html_node)
  addr, port = html_node.content_at("a").to_s.split(":")

  ProxyFetcher::Proxy.new.tap do |proxy|
    proxy.addr = addr
    proxy.port = Integer(port)
    proxy.country = parse_country(html_node)
    proxy.anonymity = "Unknown"
    proxy.type = ProxyFetcher::Proxy::HTTP
  end
end

#xpath ⇒ Object

NOTE

Doesn’t support filtering



13
14
15
 
# File 'lib/proxy_fetcher/providers/proxypedia.rb', line 13

def xpath
  "//main/ul/li[position()>1]"
end