Class: Wuclan::JsonModel::JsonTwitterUser

Inherits:
Object
  • Object
show all
Defined in:
lib/wuclan/twitter/parse/json_twitter_user.rb

Overview

The JSON user records come off the wire a bit more heavyweight than we’d like.

We vertically partition the single user record into three, as described above: one with the fundamental info, one with user’s personal info (name, location, etc) and one with the styling they’ve applied to their homepage.

A sample JSON file, reformatted for clarity:

{
  "id"                           : 14693823,
  // scraped_at added in processing
  "screen_name"                  : "MarsPhoenix"
  "protected"                    : false,
  "followers_count"              : 39452,
  "friends_count"                : 3,
  "statuses_count"               : 609,
  "favourites_count"             : 5,
  "created_at"                   : "Thu May 08 00:17:54 +0000 2008",

  // "id"                        : 14693823,
  // scraped_at added in processing
  "name"                         : "MarsPhoenix",
  "url"                          : "http:\/\/tinyurl.com\/5wwaru",
  "location"                     : "Mars, Solar System",
  "description"                  : "I dig Mars! ",
  "time_zone"                    : "Pacific Time (US & Canada)",
  "utc_offset"                   : -28800,

  // "id"                        : 14693823,
  // scraped_at added in processing
  "profile_background_color"     : "9ae4e8",
  "profile_text_color"           : "000000",
  "profile_link_color"           : "0000ff",
  "profile_sidebar_border_color" : "87bc44",
  "profile_sidebar_fill_color"   : "e0ff92",
  "profile_background_tile"      : true,
  "profile_image_url"            : "http:\/\/s3.amazonaws.com\/twitter_production\/profile_images\/55133915\/PIA09942_normal.jpg",
  "profile_background_image_url" : "http:\/\/s3.amazonaws.com\/twitter_production\/profile_background_images\/3069906\/PSP_008591_2485_RGB_Lander_Detail_516-387.jpg",

  // Sometimes:
  "status"                       :  { ... a tweet record: see tweet.tsv ... }

}

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(raw, scraped_at) ⇒ JsonTwitterUser

Returns a new instance of JsonTwitterUser.



52
53
54
55
56
 
# File 'lib/wuclan/twitter/parse/json_twitter_user.rb', line 52

def initialize raw, scraped_at
  self.raw = raw; return unless healthy?
  self.raw['scraped_at'] = scraped_at
  self.fix_raw!
end

Instance Attribute Details

#raw ⇒ Object

Returns the value of attribute raw.



51
52
53
 
# File 'lib/wuclan/twitter/parse/json_twitter_user.rb', line 51

def raw
  @raw
end

Instance Method Details

#fix_raw! ⇒ Object

Make the data easier for batch flat-record processing



67
68
69
70
71
72
73
74
75
76
77
 
# File 'lib/wuclan/twitter/parse/json_twitter_user.rb', line 67

def fix_raw!
  raw['created_at'] = ModelCommon.flatten_date(raw['created_at'])
  raw['id']         = ModelCommon.zeropad_id(raw['id'])
  raw['protected']  = ModelCommon.unbooleanize(raw['protected'])
  Wukong.encode_components raw, 'name', 'location', 'description', 'url'
  # There are several users with bogus screen names
  # These we need to **URL encode** -- not XML-encode.
  if raw['screen_name'] !~ /\A\w+\z/
    raw['screen_name'] = Wukong.encode_str(raw['screen_name'], :url)
  end
end

#generate_tweet ⇒ Object

produce the included last tweet



115
116
117
118
 
# File 'lib/wuclan/twitter/parse/json_twitter_user.rb', line 115

def generate_tweet
  raw_tweet = raw['status']
  JsonTweet.new(raw_tweet, twitter_user_id).generate_tweet if raw_tweet
end

#generate_user_classes(*klasses) ⇒ Object

Expand a user .json record into model instances

Ex.

# Parse a complete twitter users/show/foo.json record
twitter_user, , twitter_user_style =
  JsonUser.generate_user_classes TwitterUser, TwitterUserProfile, TwitterUserStyle

# just get the id and screen_name
JsonUser.generate_user_classes TwitterUserId



91
92
93
94
95
96
 
# File 'lib/wuclan/twitter/parse/json_twitter_user.rb', line 91

def generate_user_classes *klasses
  return [] unless healthy?
  klasses.map do |klass|
    klass.from_hash(raw)
  end
end

#generate_user_partial ⇒ Object

Create TwitterUserPartial from this hash – use this when you only have a partial listing, for instance in the public timeline or another user’s followers list



109
110
111
 
# File 'lib/wuclan/twitter/parse/json_twitter_user.rb', line 109

def generate_user_partial
  generate_user_classes(TwitterUserPartial).first
end

#generate_user_profile_and_style ⇒ Object

Create TwitterUser, TwitterUserProfile, and TwitterUserStyle instances from this hash



101
102
103
 
# File 'lib/wuclan/twitter/parse/json_twitter_user.rb', line 101

def 
  generate_user_classes TwitterUser, TwitterUserProfile, TwitterUserStyle
end

#healthy? ⇒ Boolean

Returns:

  • (Boolean) 


57
 
# File 'lib/wuclan/twitter/parse/json_twitter_user.rb', line 57

def healthy?() raw && raw.is_a?(Hash) end

#twitter_user_id ⇒ Object

user id from the raw hash



60
61
62
 
# File 'lib/wuclan/twitter/parse/json_twitter_user.rb', line 60

def twitter_user_id
  raw['id']
end