You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

377 lines
12 KiB

Account domain blocks (#2381) * Add <ostatus:conversation /> tag to Atom input/output Only uses ref attribute (not href) because href would be the alternate link that's always included also. Creates new conversation for every non-reply status. Carries over conversation for every reply. Keeps remote URIs verbatim, generates local URIs on the fly like the rest of them. * Conversation muting - prevents notifications that reference a conversation (including replies, favourites, reblogs) from being created. API endpoints /api/v1/statuses/:id/mute and /api/v1/statuses/:id/unmute Currently no way to tell when a status/conversation is muted, so the web UI only has a "disable notifications" button, doesn't work as a toggle * Display "Dismiss notifications" on all statuses in notifications column, not just own * Add "muted" as a boolean attribute on statuses JSON For now always false on contained reblogs, since it's only relevant for statuses returned from the notifications endpoint, which are not nested Remove "Disable notifications" from detailed status view, since it's only relevant in the notifications column * Up max class length * Remove pending test for conversation mute * Add tests, clean up * Rename to "mute conversation" and "unmute conversation" * Raise validation error when trying to mute/unmute status without conversation * Adding account domain blocks that filter notifications and public timelines * Add tests for domain blocks in notifications, public timelines Filter reblogs of blocked domains from home * Add API for listing and creating account domain blocks * API for creating/deleting domain blocks, tests for Status#ancestors and Status#descendants, filter domain blocks from them * Filter domains in streaming API * Update account_domain_block_spec.rb
7 years ago
Fix Account model deprecation warnings (#3689) ``` DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:61) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:62) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:63) ``` Here's PR describing changes to Dirty API https://github.com/rails/rails/pull/25337
7 years ago
Fix Account model deprecation warnings (#3689) ``` DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:61) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:62) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:63) ``` Here's PR describing changes to Dirty API https://github.com/rails/rails/pull/25337
7 years ago
8 years ago
8 years ago
8 years ago
Account domain blocks (#2381) * Add <ostatus:conversation /> tag to Atom input/output Only uses ref attribute (not href) because href would be the alternate link that's always included also. Creates new conversation for every non-reply status. Carries over conversation for every reply. Keeps remote URIs verbatim, generates local URIs on the fly like the rest of them. * Conversation muting - prevents notifications that reference a conversation (including replies, favourites, reblogs) from being created. API endpoints /api/v1/statuses/:id/mute and /api/v1/statuses/:id/unmute Currently no way to tell when a status/conversation is muted, so the web UI only has a "disable notifications" button, doesn't work as a toggle * Display "Dismiss notifications" on all statuses in notifications column, not just own * Add "muted" as a boolean attribute on statuses JSON For now always false on contained reblogs, since it's only relevant for statuses returned from the notifications endpoint, which are not nested Remove "Disable notifications" from detailed status view, since it's only relevant in the notifications column * Up max class length * Remove pending test for conversation mute * Add tests, clean up * Rename to "mute conversation" and "unmute conversation" * Raise validation error when trying to mute/unmute status without conversation * Adding account domain blocks that filter notifications and public timelines * Add tests for domain blocks in notifications, public timelines Filter reblogs of blocked domains from home * Add API for listing and creating account domain blocks * API for creating/deleting domain blocks, tests for Status#ancestors and Status#descendants, filter domain blocks from them * Filter domains in streaming API * Update account_domain_block_spec.rb
7 years ago
8 years ago
  1. # frozen_string_literal: true
  2. # == Schema Information
  3. #
  4. # Table name: accounts
  5. #
  6. # id :integer not null, primary key
  7. # username :string default(""), not null
  8. # domain :string
  9. # secret :string default(""), not null
  10. # private_key :text
  11. # public_key :text default(""), not null
  12. # remote_url :string default(""), not null
  13. # salmon_url :string default(""), not null
  14. # hub_url :string default(""), not null
  15. # created_at :datetime not null
  16. # updated_at :datetime not null
  17. # note :text default(""), not null
  18. # display_name :string default(""), not null
  19. # uri :string default(""), not null
  20. # url :string
  21. # avatar_file_name :string
  22. # avatar_content_type :string
  23. # avatar_file_size :integer
  24. # avatar_updated_at :datetime
  25. # header_file_name :string
  26. # header_content_type :string
  27. # header_file_size :integer
  28. # header_updated_at :datetime
  29. # avatar_remote_url :string
  30. # subscription_expires_at :datetime
  31. # silenced :boolean default(FALSE), not null
  32. # suspended :boolean default(FALSE), not null
  33. # locked :boolean default(FALSE), not null
  34. # header_remote_url :string default(""), not null
  35. # statuses_count :integer default(0), not null
  36. # followers_count :integer default(0), not null
  37. # following_count :integer default(0), not null
  38. # last_webfingered_at :datetime
  39. # inbox_url :string default(""), not null
  40. # outbox_url :string default(""), not null
  41. # shared_inbox_url :string default(""), not null
  42. # followers_url :string default(""), not null
  43. # protocol :integer default("ostatus"), not null
  44. # memorial :boolean default(FALSE), not null
  45. # moved_to_account_id :integer
  46. # featured_collection_url :string
  47. #
  48. class Account < ApplicationRecord
  49. USERNAME_RE = /[a-z0-9_]+([a-z0-9_\.]+[a-z0-9_]+)?/i
  50. MENTION_RE = /(?<=^|[^\/[:word:]])@((#{USERNAME_RE})(?:@[a-z0-9\.\-]+[a-z0-9]+)?)/i
  51. include AccountAvatar
  52. include AccountFinderConcern
  53. include AccountHeader
  54. include AccountInteractions
  55. include Attachmentable
  56. include Paginable
  57. enum protocol: [:ostatus, :activitypub]
  58. # Local users
  59. has_one :user, inverse_of: :account
  60. validates :username, presence: true
  61. # Remote user validations
  62. validates :username, uniqueness: { scope: :domain, case_sensitive: true }, if: -> { !local? && will_save_change_to_username? }
  63. # Local user validations
  64. validates :username, format: { with: /\A[a-z0-9_]+\z/i }, length: { maximum: 30 }, if: -> { local? && will_save_change_to_username? }
  65. validates_with UniqueUsernameValidator, if: -> { local? && will_save_change_to_username? }
  66. validates_with UnreservedUsernameValidator, if: -> { local? && will_save_change_to_username? }
  67. validates :display_name, length: { maximum: 30 }, if: -> { local? && will_save_change_to_display_name? }
  68. validates :note, length: { maximum: 160 }, if: -> { local? && will_save_change_to_note? }
  69. # Timelines
  70. has_many :stream_entries, inverse_of: :account, dependent: :destroy
  71. has_many :statuses, inverse_of: :account, dependent: :destroy
  72. has_many :favourites, inverse_of: :account, dependent: :destroy
  73. has_many :mentions, inverse_of: :account, dependent: :destroy
  74. has_many :notifications, inverse_of: :account, dependent: :destroy
  75. # Pinned statuses
  76. has_many :status_pins, inverse_of: :account, dependent: :destroy
  77. has_many :pinned_statuses, -> { reorder('status_pins.created_at DESC') }, through: :status_pins, class_name: 'Status', source: :status
  78. # Media
  79. has_many :media_attachments, dependent: :destroy
  80. # PuSH subscriptions
  81. has_many :subscriptions, dependent: :destroy
  82. # Report relationships
  83. has_many :reports
  84. has_many :targeted_reports, class_name: 'Report', foreign_key: :target_account_id
  85. # Moderation notes
  86. has_many :account_moderation_notes, dependent: :destroy
  87. has_many :targeted_moderation_notes, class_name: 'AccountModerationNote', foreign_key: :target_account_id, dependent: :destroy
  88. # Lists
  89. has_many :list_accounts, inverse_of: :account, dependent: :destroy
  90. has_many :lists, through: :list_accounts
  91. # Account migrations
  92. belongs_to :moved_to_account, class_name: 'Account', optional: true
  93. scope :remote, -> { where.not(domain: nil) }
  94. scope :local, -> { where(domain: nil) }
  95. scope :without_followers, -> { where(followers_count: 0) }
  96. scope :with_followers, -> { where('followers_count > 0') }
  97. scope :expiring, ->(time) { remote.where.not(subscription_expires_at: nil).where('subscription_expires_at < ?', time) }
  98. scope :partitioned, -> { order('row_number() over (partition by domain)') }
  99. scope :silenced, -> { where(silenced: true) }
  100. scope :suspended, -> { where(suspended: true) }
  101. scope :recent, -> { reorder(id: :desc) }
  102. scope :alphabetic, -> { order(domain: :asc, username: :asc) }
  103. scope :by_domain_accounts, -> { group(:domain).select(:domain, 'COUNT(*) AS accounts_count').order('accounts_count desc') }
  104. scope :matches_username, ->(value) { where(arel_table[:username].matches("#{value}%")) }
  105. scope :matches_display_name, ->(value) { where(arel_table[:display_name].matches("#{value}%")) }
  106. scope :matches_domain, ->(value) { where(arel_table[:domain].matches("%#{value}%")) }
  107. delegate :email,
  108. :current_sign_in_ip,
  109. :current_sign_in_at,
  110. :confirmed?,
  111. :admin?,
  112. :moderator?,
  113. :staff?,
  114. :locale,
  115. to: :user,
  116. prefix: true,
  117. allow_nil: true
  118. delegate :filtered_languages, to: :user, prefix: false, allow_nil: true
  119. def local?
  120. domain.nil?
  121. end
  122. def moved?
  123. moved_to_account_id.present?
  124. end
  125. def acct
  126. local? ? username : "#{username}@#{domain}"
  127. end
  128. def local_username_and_domain
  129. "#{username}@#{Rails.configuration.x.local_domain}"
  130. end
  131. def to_webfinger_s
  132. "acct:#{local_username_and_domain}"
  133. end
  134. def subscribed?
  135. subscription_expires_at.present?
  136. end
  137. def possibly_stale?
  138. last_webfingered_at.nil? || last_webfingered_at <= 1.day.ago
  139. end
  140. def refresh!
  141. return if local?
  142. ResolveAccountService.new.call(acct)
  143. end
  144. def unsuspend!
  145. transaction do
  146. user&.enable! if local?
  147. update!(suspended: false)
  148. end
  149. end
  150. def memorialize!
  151. transaction do
  152. user&.disable! if local?
  153. update!(memorial: true)
  154. end
  155. end
  156. def keypair
  157. @keypair ||= OpenSSL::PKey::RSA.new(private_key || public_key)
  158. end
  159. def magic_key
  160. modulus, exponent = [keypair.public_key.n, keypair.public_key.e].map do |component|
  161. result = []
  162. until component.zero?
  163. result << [component % 256].pack('C')
  164. component >>= 8
  165. end
  166. result.reverse.join
  167. end
  168. (['RSA'] + [modulus, exponent].map { |n| Base64.urlsafe_encode64(n) }).join('.')
  169. end
  170. def subscription(webhook_url)
  171. @subscription ||= OStatus2::Subscription.new(remote_url, secret: secret, webhook: webhook_url, hub: hub_url)
  172. end
  173. def save_with_optional_media!
  174. save!
  175. rescue ActiveRecord::RecordInvalid
  176. self.avatar = nil
  177. self.header = nil
  178. self[:avatar_remote_url] = ''
  179. self[:header_remote_url] = ''
  180. save!
  181. end
  182. def object_type
  183. :person
  184. end
  185. def to_param
  186. username
  187. end
  188. def excluded_from_timeline_account_ids
  189. Rails.cache.fetch("exclude_account_ids_for:#{id}") { blocking.pluck(:target_account_id) + blocked_by.pluck(:account_id) + muting.pluck(:target_account_id) }
  190. end
  191. def excluded_from_timeline_domains
  192. Rails.cache.fetch("exclude_domains_for:#{id}") { domain_blocks.pluck(:domain) }
  193. end
  194. def preferred_inbox_url
  195. shared_inbox_url.presence || inbox_url
  196. end
  197. class << self
  198. def readonly_attributes
  199. super - %w(statuses_count following_count followers_count)
  200. end
  201. def domains
  202. reorder(nil).pluck('distinct accounts.domain')
  203. end
  204. def inboxes
  205. urls = reorder(nil).where(protocol: :activitypub).pluck("distinct coalesce(nullif(accounts.shared_inbox_url, ''), accounts.inbox_url)")
  206. DeliveryFailureTracker.filter(urls)
  207. end
  208. def triadic_closures(account, limit: 5, offset: 0)
  209. sql = <<-SQL.squish
  210. WITH first_degree AS (
  211. SELECT target_account_id
  212. FROM follows
  213. WHERE account_id = :account_id
  214. )
  215. SELECT accounts.*
  216. FROM follows
  217. INNER JOIN accounts ON follows.target_account_id = accounts.id
  218. WHERE
  219. account_id IN (SELECT * FROM first_degree)
  220. AND target_account_id NOT IN (SELECT * FROM first_degree)
  221. AND target_account_id NOT IN (:excluded_account_ids)
  222. AND accounts.suspended = false
  223. GROUP BY target_account_id, accounts.id
  224. ORDER BY count(account_id) DESC
  225. OFFSET :offset
  226. LIMIT :limit
  227. SQL
  228. excluded_account_ids = account.excluded_from_timeline_account_ids + [account.id]
  229. find_by_sql(
  230. [sql, { account_id: account.id, excluded_account_ids: excluded_account_ids, limit: limit, offset: offset }]
  231. )
  232. end
  233. def search_for(terms, limit = 10)
  234. textsearch, query = generate_query_for_search(terms)
  235. sql = <<-SQL.squish
  236. SELECT
  237. accounts.*,
  238. ts_rank_cd(#{textsearch}, #{query}, 32) AS rank
  239. FROM accounts
  240. WHERE #{query} @@ #{textsearch}
  241. AND accounts.suspended = false
  242. AND accounts.moved_to_account_id IS NULL
  243. ORDER BY rank DESC
  244. LIMIT ?
  245. SQL
  246. find_by_sql([sql, limit])
  247. end
  248. def advanced_search_for(terms, account, limit = 10, following = false)
  249. textsearch, query = generate_query_for_search(terms)
  250. if following
  251. sql = <<-SQL.squish
  252. WITH first_degree AS (
  253. SELECT target_account_id
  254. FROM follows
  255. WHERE account_id = ?
  256. )
  257. SELECT
  258. accounts.*,
  259. (count(f.id) + 1) * ts_rank_cd(#{textsearch}, #{query}, 32) AS rank
  260. FROM accounts
  261. LEFT OUTER JOIN follows AS f ON (accounts.id = f.account_id AND f.target_account_id = ?) OR (accounts.id = f.target_account_id AND f.account_id = ?)
  262. WHERE accounts.id IN (SELECT * FROM first_degree)
  263. AND #{query} @@ #{textsearch}
  264. AND accounts.suspended = false
  265. AND accounts.moved_to_account_id IS NULL
  266. GROUP BY accounts.id
  267. ORDER BY rank DESC
  268. LIMIT ?
  269. SQL
  270. find_by_sql([sql, account.id, account.id, account.id, limit])
  271. else
  272. sql = <<-SQL.squish
  273. SELECT
  274. accounts.*,
  275. (count(f.id) + 1) * ts_rank_cd(#{textsearch}, #{query}, 32) AS rank
  276. FROM accounts
  277. LEFT OUTER JOIN follows AS f ON (accounts.id = f.account_id AND f.target_account_id = ?) OR (accounts.id = f.target_account_id AND f.account_id = ?)
  278. WHERE #{query} @@ #{textsearch}
  279. AND accounts.suspended = false
  280. AND accounts.moved_to_account_id IS NULL
  281. GROUP BY accounts.id
  282. ORDER BY rank DESC
  283. LIMIT ?
  284. SQL
  285. find_by_sql([sql, account.id, account.id, limit])
  286. end
  287. end
  288. private
  289. def generate_query_for_search(terms)
  290. terms = Arel.sql(connection.quote(terms.gsub(/['?\\:]/, ' ')))
  291. textsearch = "(setweight(to_tsvector('simple', accounts.display_name), 'A') || setweight(to_tsvector('simple', accounts.username), 'B') || setweight(to_tsvector('simple', coalesce(accounts.domain, '')), 'C'))"
  292. query = "to_tsquery('simple', ''' ' || #{terms} || ' ''' || ':*')"
  293. [textsearch, query]
  294. end
  295. end
  296. before_create :generate_keys
  297. before_validation :normalize_domain
  298. before_validation :prepare_contents, if: :local?
  299. private
  300. def prepare_contents
  301. display_name&.strip!
  302. note&.strip!
  303. end
  304. def generate_keys
  305. return unless local?
  306. keypair = OpenSSL::PKey::RSA.new(Rails.env.test? ? 512 : 2048)
  307. self.private_key = keypair.to_pem
  308. self.public_key = keypair.public_key.to_pem
  309. end
  310. def normalize_domain
  311. return if local?
  312. self.domain = TagManager.instance.normalize_domain(domain)
  313. end
  314. end