You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

444 lines
14 KiB

Account domain blocks (#2381) * Add <ostatus:conversation /> tag to Atom input/output Only uses ref attribute (not href) because href would be the alternate link that's always included also. Creates new conversation for every non-reply status. Carries over conversation for every reply. Keeps remote URIs verbatim, generates local URIs on the fly like the rest of them. * Conversation muting - prevents notifications that reference a conversation (including replies, favourites, reblogs) from being created. API endpoints /api/v1/statuses/:id/mute and /api/v1/statuses/:id/unmute Currently no way to tell when a status/conversation is muted, so the web UI only has a "disable notifications" button, doesn't work as a toggle * Display "Dismiss notifications" on all statuses in notifications column, not just own * Add "muted" as a boolean attribute on statuses JSON For now always false on contained reblogs, since it's only relevant for statuses returned from the notifications endpoint, which are not nested Remove "Disable notifications" from detailed status view, since it's only relevant in the notifications column * Up max class length * Remove pending test for conversation mute * Add tests, clean up * Rename to "mute conversation" and "unmute conversation" * Raise validation error when trying to mute/unmute status without conversation * Adding account domain blocks that filter notifications and public timelines * Add tests for domain blocks in notifications, public timelines Filter reblogs of blocked domains from home * Add API for listing and creating account domain blocks * API for creating/deleting domain blocks, tests for Status#ancestors and Status#descendants, filter domain blocks from them * Filter domains in streaming API * Update account_domain_block_spec.rb
7 years ago
Fix Account model deprecation warnings (#3689) ``` DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:61) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:62) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:63) ``` Here's PR describing changes to Dirty API https://github.com/rails/rails/pull/25337
7 years ago
Fix Account model deprecation warnings (#3689) ``` DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:61) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:62) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:63) ``` Here's PR describing changes to Dirty API https://github.com/rails/rails/pull/25337
7 years ago
8 years ago
8 years ago
8 years ago
Account domain blocks (#2381) * Add <ostatus:conversation /> tag to Atom input/output Only uses ref attribute (not href) because href would be the alternate link that's always included also. Creates new conversation for every non-reply status. Carries over conversation for every reply. Keeps remote URIs verbatim, generates local URIs on the fly like the rest of them. * Conversation muting - prevents notifications that reference a conversation (including replies, favourites, reblogs) from being created. API endpoints /api/v1/statuses/:id/mute and /api/v1/statuses/:id/unmute Currently no way to tell when a status/conversation is muted, so the web UI only has a "disable notifications" button, doesn't work as a toggle * Display "Dismiss notifications" on all statuses in notifications column, not just own * Add "muted" as a boolean attribute on statuses JSON For now always false on contained reblogs, since it's only relevant for statuses returned from the notifications endpoint, which are not nested Remove "Disable notifications" from detailed status view, since it's only relevant in the notifications column * Up max class length * Remove pending test for conversation mute * Add tests, clean up * Rename to "mute conversation" and "unmute conversation" * Raise validation error when trying to mute/unmute status without conversation * Adding account domain blocks that filter notifications and public timelines * Add tests for domain blocks in notifications, public timelines Filter reblogs of blocked domains from home * Add API for listing and creating account domain blocks * API for creating/deleting domain blocks, tests for Status#ancestors and Status#descendants, filter domain blocks from them * Filter domains in streaming API * Update account_domain_block_spec.rb
7 years ago
8 years ago
  1. # frozen_string_literal: true
  2. # == Schema Information
  3. #
  4. # Table name: accounts
  5. #
  6. # id :bigint(8) not null, primary key
  7. # username :string default(""), not null
  8. # domain :string
  9. # secret :string default(""), not null
  10. # private_key :text
  11. # public_key :text default(""), not null
  12. # remote_url :string default(""), not null
  13. # salmon_url :string default(""), not null
  14. # hub_url :string default(""), not null
  15. # created_at :datetime not null
  16. # updated_at :datetime not null
  17. # note :text default(""), not null
  18. # display_name :string default(""), not null
  19. # uri :string default(""), not null
  20. # url :string
  21. # avatar_file_name :string
  22. # avatar_content_type :string
  23. # avatar_file_size :integer
  24. # avatar_updated_at :datetime
  25. # header_file_name :string
  26. # header_content_type :string
  27. # header_file_size :integer
  28. # header_updated_at :datetime
  29. # avatar_remote_url :string
  30. # subscription_expires_at :datetime
  31. # silenced :boolean default(FALSE), not null
  32. # suspended :boolean default(FALSE), not null
  33. # locked :boolean default(FALSE), not null
  34. # header_remote_url :string default(""), not null
  35. # statuses_count :integer default(0), not null
  36. # followers_count :integer default(0), not null
  37. # following_count :integer default(0), not null
  38. # last_webfingered_at :datetime
  39. # inbox_url :string default(""), not null
  40. # outbox_url :string default(""), not null
  41. # shared_inbox_url :string default(""), not null
  42. # followers_url :string default(""), not null
  43. # protocol :integer default("ostatus"), not null
  44. # memorial :boolean default(FALSE), not null
  45. # moved_to_account_id :bigint(8)
  46. # featured_collection_url :string
  47. # fields :jsonb
  48. # actor_type :string
  49. #
  50. class Account < ApplicationRecord
  51. USERNAME_RE = /[a-z0-9_]+([a-z0-9_\.]+[a-z0-9_]+)?/i
  52. MENTION_RE = /(?<=^|[^\/[:word:]])@((#{USERNAME_RE})(?:@[a-z0-9\.\-]+[a-z0-9]+)?)/i
  53. include AccountAvatar
  54. include AccountFinderConcern
  55. include AccountHeader
  56. include AccountInteractions
  57. include Attachmentable
  58. include Paginable
  59. enum protocol: [:ostatus, :activitypub]
  60. # Local users
  61. has_one :user, inverse_of: :account
  62. validates :username, presence: true
  63. # Remote user validations
  64. validates :username, uniqueness: { scope: :domain, case_sensitive: true }, if: -> { !local? && will_save_change_to_username? }
  65. # Local user validations
  66. validates :username, format: { with: /\A[a-z0-9_]+\z/i }, length: { maximum: 30 }, if: -> { local? && will_save_change_to_username? }
  67. validates_with UniqueUsernameValidator, if: -> { local? && will_save_change_to_username? }
  68. validates_with UnreservedUsernameValidator, if: -> { local? && will_save_change_to_username? }
  69. validates :display_name, length: { maximum: 30 }, if: -> { local? && will_save_change_to_display_name? }
  70. validates :note, length: { maximum: 160 }, if: -> { local? && will_save_change_to_note? }
  71. validates :fields, length: { maximum: 4 }, if: -> { local? && will_save_change_to_fields? }
  72. # Timelines
  73. has_many :stream_entries, inverse_of: :account, dependent: :destroy
  74. has_many :statuses, inverse_of: :account, dependent: :destroy
  75. has_many :favourites, inverse_of: :account, dependent: :destroy
  76. has_many :mentions, inverse_of: :account, dependent: :destroy
  77. has_many :notifications, inverse_of: :account, dependent: :destroy
  78. # Pinned statuses
  79. has_many :status_pins, inverse_of: :account, dependent: :destroy
  80. has_many :pinned_statuses, -> { reorder('status_pins.created_at DESC') }, through: :status_pins, class_name: 'Status', source: :status
  81. # Media
  82. has_many :media_attachments, dependent: :destroy
  83. # PuSH subscriptions
  84. has_many :subscriptions, dependent: :destroy
  85. # Report relationships
  86. has_many :reports
  87. has_many :targeted_reports, class_name: 'Report', foreign_key: :target_account_id
  88. has_many :report_notes, dependent: :destroy
  89. # Moderation notes
  90. has_many :account_moderation_notes, dependent: :destroy
  91. has_many :targeted_moderation_notes, class_name: 'AccountModerationNote', foreign_key: :target_account_id, dependent: :destroy
  92. # Lists
  93. has_many :list_accounts, inverse_of: :account, dependent: :destroy
  94. has_many :lists, through: :list_accounts
  95. # Account migrations
  96. belongs_to :moved_to_account, class_name: 'Account', optional: true
  97. scope :remote, -> { where.not(domain: nil) }
  98. scope :local, -> { where(domain: nil) }
  99. scope :without_followers, -> { where(followers_count: 0) }
  100. scope :with_followers, -> { where('followers_count > 0') }
  101. scope :expiring, ->(time) { remote.where.not(subscription_expires_at: nil).where('subscription_expires_at < ?', time) }
  102. scope :partitioned, -> { order(Arel.sql('row_number() over (partition by domain)')) }
  103. scope :silenced, -> { where(silenced: true) }
  104. scope :suspended, -> { where(suspended: true) }
  105. scope :without_suspended, -> { where(suspended: false) }
  106. scope :recent, -> { reorder(id: :desc) }
  107. scope :alphabetic, -> { order(domain: :asc, username: :asc) }
  108. scope :by_domain_accounts, -> { group(:domain).select(:domain, 'COUNT(*) AS accounts_count').order('accounts_count desc') }
  109. scope :matches_username, ->(value) { where(arel_table[:username].matches("#{value}%")) }
  110. scope :matches_display_name, ->(value) { where(arel_table[:display_name].matches("#{value}%")) }
  111. scope :matches_domain, ->(value) { where(arel_table[:domain].matches("%#{value}%")) }
  112. delegate :email,
  113. :unconfirmed_email,
  114. :current_sign_in_ip,
  115. :current_sign_in_at,
  116. :confirmed?,
  117. :admin?,
  118. :moderator?,
  119. :staff?,
  120. :locale,
  121. :hides_network?,
  122. to: :user,
  123. prefix: true,
  124. allow_nil: true
  125. delegate :chosen_languages, to: :user, prefix: false, allow_nil: true
  126. def local?
  127. domain.nil?
  128. end
  129. def moved?
  130. moved_to_account_id.present?
  131. end
  132. def bot?
  133. %w(Application Service).include? actor_type
  134. end
  135. alias bot bot?
  136. def bot=(val)
  137. self.actor_type = ActiveModel::Type::Boolean.new.cast(val) ? 'Service' : 'Person'
  138. end
  139. def acct
  140. local? ? username : "#{username}@#{domain}"
  141. end
  142. def local_username_and_domain
  143. "#{username}@#{Rails.configuration.x.local_domain}"
  144. end
  145. def to_webfinger_s
  146. "acct:#{local_username_and_domain}"
  147. end
  148. def subscribed?
  149. subscription_expires_at.present?
  150. end
  151. def possibly_stale?
  152. last_webfingered_at.nil? || last_webfingered_at <= 1.day.ago
  153. end
  154. def refresh!
  155. return if local?
  156. ResolveAccountService.new.call(acct)
  157. end
  158. def unsuspend!
  159. transaction do
  160. user&.enable! if local?
  161. update!(suspended: false)
  162. end
  163. end
  164. def memorialize!
  165. transaction do
  166. user&.disable! if local?
  167. update!(memorial: true)
  168. end
  169. end
  170. def keypair
  171. @keypair ||= OpenSSL::PKey::RSA.new(private_key || public_key)
  172. end
  173. def fields
  174. (self[:fields] || []).map { |f| Field.new(self, f) }
  175. end
  176. def fields_attributes=(attributes)
  177. fields = []
  178. if attributes.is_a?(Hash)
  179. attributes.each_value do |attr|
  180. next if attr[:name].blank?
  181. fields << attr
  182. end
  183. end
  184. self[:fields] = fields
  185. end
  186. def build_fields
  187. return if fields.size >= 4
  188. raw_fields = self[:fields] || []
  189. add_fields = 4 - raw_fields.size
  190. add_fields.times { raw_fields << { name: '', value: '' } }
  191. self.fields = raw_fields
  192. end
  193. def magic_key
  194. modulus, exponent = [keypair.public_key.n, keypair.public_key.e].map do |component|
  195. result = []
  196. until component.zero?
  197. result << [component % 256].pack('C')
  198. component >>= 8
  199. end
  200. result.reverse.join
  201. end
  202. (['RSA'] + [modulus, exponent].map { |n| Base64.urlsafe_encode64(n) }).join('.')
  203. end
  204. def subscription(webhook_url)
  205. @subscription ||= OStatus2::Subscription.new(remote_url, secret: secret, webhook: webhook_url, hub: hub_url)
  206. end
  207. def save_with_optional_media!
  208. save!
  209. rescue ActiveRecord::RecordInvalid
  210. self.avatar = nil
  211. self.header = nil
  212. self[:avatar_remote_url] = ''
  213. self[:header_remote_url] = ''
  214. save!
  215. end
  216. def object_type
  217. :person
  218. end
  219. def to_param
  220. username
  221. end
  222. def excluded_from_timeline_account_ids
  223. Rails.cache.fetch("exclude_account_ids_for:#{id}") { blocking.pluck(:target_account_id) + blocked_by.pluck(:account_id) + muting.pluck(:target_account_id) }
  224. end
  225. def excluded_from_timeline_domains
  226. Rails.cache.fetch("exclude_domains_for:#{id}") { domain_blocks.pluck(:domain) }
  227. end
  228. def preferred_inbox_url
  229. shared_inbox_url.presence || inbox_url
  230. end
  231. class Field < ActiveModelSerializers::Model
  232. attributes :name, :value, :account, :errors
  233. def initialize(account, attr)
  234. @account = account
  235. @name = attr['name'].strip[0, 255]
  236. @value = attr['value'].strip[0, 255]
  237. @errors = {}
  238. end
  239. def to_h
  240. { name: @name, value: @value }
  241. end
  242. end
  243. class << self
  244. def readonly_attributes
  245. super - %w(statuses_count following_count followers_count)
  246. end
  247. def domains
  248. reorder(nil).pluck(Arel.sql('distinct accounts.domain'))
  249. end
  250. def inboxes
  251. urls = reorder(nil).where(protocol: :activitypub).pluck(Arel.sql("distinct coalesce(nullif(accounts.shared_inbox_url, ''), accounts.inbox_url)"))
  252. DeliveryFailureTracker.filter(urls)
  253. end
  254. def triadic_closures(account, limit: 5, offset: 0)
  255. sql = <<-SQL.squish
  256. WITH first_degree AS (
  257. SELECT target_account_id
  258. FROM follows
  259. WHERE account_id = :account_id
  260. )
  261. SELECT accounts.*
  262. FROM follows
  263. INNER JOIN accounts ON follows.target_account_id = accounts.id
  264. WHERE
  265. account_id IN (SELECT * FROM first_degree)
  266. AND target_account_id NOT IN (SELECT * FROM first_degree)
  267. AND target_account_id NOT IN (:excluded_account_ids)
  268. AND accounts.suspended = false
  269. GROUP BY target_account_id, accounts.id
  270. ORDER BY count(account_id) DESC
  271. OFFSET :offset
  272. LIMIT :limit
  273. SQL
  274. excluded_account_ids = account.excluded_from_timeline_account_ids + [account.id]
  275. find_by_sql(
  276. [sql, { account_id: account.id, excluded_account_ids: excluded_account_ids, limit: limit, offset: offset }]
  277. )
  278. end
  279. def search_for(terms, limit = 10)
  280. textsearch, query = generate_query_for_search(terms)
  281. sql = <<-SQL.squish
  282. SELECT
  283. accounts.*,
  284. ts_rank_cd(#{textsearch}, #{query}, 32) AS rank
  285. FROM accounts
  286. WHERE #{query} @@ #{textsearch}
  287. AND accounts.suspended = false
  288. AND accounts.moved_to_account_id IS NULL
  289. ORDER BY rank DESC
  290. LIMIT ?
  291. SQL
  292. find_by_sql([sql, limit])
  293. end
  294. def advanced_search_for(terms, account, limit = 10, following = false)
  295. textsearch, query = generate_query_for_search(terms)
  296. if following
  297. sql = <<-SQL.squish
  298. WITH first_degree AS (
  299. SELECT target_account_id
  300. FROM follows
  301. WHERE account_id = ?
  302. )
  303. SELECT
  304. accounts.*,
  305. (count(f.id) + 1) * ts_rank_cd(#{textsearch}, #{query}, 32) AS rank
  306. FROM accounts
  307. LEFT OUTER JOIN follows AS f ON (accounts.id = f.account_id AND f.target_account_id = ?) OR (accounts.id = f.target_account_id AND f.account_id = ?)
  308. WHERE accounts.id IN (SELECT * FROM first_degree)
  309. AND #{query} @@ #{textsearch}
  310. AND accounts.suspended = false
  311. AND accounts.moved_to_account_id IS NULL
  312. GROUP BY accounts.id
  313. ORDER BY rank DESC
  314. LIMIT ?
  315. SQL
  316. find_by_sql([sql, account.id, account.id, account.id, limit])
  317. else
  318. sql = <<-SQL.squish
  319. SELECT
  320. accounts.*,
  321. (count(f.id) + 1) * ts_rank_cd(#{textsearch}, #{query}, 32) AS rank
  322. FROM accounts
  323. LEFT OUTER JOIN follows AS f ON (accounts.id = f.account_id AND f.target_account_id = ?) OR (accounts.id = f.target_account_id AND f.account_id = ?)
  324. WHERE #{query} @@ #{textsearch}
  325. AND accounts.suspended = false
  326. AND accounts.moved_to_account_id IS NULL
  327. GROUP BY accounts.id
  328. ORDER BY rank DESC
  329. LIMIT ?
  330. SQL
  331. find_by_sql([sql, account.id, account.id, limit])
  332. end
  333. end
  334. private
  335. def generate_query_for_search(terms)
  336. terms = Arel.sql(connection.quote(terms.gsub(/['?\\:]/, ' ')))
  337. textsearch = "(setweight(to_tsvector('simple', accounts.display_name), 'A') || setweight(to_tsvector('simple', accounts.username), 'B') || setweight(to_tsvector('simple', coalesce(accounts.domain, '')), 'C'))"
  338. query = "to_tsquery('simple', ''' ' || #{terms} || ' ''' || ':*')"
  339. [textsearch, query]
  340. end
  341. end
  342. def emojis
  343. @emojis ||= CustomEmoji.from_text(emojifiable_text, domain)
  344. end
  345. before_create :generate_keys
  346. before_validation :normalize_domain
  347. before_validation :prepare_contents, if: :local?
  348. private
  349. def prepare_contents
  350. display_name&.strip!
  351. note&.strip!
  352. end
  353. def generate_keys
  354. return unless local? && !Rails.env.test?
  355. keypair = OpenSSL::PKey::RSA.new(2048)
  356. self.private_key = keypair.to_pem
  357. self.public_key = keypair.public_key.to_pem
  358. end
  359. def normalize_domain
  360. return if local?
  361. self.domain = TagManager.instance.normalize_domain(domain)
  362. end
  363. def emojifiable_text
  364. [note, display_name, fields.map(&:value)].join(' ')
  365. end
  366. end