You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

478 lines
15 KiB

Account domain blocks (#2381) * Add <ostatus:conversation /> tag to Atom input/output Only uses ref attribute (not href) because href would be the alternate link that's always included also. Creates new conversation for every non-reply status. Carries over conversation for every reply. Keeps remote URIs verbatim, generates local URIs on the fly like the rest of them. * Conversation muting - prevents notifications that reference a conversation (including replies, favourites, reblogs) from being created. API endpoints /api/v1/statuses/:id/mute and /api/v1/statuses/:id/unmute Currently no way to tell when a status/conversation is muted, so the web UI only has a "disable notifications" button, doesn't work as a toggle * Display "Dismiss notifications" on all statuses in notifications column, not just own * Add "muted" as a boolean attribute on statuses JSON For now always false on contained reblogs, since it's only relevant for statuses returned from the notifications endpoint, which are not nested Remove "Disable notifications" from detailed status view, since it's only relevant in the notifications column * Up max class length * Remove pending test for conversation mute * Add tests, clean up * Rename to "mute conversation" and "unmute conversation" * Raise validation error when trying to mute/unmute status without conversation * Adding account domain blocks that filter notifications and public timelines * Add tests for domain blocks in notifications, public timelines Filter reblogs of blocked domains from home * Add API for listing and creating account domain blocks * API for creating/deleting domain blocks, tests for Status#ancestors and Status#descendants, filter domain blocks from them * Filter domains in streaming API * Update account_domain_block_spec.rb
7 years ago
Fix Account model deprecation warnings (#3689) ``` DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:61) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:62) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:63) ``` Here's PR describing changes to Dirty API https://github.com/rails/rails/pull/25337
7 years ago
Fix Account model deprecation warnings (#3689) ``` DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:60) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:61) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:62) DEPRECATION WARNING: The behavior of `attribute_changed?` inside of after callbacks will be changing in the next version of Rails. The new return value will reflect the behavior of calling the method after `save` returned (e.g. the opposite of what it returns now). To maintain the current behavior, use `saved_change_to_attribute?` instead. (called from block in <class:Account> at /Users/rene/Workspace/personal/ruby/mastodon/app/models/account.rb:63) ``` Here's PR describing changes to Dirty API https://github.com/rails/rails/pull/25337
7 years ago
8 years ago
8 years ago
8 years ago
Account domain blocks (#2381) * Add <ostatus:conversation /> tag to Atom input/output Only uses ref attribute (not href) because href would be the alternate link that's always included also. Creates new conversation for every non-reply status. Carries over conversation for every reply. Keeps remote URIs verbatim, generates local URIs on the fly like the rest of them. * Conversation muting - prevents notifications that reference a conversation (including replies, favourites, reblogs) from being created. API endpoints /api/v1/statuses/:id/mute and /api/v1/statuses/:id/unmute Currently no way to tell when a status/conversation is muted, so the web UI only has a "disable notifications" button, doesn't work as a toggle * Display "Dismiss notifications" on all statuses in notifications column, not just own * Add "muted" as a boolean attribute on statuses JSON For now always false on contained reblogs, since it's only relevant for statuses returned from the notifications endpoint, which are not nested Remove "Disable notifications" from detailed status view, since it's only relevant in the notifications column * Up max class length * Remove pending test for conversation mute * Add tests, clean up * Rename to "mute conversation" and "unmute conversation" * Raise validation error when trying to mute/unmute status without conversation * Adding account domain blocks that filter notifications and public timelines * Add tests for domain blocks in notifications, public timelines Filter reblogs of blocked domains from home * Add API for listing and creating account domain blocks * API for creating/deleting domain blocks, tests for Status#ancestors and Status#descendants, filter domain blocks from them * Filter domains in streaming API * Update account_domain_block_spec.rb
7 years ago
8 years ago
  1. # frozen_string_literal: true
  2. # == Schema Information
  3. #
  4. # Table name: accounts
  5. #
  6. # id :bigint(8) not null, primary key
  7. # username :string default(""), not null
  8. # domain :string
  9. # secret :string default(""), not null
  10. # private_key :text
  11. # public_key :text default(""), not null
  12. # remote_url :string default(""), not null
  13. # salmon_url :string default(""), not null
  14. # hub_url :string default(""), not null
  15. # created_at :datetime not null
  16. # updated_at :datetime not null
  17. # note :text default(""), not null
  18. # display_name :string default(""), not null
  19. # uri :string default(""), not null
  20. # url :string
  21. # avatar_file_name :string
  22. # avatar_content_type :string
  23. # avatar_file_size :integer
  24. # avatar_updated_at :datetime
  25. # header_file_name :string
  26. # header_content_type :string
  27. # header_file_size :integer
  28. # header_updated_at :datetime
  29. # avatar_remote_url :string
  30. # subscription_expires_at :datetime
  31. # silenced :boolean default(FALSE), not null
  32. # suspended :boolean default(FALSE), not null
  33. # locked :boolean default(FALSE), not null
  34. # header_remote_url :string default(""), not null
  35. # statuses_count :integer default(0), not null
  36. # followers_count :integer default(0), not null
  37. # following_count :integer default(0), not null
  38. # last_webfingered_at :datetime
  39. # inbox_url :string default(""), not null
  40. # outbox_url :string default(""), not null
  41. # shared_inbox_url :string default(""), not null
  42. # followers_url :string default(""), not null
  43. # protocol :integer default("ostatus"), not null
  44. # memorial :boolean default(FALSE), not null
  45. # moved_to_account_id :bigint(8)
  46. # featured_collection_url :string
  47. # fields :jsonb
  48. # actor_type :string
  49. #
  50. class Account < ApplicationRecord
  51. USERNAME_RE = /[a-z0-9_]+([a-z0-9_\.]+[a-z0-9_]+)?/i
  52. MENTION_RE = /(?<=^|[^\/[:word:]])@((#{USERNAME_RE})(?:@[a-z0-9\.\-]+[a-z0-9]+)?)/i
  53. include AccountAvatar
  54. include AccountFinderConcern
  55. include AccountHeader
  56. include AccountInteractions
  57. include Attachmentable
  58. include Paginable
  59. enum protocol: [:ostatus, :activitypub]
  60. # Local users
  61. has_one :user, inverse_of: :account
  62. validates :username, presence: true
  63. # Remote user validations
  64. validates :username, uniqueness: { scope: :domain, case_sensitive: true }, if: -> { !local? && will_save_change_to_username? }
  65. validates :username, format: { with: /\A#{USERNAME_RE}\z/i }, if: -> { !local? && will_save_change_to_username? }
  66. # Local user validations
  67. validates :username, format: { with: /\A[a-z0-9_]+\z/i }, length: { maximum: 30 }, if: -> { local? && will_save_change_to_username? }
  68. validates_with UniqueUsernameValidator, if: -> { local? && will_save_change_to_username? }
  69. validates_with UnreservedUsernameValidator, if: -> { local? && will_save_change_to_username? }
  70. validates :display_name, length: { maximum: 30 }, if: -> { local? && will_save_change_to_display_name? }
  71. validates :note, length: { maximum: 160 }, if: -> { local? && will_save_change_to_note? }
  72. validates :fields, length: { maximum: 4 }, if: -> { local? && will_save_change_to_fields? }
  73. # Timelines
  74. has_many :stream_entries, inverse_of: :account, dependent: :destroy
  75. has_many :statuses, inverse_of: :account, dependent: :destroy
  76. has_many :favourites, inverse_of: :account, dependent: :destroy
  77. has_many :mentions, inverse_of: :account, dependent: :destroy
  78. has_many :notifications, inverse_of: :account, dependent: :destroy
  79. # Pinned statuses
  80. has_many :status_pins, inverse_of: :account, dependent: :destroy
  81. has_many :pinned_statuses, -> { reorder('status_pins.created_at DESC') }, through: :status_pins, class_name: 'Status', source: :status
  82. # Endorsements
  83. has_many :account_pins, inverse_of: :account, dependent: :destroy
  84. has_many :endorsed_accounts, through: :account_pins, class_name: 'Account', source: :target_account
  85. # Media
  86. has_many :media_attachments, dependent: :destroy
  87. # PuSH subscriptions
  88. has_many :subscriptions, dependent: :destroy
  89. # Report relationships
  90. has_many :reports
  91. has_many :targeted_reports, class_name: 'Report', foreign_key: :target_account_id
  92. has_many :report_notes, dependent: :destroy
  93. has_many :custom_filters, inverse_of: :account, dependent: :destroy
  94. # Moderation notes
  95. has_many :account_moderation_notes, dependent: :destroy
  96. has_many :targeted_moderation_notes, class_name: 'AccountModerationNote', foreign_key: :target_account_id, dependent: :destroy
  97. # Lists
  98. has_many :list_accounts, inverse_of: :account, dependent: :destroy
  99. has_many :lists, through: :list_accounts
  100. # Account migrations
  101. belongs_to :moved_to_account, class_name: 'Account', optional: true
  102. scope :remote, -> { where.not(domain: nil) }
  103. scope :local, -> { where(domain: nil) }
  104. scope :without_followers, -> { where(followers_count: 0) }
  105. scope :with_followers, -> { where('followers_count > 0') }
  106. scope :expiring, ->(time) { remote.where.not(subscription_expires_at: nil).where('subscription_expires_at < ?', time) }
  107. scope :partitioned, -> { order(Arel.sql('row_number() over (partition by domain)')) }
  108. scope :silenced, -> { where(silenced: true) }
  109. scope :suspended, -> { where(suspended: true) }
  110. scope :without_suspended, -> { where(suspended: false) }
  111. scope :recent, -> { reorder(id: :desc) }
  112. scope :alphabetic, -> { order(domain: :asc, username: :asc) }
  113. scope :by_domain_accounts, -> { group(:domain).select(:domain, 'COUNT(*) AS accounts_count').order('accounts_count desc') }
  114. scope :matches_username, ->(value) { where(arel_table[:username].matches("#{value}%")) }
  115. scope :matches_display_name, ->(value) { where(arel_table[:display_name].matches("#{value}%")) }
  116. scope :matches_domain, ->(value) { where(arel_table[:domain].matches("%#{value}%")) }
  117. scope :searchable, -> { where(suspended: false).where(moved_to_account_id: nil) }
  118. delegate :email,
  119. :unconfirmed_email,
  120. :current_sign_in_ip,
  121. :current_sign_in_at,
  122. :confirmed?,
  123. :admin?,
  124. :moderator?,
  125. :staff?,
  126. :locale,
  127. :hides_network?,
  128. to: :user,
  129. prefix: true,
  130. allow_nil: true
  131. delegate :chosen_languages, to: :user, prefix: false, allow_nil: true
  132. def local?
  133. domain.nil?
  134. end
  135. def moved?
  136. moved_to_account_id.present?
  137. end
  138. def bot?
  139. %w(Application Service).include? actor_type
  140. end
  141. alias bot bot?
  142. def bot=(val)
  143. self.actor_type = ActiveModel::Type::Boolean.new.cast(val) ? 'Service' : 'Person'
  144. end
  145. def acct
  146. local? ? username : "#{username}@#{domain}"
  147. end
  148. def local_username_and_domain
  149. "#{username}@#{Rails.configuration.x.local_domain}"
  150. end
  151. def to_webfinger_s
  152. "acct:#{local_username_and_domain}"
  153. end
  154. def subscribed?
  155. subscription_expires_at.present?
  156. end
  157. def possibly_stale?
  158. last_webfingered_at.nil? || last_webfingered_at <= 1.day.ago
  159. end
  160. def refresh!
  161. return if local?
  162. ResolveAccountService.new.call(acct)
  163. end
  164. def suspend!
  165. transaction do
  166. user&.disable! if local?
  167. update!(suspended: true)
  168. end
  169. end
  170. def unsuspend!
  171. transaction do
  172. user&.enable! if local?
  173. update!(suspended: false)
  174. end
  175. end
  176. def memorialize!
  177. transaction do
  178. user&.disable! if local?
  179. update!(memorial: true)
  180. end
  181. end
  182. def keypair
  183. @keypair ||= OpenSSL::PKey::RSA.new(private_key || public_key)
  184. end
  185. def fields
  186. (self[:fields] || []).map { |f| Field.new(self, f) }
  187. end
  188. def fields_attributes=(attributes)
  189. fields = []
  190. old_fields = self[:fields] || []
  191. if attributes.is_a?(Hash)
  192. attributes.each_value do |attr|
  193. next if attr[:name].blank?
  194. previous = old_fields.find { |item| item['value'] == attr[:value] }
  195. if previous && previous['verified_at'].present?
  196. attr[:verified_at] = previous['verified_at']
  197. end
  198. fields << attr
  199. end
  200. end
  201. self[:fields] = fields
  202. end
  203. DEFAULT_FIELDS_SIZE = 4
  204. def build_fields
  205. return if fields.size >= DEFAULT_FIELDS_SIZE
  206. tmp = self[:fields] || []
  207. (DEFAULT_FIELDS_SIZE - tmp.size).times do
  208. tmp << { name: '', value: '' }
  209. end
  210. self.fields = tmp
  211. end
  212. def magic_key
  213. modulus, exponent = [keypair.public_key.n, keypair.public_key.e].map do |component|
  214. result = []
  215. until component.zero?
  216. result << [component % 256].pack('C')
  217. component >>= 8
  218. end
  219. result.reverse.join
  220. end
  221. (['RSA'] + [modulus, exponent].map { |n| Base64.urlsafe_encode64(n) }).join('.')
  222. end
  223. def subscription(webhook_url)
  224. @subscription ||= OStatus2::Subscription.new(remote_url, secret: secret, webhook: webhook_url, hub: hub_url)
  225. end
  226. def save_with_optional_media!
  227. save!
  228. rescue ActiveRecord::RecordInvalid
  229. self.avatar = nil
  230. self.header = nil
  231. self[:avatar_remote_url] = ''
  232. self[:header_remote_url] = ''
  233. save!
  234. end
  235. def object_type
  236. :person
  237. end
  238. def to_param
  239. username
  240. end
  241. def excluded_from_timeline_account_ids
  242. Rails.cache.fetch("exclude_account_ids_for:#{id}") { blocking.pluck(:target_account_id) + blocked_by.pluck(:account_id) + muting.pluck(:target_account_id) }
  243. end
  244. def excluded_from_timeline_domains
  245. Rails.cache.fetch("exclude_domains_for:#{id}") { domain_blocks.pluck(:domain) }
  246. end
  247. def preferred_inbox_url
  248. shared_inbox_url.presence || inbox_url
  249. end
  250. class Field < ActiveModelSerializers::Model
  251. attributes :name, :value, :verified_at, :account, :errors
  252. def initialize(account, attributes)
  253. @account = account
  254. @attributes = attributes
  255. @name = attributes['name'].strip[0, string_limit]
  256. @value = attributes['value'].strip[0, string_limit]
  257. @verified_at = attributes['verified_at']&.to_datetime
  258. @errors = {}
  259. end
  260. def verified?
  261. verified_at.present?
  262. end
  263. def value_for_verification
  264. @value_for_verification ||= begin
  265. if account.local?
  266. value
  267. else
  268. ActionController::Base.helpers.strip_tags(value)
  269. end
  270. end
  271. end
  272. def verifiable?
  273. value_for_verification.present? && value_for_verification.start_with?('http://', 'https://')
  274. end
  275. def mark_verified!
  276. @verified_at = Time.now.utc
  277. @attributes['verified_at'] = @verified_at
  278. end
  279. def to_h
  280. { name: @name, value: @value, verified_at: @verified_at }
  281. end
  282. private
  283. def string_limit
  284. if account.local?
  285. 255
  286. else
  287. 2047
  288. end
  289. end
  290. end
  291. class << self
  292. def readonly_attributes
  293. super - %w(statuses_count following_count followers_count)
  294. end
  295. def domains
  296. reorder(nil).pluck(Arel.sql('distinct accounts.domain'))
  297. end
  298. def inboxes
  299. urls = reorder(nil).where(protocol: :activitypub).pluck(Arel.sql("distinct coalesce(nullif(accounts.shared_inbox_url, ''), accounts.inbox_url)"))
  300. DeliveryFailureTracker.filter(urls)
  301. end
  302. def search_for(terms, limit = 10)
  303. textsearch, query = generate_query_for_search(terms)
  304. sql = <<-SQL.squish
  305. SELECT
  306. accounts.*,
  307. ts_rank_cd(#{textsearch}, #{query}, 32) AS rank
  308. FROM accounts
  309. WHERE #{query} @@ #{textsearch}
  310. AND accounts.suspended = false
  311. AND accounts.moved_to_account_id IS NULL
  312. ORDER BY rank DESC
  313. LIMIT ?
  314. SQL
  315. find_by_sql([sql, limit])
  316. end
  317. def advanced_search_for(terms, account, limit = 10, following = false)
  318. textsearch, query = generate_query_for_search(terms)
  319. if following
  320. sql = <<-SQL.squish
  321. WITH first_degree AS (
  322. SELECT target_account_id
  323. FROM follows
  324. WHERE account_id = ?
  325. )
  326. SELECT
  327. accounts.*,
  328. (count(f.id) + 1) * ts_rank_cd(#{textsearch}, #{query}, 32) AS rank
  329. FROM accounts
  330. LEFT OUTER JOIN follows AS f ON (accounts.id = f.account_id AND f.target_account_id = ?) OR (accounts.id = f.target_account_id AND f.account_id = ?)
  331. WHERE accounts.id IN (SELECT * FROM first_degree)
  332. AND #{query} @@ #{textsearch}
  333. AND accounts.suspended = false
  334. AND accounts.moved_to_account_id IS NULL
  335. GROUP BY accounts.id
  336. ORDER BY rank DESC
  337. LIMIT ?
  338. SQL
  339. find_by_sql([sql, account.id, account.id, account.id, limit])
  340. else
  341. sql = <<-SQL.squish
  342. SELECT
  343. accounts.*,
  344. (count(f.id) + 1) * ts_rank_cd(#{textsearch}, #{query}, 32) AS rank
  345. FROM accounts
  346. LEFT OUTER JOIN follows AS f ON (accounts.id = f.account_id AND f.target_account_id = ?) OR (accounts.id = f.target_account_id AND f.account_id = ?)
  347. WHERE #{query} @@ #{textsearch}
  348. AND accounts.suspended = false
  349. AND accounts.moved_to_account_id IS NULL
  350. GROUP BY accounts.id
  351. ORDER BY rank DESC
  352. LIMIT ?
  353. SQL
  354. find_by_sql([sql, account.id, account.id, limit])
  355. end
  356. end
  357. private
  358. def generate_query_for_search(terms)
  359. terms = Arel.sql(connection.quote(terms.gsub(/['?\\:]/, ' ')))
  360. textsearch = "(setweight(to_tsvector('simple', accounts.display_name), 'A') || setweight(to_tsvector('simple', accounts.username), 'B') || setweight(to_tsvector('simple', coalesce(accounts.domain, '')), 'C'))"
  361. query = "to_tsquery('simple', ''' ' || #{terms} || ' ''' || ':*')"
  362. [textsearch, query]
  363. end
  364. end
  365. def emojis
  366. @emojis ||= CustomEmoji.from_text(emojifiable_text, domain)
  367. end
  368. before_create :generate_keys
  369. before_validation :normalize_domain
  370. before_validation :prepare_contents, if: :local?
  371. private
  372. def prepare_contents
  373. display_name&.strip!
  374. note&.strip!
  375. end
  376. def generate_keys
  377. return unless local? && !Rails.env.test?
  378. keypair = OpenSSL::PKey::RSA.new(2048)
  379. self.private_key = keypair.to_pem
  380. self.public_key = keypair.public_key.to_pem
  381. end
  382. def normalize_domain
  383. return if local?
  384. self.domain = TagManager.instance.normalize_domain(domain)
  385. end
  386. def emojifiable_text
  387. [note, display_name, fields.map(&:value)].join(' ')
  388. end
  389. end