You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

186 lines
6.0 KiB

Add follower synchronization mechanism (#14510) * Add support for followers synchronization on the receiving end Check the `collectionSynchronization` attribute on `Create` and `Announce` activities and synchronize followers from provided collection if possible. * Add tests for followers synchronization on the receiving end * Add support for follower synchronization on the sender's end * Add tests for the sending end * Switch from AS attributes to HTTP header Replace the custom `collectionSynchronization` ActivityStreams attribute by an HTTP header (`X-AS-Collection-Synchronization`) with the same syntax as the `Signature` header and the following fields: - `collectionId` to specify which collection to synchronize - `digest` for the SHA256 hex-digest of the list of followers known on the receiving instance (where “receiving instance” is determined by accounts sharing the same host name for their ActivityPub actor `id`) - `url` of a collection that should be fetched by the instance actor Internally, move away from the webfinger-based `domain` attribute and use account `uri` prefix to group accounts. * Add environment variable to disable followers synchronization Since the whole mechanism relies on some new preconditions that, in some extremely rare cases, might not be met, add an environment variable (DISABLE_FOLLOWERS_SYNCHRONIZATION) to disable the mechanism altogether and avoid followers being incorrectly removed. The current conditions are: 1. all managed accounts' actor `id` and inbox URL have the same URI scheme and netloc. 2. all accounts whose actor `id` or inbox URL share the same URI scheme and netloc as a managed account must be managed by the same Mastodon instance as well. As far as Mastodon is concerned, breaking those preconditions require extensive configuration changes in the reverse proxy and might also cause other issues. Therefore, this environment variable provides a way out for people with highly unusual configurations, and can be safely ignored for the overwhelming majority of Mastodon administrators. * Only set follower synchronization header on non-public statuses This is to avoid unnecessary computations and allow Follow-related activities to be handled by the usual codepath instead of going through the synchronization mechanism (otherwise, any Follow/Undo/Accept activity would trigger the synchronization mechanism even if processing the activity itself would be enough to re-introduce synchronization) * Change how ActivityPub::SynchronizeFollowersService handles follow requests If the remote lists a local follower which we only know has sent a follow request, consider the follow request as accepted instead of sending an Undo. * Integrate review feeback - rename X-AS-Collection-Synchronization to Collection-Synchronization - various minor refactoring and code style changes * Only select required fields when computing followers_hash * Use actor URI rather than webfinger domain in synchronization endpoint * Change hash computation to be a XOR of individual hashes Makes it much easier to be memory-efficient, and avoid sorting discrepancy issues. * Marginally improve followers_hash computation speed * Further improve hash computation performances by using pluck_each
3 years ago
  1. # frozen_string_literal: true
  2. require 'singleton'
  3. class ActivityPub::TagManager
  4. include Singleton
  5. include RoutingHelper
  6. CONTEXT = 'https://www.w3.org/ns/activitystreams'
  7. COLLECTIONS = {
  8. public: 'https://www.w3.org/ns/activitystreams#Public',
  9. }.freeze
  10. def public_collection?(uri)
  11. uri == COLLECTIONS[:public] || uri == 'as:Public' || uri == 'Public'
  12. end
  13. def url_for(target)
  14. return target.url if target.respond_to?(:local?) && !target.local?
  15. return unless target.respond_to?(:object_type)
  16. case target.object_type
  17. when :person
  18. target.instance_actor? ? about_more_url(instance_actor: true) : short_account_url(target)
  19. when :note, :comment, :activity
  20. return activity_account_status_url(target.account, target) if target.reblog?
  21. short_account_status_url(target.account, target)
  22. end
  23. end
  24. def uri_for(target)
  25. return target.uri if target.respond_to?(:local?) && !target.local?
  26. case target.object_type
  27. when :person
  28. target.instance_actor? ? instance_actor_url : account_url(target)
  29. when :note, :comment, :activity
  30. return activity_account_status_url(target.account, target) if target.reblog?
  31. account_status_url(target.account, target)
  32. when :emoji
  33. emoji_url(target)
  34. end
  35. end
  36. def key_uri_for(target)
  37. [uri_for(target), '#main-key'].join
  38. end
  39. def uri_for_username(username)
  40. account_url(username: username)
  41. end
  42. def generate_uri_for(_target)
  43. URI.join(root_url, 'payloads', SecureRandom.uuid)
  44. end
  45. def activity_uri_for(target)
  46. raise ArgumentError, 'target must be a local activity' unless %i(note comment activity).include?(target.object_type) && target.local?
  47. activity_account_status_url(target.account, target)
  48. end
  49. def replies_uri_for(target, page_params = nil)
  50. raise ArgumentError, 'target must be a local activity' unless %i(note comment activity).include?(target.object_type) && target.local?
  51. account_status_replies_url(target.account, target, page_params)
  52. end
  53. def followers_uri_for(target)
  54. target.local? ? account_followers_url(target) : target.followers_url.presence
  55. end
  56. # Primary audience of a status
  57. # Public statuses go out to primarily the public collection
  58. # Unlisted and private statuses go out primarily to the followers collection
  59. # Others go out only to the people they mention
  60. def to(status)
  61. case status.visibility
  62. when 'public'
  63. [COLLECTIONS[:public]]
  64. when 'unlisted', 'private'
  65. [account_followers_url(status.account)]
  66. when 'direct', 'limited'
  67. if status.account.silenced?
  68. # Only notify followers if the account is locally silenced
  69. account_ids = status.active_mentions.pluck(:account_id)
  70. to = status.account.followers.where(id: account_ids).each_with_object([]) do |account, result|
  71. result << uri_for(account)
  72. result << followers_uri_for(account) if account.group?
  73. end
  74. to.concat(FollowRequest.where(target_account_id: status.account_id, account_id: account_ids).each_with_object([]) do |request, result|
  75. result << uri_for(request.account)
  76. result << followers_uri_for(request.account) if request.account.group?
  77. end).compact
  78. else
  79. status.active_mentions.each_with_object([]) do |mention, result|
  80. result << uri_for(mention.account)
  81. result << followers_uri_for(mention.account) if mention.account.group?
  82. end.compact
  83. end
  84. end
  85. end
  86. # Secondary audience of a status
  87. # Public statuses go out to followers as well
  88. # Unlisted statuses go to the public as well
  89. # Both of those and private statuses also go to the people mentioned in them
  90. # Direct ones don't have a secondary audience
  91. def cc(status)
  92. cc = []
  93. cc << uri_for(status.reblog.account) if status.reblog?
  94. case status.visibility
  95. when 'public'
  96. cc << account_followers_url(status.account)
  97. when 'unlisted'
  98. cc << COLLECTIONS[:public]
  99. end
  100. unless status.direct_visibility? || status.limited_visibility?
  101. if status.account.silenced?
  102. # Only notify followers if the account is locally silenced
  103. account_ids = status.active_mentions.pluck(:account_id)
  104. cc.concat(status.account.followers.where(id: account_ids).each_with_object([]) do |account, result|
  105. result << uri_for(account)
  106. result << followers_uri_for(account) if account.group?
  107. end.compact)
  108. cc.concat(FollowRequest.where(target_account_id: status.account_id, account_id: account_ids).each_with_object([]) do |request, result|
  109. result << uri_for(request.account)
  110. result << followers_uri_for(request.account) if request.account.group?
  111. end.compact)
  112. else
  113. cc.concat(status.active_mentions.each_with_object([]) do |mention, result|
  114. result << uri_for(mention.account)
  115. result << followers_uri_for(mention.account) if mention.account.group?
  116. end.compact)
  117. end
  118. end
  119. cc
  120. end
  121. def local_uri?(uri)
  122. return false if uri.nil?
  123. uri = Addressable::URI.parse(uri)
  124. host = uri.normalized_host
  125. host = "#{host}:#{uri.port}" if uri.port
  126. !host.nil? && (::TagManager.instance.local_domain?(host) || ::TagManager.instance.web_domain?(host))
  127. end
  128. def uri_to_local_id(uri, param = :id)
  129. path_params = Rails.application.routes.recognize_path(uri)
  130. path_params[:username] = Rails.configuration.x.local_domain if path_params[:controller] == 'instance_actors'
  131. path_params[param]
  132. end
  133. def uri_to_actor(uri)
  134. uri_to_resource(uri, Account)
  135. end
  136. def uri_to_resource(uri, klass)
  137. return if uri.nil?
  138. if local_uri?(uri)
  139. case klass.name
  140. when 'Account'
  141. klass.find_local(uri_to_local_id(uri, :username))
  142. else
  143. StatusFinder.new(uri).status
  144. end
  145. elsif OStatus::TagManager.instance.local_id?(uri)
  146. klass.find_by(id: OStatus::TagManager.instance.unique_tag_to_local_id(uri, klass.to_s))
  147. else
  148. klass.find_by(uri: uri.split('#').first)
  149. end
  150. rescue ActiveRecord::RecordNotFound
  151. nil
  152. end
  153. end