You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

176 lines
5.8 KiB

Add follower synchronization mechanism (#14510) * Add support for followers synchronization on the receiving end Check the `collectionSynchronization` attribute on `Create` and `Announce` activities and synchronize followers from provided collection if possible. * Add tests for followers synchronization on the receiving end * Add support for follower synchronization on the sender's end * Add tests for the sending end * Switch from AS attributes to HTTP header Replace the custom `collectionSynchronization` ActivityStreams attribute by an HTTP header (`X-AS-Collection-Synchronization`) with the same syntax as the `Signature` header and the following fields: - `collectionId` to specify which collection to synchronize - `digest` for the SHA256 hex-digest of the list of followers known on the receiving instance (where “receiving instance” is determined by accounts sharing the same host name for their ActivityPub actor `id`) - `url` of a collection that should be fetched by the instance actor Internally, move away from the webfinger-based `domain` attribute and use account `uri` prefix to group accounts. * Add environment variable to disable followers synchronization Since the whole mechanism relies on some new preconditions that, in some extremely rare cases, might not be met, add an environment variable (DISABLE_FOLLOWERS_SYNCHRONIZATION) to disable the mechanism altogether and avoid followers being incorrectly removed. The current conditions are: 1. all managed accounts' actor `id` and inbox URL have the same URI scheme and netloc. 2. all accounts whose actor `id` or inbox URL share the same URI scheme and netloc as a managed account must be managed by the same Mastodon instance as well. As far as Mastodon is concerned, breaking those preconditions require extensive configuration changes in the reverse proxy and might also cause other issues. Therefore, this environment variable provides a way out for people with highly unusual configurations, and can be safely ignored for the overwhelming majority of Mastodon administrators. * Only set follower synchronization header on non-public statuses This is to avoid unnecessary computations and allow Follow-related activities to be handled by the usual codepath instead of going through the synchronization mechanism (otherwise, any Follow/Undo/Accept activity would trigger the synchronization mechanism even if processing the activity itself would be enough to re-introduce synchronization) * Change how ActivityPub::SynchronizeFollowersService handles follow requests If the remote lists a local follower which we only know has sent a follow request, consider the follow request as accepted instead of sending an Undo. * Integrate review feeback - rename X-AS-Collection-Synchronization to Collection-Synchronization - various minor refactoring and code style changes * Only select required fields when computing followers_hash * Use actor URI rather than webfinger domain in synchronization endpoint * Change hash computation to be a XOR of individual hashes Makes it much easier to be memory-efficient, and avoid sorting discrepancy issues. * Marginally improve followers_hash computation speed * Further improve hash computation performances by using pluck_each
3 years ago
  1. # frozen_string_literal: true
  2. require 'singleton'
  3. class ActivityPub::TagManager
  4. include Singleton
  5. include RoutingHelper
  6. CONTEXT = 'https://www.w3.org/ns/activitystreams'
  7. COLLECTIONS = {
  8. public: 'https://www.w3.org/ns/activitystreams#Public',
  9. }.freeze
  10. def public_collection?(uri)
  11. uri == COLLECTIONS[:public] || uri == 'as:Public' || uri == 'Public'
  12. end
  13. def url_for(target)
  14. return target.url if target.respond_to?(:local?) && !target.local?
  15. return unless target.respond_to?(:object_type)
  16. case target.object_type
  17. when :person
  18. target.instance_actor? ? about_more_url(instance_actor: true) : short_account_url(target)
  19. when :note, :comment, :activity
  20. return activity_account_status_url(target.account, target) if target.reblog?
  21. short_account_status_url(target.account, target)
  22. end
  23. end
  24. def uri_for(target)
  25. return target.uri if target.respond_to?(:local?) && !target.local?
  26. case target.object_type
  27. when :person
  28. target.instance_actor? ? instance_actor_url : account_url(target)
  29. when :note, :comment, :activity
  30. return activity_account_status_url(target.account, target) if target.reblog?
  31. account_status_url(target.account, target)
  32. when :emoji
  33. emoji_url(target)
  34. end
  35. end
  36. def uri_for_username(username)
  37. account_url(username: username)
  38. end
  39. def generate_uri_for(_target)
  40. URI.join(root_url, 'payloads', SecureRandom.uuid)
  41. end
  42. def activity_uri_for(target)
  43. raise ArgumentError, 'target must be a local activity' unless %i(note comment activity).include?(target.object_type) && target.local?
  44. activity_account_status_url(target.account, target)
  45. end
  46. def replies_uri_for(target, page_params = nil)
  47. raise ArgumentError, 'target must be a local activity' unless %i(note comment activity).include?(target.object_type) && target.local?
  48. account_status_replies_url(target.account, target, page_params)
  49. end
  50. def followers_uri_for(target)
  51. target.local? ? account_followers_url(target) : target.followers_url.presence
  52. end
  53. # Primary audience of a status
  54. # Public statuses go out to primarily the public collection
  55. # Unlisted and private statuses go out primarily to the followers collection
  56. # Others go out only to the people they mention
  57. def to(status)
  58. case status.visibility
  59. when 'public'
  60. [COLLECTIONS[:public]]
  61. when 'unlisted', 'private'
  62. [account_followers_url(status.account)]
  63. when 'direct', 'limited'
  64. if status.account.silenced?
  65. # Only notify followers if the account is locally silenced
  66. account_ids = status.active_mentions.pluck(:account_id)
  67. to = status.account.followers.where(id: account_ids).each_with_object([]) do |account, result|
  68. result << uri_for(account)
  69. result << followers_uri_for(account) if account.group?
  70. end
  71. to.concat(FollowRequest.where(target_account_id: status.account_id, account_id: account_ids).each_with_object([]) do |request, result|
  72. result << uri_for(request.account)
  73. result << followers_uri_for(request.account) if request.account.group?
  74. end).compact
  75. else
  76. status.active_mentions.each_with_object([]) do |mention, result|
  77. result << uri_for(mention.account)
  78. result << followers_uri_for(mention.account) if mention.account.group?
  79. end.compact
  80. end
  81. end
  82. end
  83. # Secondary audience of a status
  84. # Public statuses go out to followers as well
  85. # Unlisted statuses go to the public as well
  86. # Both of those and private statuses also go to the people mentioned in them
  87. # Direct ones don't have a secondary audience
  88. def cc(status)
  89. cc = []
  90. cc << uri_for(status.reblog.account) if status.reblog?
  91. case status.visibility
  92. when 'public'
  93. cc << account_followers_url(status.account)
  94. when 'unlisted'
  95. cc << COLLECTIONS[:public]
  96. end
  97. unless status.direct_visibility? || status.limited_visibility?
  98. if status.account.silenced?
  99. # Only notify followers if the account is locally silenced
  100. account_ids = status.active_mentions.pluck(:account_id)
  101. cc.concat(status.account.followers.where(id: account_ids).each_with_object([]) do |account, result|
  102. result << uri_for(account)
  103. result << followers_uri_for(account) if account.group?
  104. end.compact)
  105. cc.concat(FollowRequest.where(target_account_id: status.account_id, account_id: account_ids).each_with_object([]) do |request, result|
  106. result << uri_for(request.account)
  107. result << followers_uri_for(request.account) if request.account.group?
  108. end.compact)
  109. else
  110. cc.concat(status.active_mentions.each_with_object([]) do |mention, result|
  111. result << uri_for(mention.account)
  112. result << followers_uri_for(mention.account) if mention.account.group?
  113. end.compact)
  114. end
  115. end
  116. cc
  117. end
  118. def local_uri?(uri)
  119. return false if uri.nil?
  120. uri = Addressable::URI.parse(uri)
  121. host = uri.normalized_host
  122. host = "#{host}:#{uri.port}" if uri.port
  123. !host.nil? && (::TagManager.instance.local_domain?(host) || ::TagManager.instance.web_domain?(host))
  124. end
  125. def uri_to_local_id(uri, param = :id)
  126. path_params = Rails.application.routes.recognize_path(uri)
  127. path_params[:username] = Rails.configuration.x.local_domain if path_params[:controller] == 'instance_actors'
  128. path_params[param]
  129. end
  130. def uri_to_resource(uri, klass)
  131. return if uri.nil?
  132. if local_uri?(uri)
  133. case klass.name
  134. when 'Account'
  135. klass.find_local(uri_to_local_id(uri, :username))
  136. else
  137. StatusFinder.new(uri).status
  138. end
  139. elsif OStatus::TagManager.instance.local_id?(uri)
  140. klass.find_by(id: OStatus::TagManager.instance.unique_tag_to_local_id(uri, klass.to_s))
  141. else
  142. klass.find_by(uri: uri.split('#').first)
  143. end
  144. rescue ActiveRecord::RecordNotFound
  145. nil
  146. end
  147. end