You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

172 lines
5.7 KiB

Add follower synchronization mechanism (#14510) * Add support for followers synchronization on the receiving end Check the `collectionSynchronization` attribute on `Create` and `Announce` activities and synchronize followers from provided collection if possible. * Add tests for followers synchronization on the receiving end * Add support for follower synchronization on the sender's end * Add tests for the sending end * Switch from AS attributes to HTTP header Replace the custom `collectionSynchronization` ActivityStreams attribute by an HTTP header (`X-AS-Collection-Synchronization`) with the same syntax as the `Signature` header and the following fields: - `collectionId` to specify which collection to synchronize - `digest` for the SHA256 hex-digest of the list of followers known on the receiving instance (where “receiving instance” is determined by accounts sharing the same host name for their ActivityPub actor `id`) - `url` of a collection that should be fetched by the instance actor Internally, move away from the webfinger-based `domain` attribute and use account `uri` prefix to group accounts. * Add environment variable to disable followers synchronization Since the whole mechanism relies on some new preconditions that, in some extremely rare cases, might not be met, add an environment variable (DISABLE_FOLLOWERS_SYNCHRONIZATION) to disable the mechanism altogether and avoid followers being incorrectly removed. The current conditions are: 1. all managed accounts' actor `id` and inbox URL have the same URI scheme and netloc. 2. all accounts whose actor `id` or inbox URL share the same URI scheme and netloc as a managed account must be managed by the same Mastodon instance as well. As far as Mastodon is concerned, breaking those preconditions require extensive configuration changes in the reverse proxy and might also cause other issues. Therefore, this environment variable provides a way out for people with highly unusual configurations, and can be safely ignored for the overwhelming majority of Mastodon administrators. * Only set follower synchronization header on non-public statuses This is to avoid unnecessary computations and allow Follow-related activities to be handled by the usual codepath instead of going through the synchronization mechanism (otherwise, any Follow/Undo/Accept activity would trigger the synchronization mechanism even if processing the activity itself would be enough to re-introduce synchronization) * Change how ActivityPub::SynchronizeFollowersService handles follow requests If the remote lists a local follower which we only know has sent a follow request, consider the follow request as accepted instead of sending an Undo. * Integrate review feeback - rename X-AS-Collection-Synchronization to Collection-Synchronization - various minor refactoring and code style changes * Only select required fields when computing followers_hash * Use actor URI rather than webfinger domain in synchronization endpoint * Change hash computation to be a XOR of individual hashes Makes it much easier to be memory-efficient, and avoid sorting discrepancy issues. * Marginally improve followers_hash computation speed * Further improve hash computation performances by using pluck_each
3 years ago
  1. # frozen_string_literal: true
  2. require 'singleton'
  3. class ActivityPub::TagManager
  4. include Singleton
  5. include RoutingHelper
  6. CONTEXT = 'https://www.w3.org/ns/activitystreams'
  7. COLLECTIONS = {
  8. public: 'https://www.w3.org/ns/activitystreams#Public',
  9. }.freeze
  10. def public_collection?(uri)
  11. uri == COLLECTIONS[:public] || uri == 'as:Public' || uri == 'Public'
  12. end
  13. def url_for(target)
  14. return target.url if target.respond_to?(:local?) && !target.local?
  15. return unless target.respond_to?(:object_type)
  16. case target.object_type
  17. when :person
  18. target.instance_actor? ? about_more_url(instance_actor: true) : short_account_url(target)
  19. when :note, :comment, :activity
  20. return activity_account_status_url(target.account, target) if target.reblog?
  21. short_account_status_url(target.account, target)
  22. end
  23. end
  24. def uri_for(target)
  25. return target.uri if target.respond_to?(:local?) && !target.local?
  26. case target.object_type
  27. when :person
  28. target.instance_actor? ? instance_actor_url : account_url(target)
  29. when :note, :comment, :activity
  30. return activity_account_status_url(target.account, target) if target.reblog?
  31. account_status_url(target.account, target)
  32. when :emoji
  33. emoji_url(target)
  34. end
  35. end
  36. def uri_for_username(username)
  37. account_url(username: username)
  38. end
  39. def generate_uri_for(_target)
  40. URI.join(root_url, 'payloads', SecureRandom.uuid)
  41. end
  42. def activity_uri_for(target)
  43. raise ArgumentError, 'target must be a local activity' unless %i(note comment activity).include?(target.object_type) && target.local?
  44. activity_account_status_url(target.account, target)
  45. end
  46. def replies_uri_for(target, page_params = nil)
  47. raise ArgumentError, 'target must be a local activity' unless %i(note comment activity).include?(target.object_type) && target.local?
  48. account_status_replies_url(target.account, target, page_params)
  49. end
  50. # Primary audience of a status
  51. # Public statuses go out to primarily the public collection
  52. # Unlisted and private statuses go out primarily to the followers collection
  53. # Others go out only to the people they mention
  54. def to(status)
  55. case status.visibility
  56. when 'public'
  57. [COLLECTIONS[:public]]
  58. when 'unlisted', 'private'
  59. [account_followers_url(status.account)]
  60. when 'direct', 'limited'
  61. if status.account.silenced?
  62. # Only notify followers if the account is locally silenced
  63. account_ids = status.active_mentions.pluck(:account_id)
  64. to = status.account.followers.where(id: account_ids).each_with_object([]) do |account, result|
  65. result << uri_for(account)
  66. result << account_followers_url(account) if account.group?
  67. end
  68. to.concat(FollowRequest.where(target_account_id: status.account_id, account_id: account_ids).each_with_object([]) do |request, result|
  69. result << uri_for(request.account)
  70. result << account_followers_url(request.account) if request.account.group?
  71. end)
  72. else
  73. status.active_mentions.each_with_object([]) do |mention, result|
  74. result << uri_for(mention.account)
  75. result << account_followers_url(mention.account) if mention.account.group?
  76. end
  77. end
  78. end
  79. end
  80. # Secondary audience of a status
  81. # Public statuses go out to followers as well
  82. # Unlisted statuses go to the public as well
  83. # Both of those and private statuses also go to the people mentioned in them
  84. # Direct ones don't have a secondary audience
  85. def cc(status)
  86. cc = []
  87. cc << uri_for(status.reblog.account) if status.reblog?
  88. case status.visibility
  89. when 'public'
  90. cc << account_followers_url(status.account)
  91. when 'unlisted'
  92. cc << COLLECTIONS[:public]
  93. end
  94. unless status.direct_visibility? || status.limited_visibility?
  95. if status.account.silenced?
  96. # Only notify followers if the account is locally silenced
  97. account_ids = status.active_mentions.pluck(:account_id)
  98. cc.concat(status.account.followers.where(id: account_ids).each_with_object([]) do |account, result|
  99. result << uri_for(account)
  100. result << account_followers_url(account) if account.group?
  101. end)
  102. cc.concat(FollowRequest.where(target_account_id: status.account_id, account_id: account_ids).each_with_object([]) do |request, result|
  103. result << uri_for(request.account)
  104. result << account_followers_url(request.account) if request.account.group?
  105. end)
  106. else
  107. cc.concat(status.active_mentions.each_with_object([]) do |mention, result|
  108. result << uri_for(mention.account)
  109. result << account_followers_url(mention.account) if mention.account.group?
  110. end)
  111. end
  112. end
  113. cc
  114. end
  115. def local_uri?(uri)
  116. return false if uri.nil?
  117. uri = Addressable::URI.parse(uri)
  118. host = uri.normalized_host
  119. host = "#{host}:#{uri.port}" if uri.port
  120. !host.nil? && (::TagManager.instance.local_domain?(host) || ::TagManager.instance.web_domain?(host))
  121. end
  122. def uri_to_local_id(uri, param = :id)
  123. path_params = Rails.application.routes.recognize_path(uri)
  124. path_params[:username] = Rails.configuration.x.local_domain if path_params[:controller] == 'instance_actors'
  125. path_params[param]
  126. end
  127. def uri_to_resource(uri, klass)
  128. return if uri.nil?
  129. if local_uri?(uri)
  130. case klass.name
  131. when 'Account'
  132. klass.find_local(uri_to_local_id(uri, :username))
  133. else
  134. StatusFinder.new(uri).status
  135. end
  136. elsif OStatus::TagManager.instance.local_id?(uri)
  137. klass.find_by(id: OStatus::TagManager.instance.unique_tag_to_local_id(uri, klass.to_s))
  138. else
  139. klass.find_by(uri: uri.split('#').first)
  140. end
  141. rescue ActiveRecord::RecordNotFound
  142. nil
  143. end
  144. end