mirror of
1
Fork 0
gotosocial/internal/federation/federatingdb
kim a483bd9e38
[performance] massively improved ActivityPub delivery worker efficiency (#2812)
* add delivery worker type that pulls from queue to httpclient package

* finish up some code commenting, bodge a vendored activity library change, integrate the deliverypool changes into transportcontroller

* hook up queue deletion logic

* support deleting queued http requests by target ID

* don't index APRequest by hostname in the queue

* use gorun

* use the original context's values when wrapping msg type as delivery{}

* actually log in the AP delivery worker ...

* add uncommitted changes

* use errors.AsV2()

* use errorsv2.AsV2()

* finish adding some code comments, add bad host handling to delivery workers

* slightly tweak deliveryworkerpool API, use advanced sender multiplier

* remove PopCtx() method, let others instead rely on Wait()

* shuffle things around to move delivery stuff into transport/ subpkg

* remove dead code

* formatting

* validate request before queueing for delivery

* finish adding code comments, fix up backoff code

* finish adding more code comments

* clamp minimum no. senders to 1

* add start/stop logging to delivery worker, some slight changes

* remove double logging

* use worker ptrs

* expose the embedded log fields in httpclient.Request{}

* ensure request context values are preserved when updating ctx

* add delivery worker tests

* fix linter issues

* ensure delivery worker gets inited in testrig

* fix tests to delivering messages to check worker delivery queue

* update error type to use ptr instead of value receiver

* fix test calling Workers{}.Start() instead of testrig.StartWorkers()

* update docs for advanced-sender-multiplier

* update to the latest activity library version

* add comment about not using httptest.Server{}
2024-04-11 11:45:35 +02:00
..
accept.go [feature] Process incoming `Move` activity (#2724) 2024-03-12 14:34:08 +00:00
announce.go [feature] Process incoming `Move` activity (#2724) 2024-03-12 14:34:08 +00:00
announce_test.go [performance] overhaul struct (+ result) caching library for simplicity, performance and multiple-result lookups (#2535) 2024-01-19 12:57:29 +00:00
create.go [feature] Process incoming `Move` activity (#2724) 2024-03-12 14:34:08 +00:00
create_test.go [bugfix] parent status replied to status not dereferenced sometimes (#2587) 2024-01-31 13:29:47 +00:00
db.go [feature] Process incoming `Move` activity (#2724) 2024-03-12 14:34:08 +00:00
delete.go [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00
exists.go [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
federatingdb_test.go [feature] Add experimental `instance-federation-spam-filter` option (#2685) 2024-02-27 12:22:05 +00:00
followers.go [feature] add paging to AP following / followers endpoints (#2198) 2023-09-20 16:49:46 +01:00
followers_test.go [feature] Enable federation in/out of profile PropertyValue fields (#1722) 2023-05-09 11:16:10 +01:00
following.go [feature] add paging to AP following / followers endpoints (#2198) 2023-09-20 16:49:46 +01:00
following_test.go [bugfix] Sort follows chronologically (#2801) 2024-04-03 14:06:39 +01:00
get.go [chore] deinterface the typeutils.Converter and update to use state structure (#2217) 2023-09-23 18:44:11 +02:00
inbox.go [feature] add paging to account follows, followers and follow requests endpoints (#2186) 2023-09-12 14:00:35 +01:00
inbox_test.go [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
liked.go [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
lock.go [feature] add per-uri dereferencer locks (#2291) 2023-10-31 11:12:22 +00:00
move.go [feature] Process incoming `Move` activity (#2724) 2024-03-12 14:34:08 +00:00
move_test.go [feature] Process incoming `Move` activity (#2724) 2024-03-12 14:34:08 +00:00
outbox.go [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
owns.go [bugfix] Add proper constraints on status faves, dedupe (#1674) 2023-04-05 20:10:05 +02:00
reject.go [chore] refactor extractFromCtx a bit (#2646) 2024-02-17 15:20:39 +01:00
reject_test.go [feature] List replies policy, refactor async workers (#2087) 2023-08-09 19:14:33 +02:00
undo.go [chore] refactor extractFromCtx a bit (#2646) 2024-02-17 15:20:39 +01:00
update.go [chore] refactor extractFromCtx a bit (#2646) 2024-02-17 15:20:39 +01:00
util.go [chore] refactor extractFromCtx a bit (#2646) 2024-02-17 15:20:39 +01:00