mirror of
1
Fork 0
gotosocial/vendor/codeberg.org/gruf
kim c9c0773f2c
[performance] update remaining worker pools to use queues (#2865)
* start replacing client + federator + media workers with new worker + queue types

* refactor federatingDB.Delete(), drop queued messages when deleting account / status

* move all queue purging to the processor workers

* undo toolchain updates

* code comments, ensure dereferencer worker pool gets started

* update gruf libraries in readme

* start the job scheduler separately to the worker pools

* reshuffle ordering or server.go + remove duplicate worker start / stop

* update go-list version

* fix vendoring

* move queue invalidation to before wipeing / deletion, to ensure queued work not dropped

* add logging to worker processing functions in testrig, don't start workers in unexpected places

* update go-structr to add (+then rely on) QueueCtx{} type

* ensure more worker pools get started properly in tests

* fix remaining broken tests relying on worker queue logic

* fix account test suite queue popping logic, ensure noop workers do not pull from queue

* move back accidentally shuffled account deletion order

* ensure error (non nil!!) gets passed in refactored federatingDB{}.Delete()

* silently drop deletes from accounts not permitted to

* don't warn log on forwarded deletes

* make if else clauses easier to parse

* use getFederatorMsg()

* improved code comment

* improved code comment re: requesting account delete checks

* remove boolean result from worker start / stop since false = already running or already stopped

* remove optional passed-in http.client

* remove worker starting from the admin CLI commands (we don't need to handle side-effects)

* update prune cli to start scheduler but not all of the workers

* fix rebase issues

* remove redundant return statements

* i'm sorry sir linter
2024-04-26 13:50:46 +01:00
..
go-atomics [chore] consolidate caching libraries (#704) 2022-07-10 17:18:21 +02:00
go-bitutil [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
go-bytes update dependencies (#296) 2021-11-13 12:29:08 +01:00
go-bytesize [chore]: Bump codeberg.org/gruf/go-bytesize from 1.0.0 to 1.0.2 (#1285) 2022-12-27 08:28:44 +00:00
go-byteutil [chore]: Bump codeberg.org/gruf/go-byteutil from 1.1.2 to 1.2.0 (#2389) 2023-11-27 13:16:26 +00:00
go-cache/v3 [performance] overhaul struct (+ result) caching library for simplicity, performance and multiple-result lookups (#2535) 2024-01-19 12:57:29 +00:00
go-debug [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
go-errors/v2 [bugfix] return 400 Bad Request on more cases of malformed AS data (#2399) 2023-11-30 16:22:34 +00:00
go-fastcopy [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
go-fastpath/v2 [feature] add per-uri dereferencer locks (#2291) 2023-10-31 11:12:22 +00:00
go-iotools [feature] add per-uri dereferencer locks (#2291) 2023-10-31 11:12:22 +00:00
go-kv [chore]: Bump codeberg.org/gruf/go-kv from 1.6.3 to 1.6.4 (#2142) 2023-08-21 06:54:30 +00:00
go-list [performance] update remaining worker pools to use queues (#2865) 2024-04-26 13:50:46 +01:00
go-logger/v2 [chore] update dependencies, bump to Go 1.19.1 (#826) 2022-09-28 18:30:40 +01:00
go-mangler [chore] bump go structr cache version -> v0.6.0 (#2773) 2024-04-02 12:03:40 +02:00
go-maps [feature] Read + Write tombstones for deleted Actors (#1005) 2022-11-11 12:18:38 +01:00
go-mutexes [chore]: Bump codeberg.org/gruf/go-mutexes from 1.4.0 to 1.4.1 (#2860) 2024-04-22 13:43:45 +01:00
go-runners [bugfix] return 400 Bad Request on more cases of malformed AS data (#2399) 2023-11-30 16:22:34 +00:00
go-sched [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
go-store/v2 [feature] add per-uri dereferencer locks (#2291) 2023-10-31 11:12:22 +00:00
go-structr [performance] update remaining worker pools to use queues (#2865) 2024-04-26 13:50:46 +01:00