mirror of
1
Fork 0
gotosocial/vendor/github.com
kim acc95923da
[performance] processing media and scheduled jobs improvements (#1482)
* replace media workers with just runners.WorkerPool, move to state structure, use go-sched for global task scheduling

* improved code comment

* fix worker tryUntil function, update go-runners/go-sched

* make preprocess functions package public, use these where possible to stop doubled up processing

* remove separate emoji worker pool

* limit calls to time.Now() during media preprocessing

* use Processor{} to manage singular runtime of processing media

* ensure workers get started when media manager is used

* improved error setting in processing media, fix media test

* port changes from processingmedia to processing emoji

* finish code commenting

* finish code commenting and comment-out client API + federator worker pools until concurrency worker pools replaced

* linterrrrrrrrrrrrrrrr

---------

Signed-off-by: kim <grufwub@gmail.com>
2023-02-13 18:40:48 +00:00
..
KimMachineGun/automemlimit [feature] Inherit resource limits from cgroups (#1336) 2023-01-17 20:59:04 +00:00
abema/go-mp4 [chore]: Bump github.com/abema/go-mp4 from 0.9.0 to 0.10.0 (#1374) 2023-01-23 10:23:29 +01:00
aymerick/douceur Grand test fixup (#138) 2021-08-12 21:03:24 +02:00
buckket/go-blurhash migrate go version to 1.17 (#203) 2021-09-10 14:42:14 +02:00
cilium/ebpf [feature] Inherit resource limits from cgroups (#1336) 2023-01-17 20:59:04 +00:00
containerd/cgroups [feature] Inherit resource limits from cgroups (#1336) 2023-01-17 20:59:04 +00:00
coreos [feature] Inherit resource limits from cgroups (#1336) 2023-01-17 20:59:04 +00:00
cornelk/hashmap [chore] bump gruf/go-store to v2 (#953) 2022-11-05 11:10:19 +00:00
davecgh/go-spew Grand test fixup (#138) 2021-08-12 21:03:24 +02:00
disintegration/imaging [bugfix] Fix thumbnails not taking exif rotation into account (#746) 2022-08-10 14:05:14 +02:00
docker/go-units [feature] Inherit resource limits from cgroups (#1336) 2023-01-17 20:59:04 +00:00
dsoprea [bugfix] Fix images not being processed correctly sometimes (#437) 2022-03-21 19:46:51 +01:00
dustin/go-humanize [feature] S3 support (#674) 2022-07-03 12:08:30 +02:00
fsnotify/fsnotify [chore]: Bump github.com/spf13/viper from 1.13.0 to 1.14.0 (#1003) 2022-11-08 11:30:29 +01:00
gin-contrib [chore] update dependencies, bump to Go 1.19.1 (#826) 2022-09-28 18:30:40 +01:00
gin-gonic/gin [chore]: Bump github.com/gin-gonic/gin from 1.8.1 to 1.8.2 (#1286) 2022-12-27 08:29:42 +00:00
go-errors/errors Update dependencies (#333) 2021-11-27 15:26:58 +01:00
go-fed/httpsig move to ssb gofed fork (#298) 2021-11-13 17:29:43 +01:00
go-jose/go-jose/v3 [chore]: Bump github.com/coreos/go-oidc/v3 from 3.4.0 to 3.5.0 (#1322) 2023-01-09 08:23:49 +00:00
go-playground [chore]: Bump github.com/go-playground/validator/v10 (#1400) 2023-01-30 10:45:34 +01:00
go-xmlfmt/xmlfmt Upstep Go dependencies (#340) 2021-12-12 15:47:51 +01:00
goccy/go-json [chore] update dependencies, bump to Go 1.19.1 (#826) 2022-09-28 18:30:40 +01:00
godbus/dbus/v5 [feature] Inherit resource limits from cgroups (#1336) 2023-01-17 20:59:04 +00:00
gogo/protobuf [feature] Inherit resource limits from cgroups (#1336) 2023-01-17 20:59:04 +00:00
golang [chore] bump gruf/go-store to v2 (#953) 2022-11-05 11:10:19 +00:00
golang-jwt/jwt migrate go version to 1.17 (#203) 2021-09-10 14:42:14 +02:00
google/uuid migrate go version to 1.17 (#203) 2021-09-10 14:42:14 +02:00
gorilla [feature] Add opt-in RSS feed for account's latest Public posts (#897) 2022-10-08 14:00:39 +02:00
h2non/filetype Update dependencies (#333) 2021-11-27 15:26:58 +01:00
hashicorp/hcl Implement Cobra CLI tooling, Viper config tooling (#336) 2021-12-07 13:31:39 +01:00
inconshreveable/mousetrap [chore] update dependencies, bump to Go 1.19.1 (#826) 2022-09-28 18:30:40 +01:00
jackc [chore] update dependencies, bump to Go 1.19.1 (#826) 2022-09-28 18:30:40 +01:00
jinzhu/inflection migrate go version to 1.17 (#203) 2021-09-10 14:42:14 +02:00
json-iterator/go Update dependencies (#333) 2021-11-27 15:26:58 +01:00
kballard/go-shellquote Add SQLite support, fix un-thread-safe DB caches, small performance f… (#172) 2021-08-29 16:41:41 +02:00
klauspost [chore] bump gruf/go-store to v2 (#953) 2022-11-05 11:10:19 +00:00
leodido/go-urn migrate go version to 1.17 (#203) 2021-09-10 14:42:14 +02:00
magiconair/properties [chore]: Bump github.com/spf13/viper from 1.14.0 to 1.15.0 (#1375) 2023-01-23 10:24:00 +01:00
mattn/go-isatty [chore] bump db dependencies (#1366) 2023-01-22 12:26:47 +01:00
microcosm-cc/bluemonday [chore]: Bump github.com/microcosm-cc/bluemonday from 1.0.21 to 1.0.22 (#1399) 2023-01-30 10:45:19 +01:00
miekg/dns [chore] update dependencies, bump to Go 1.19.1 (#826) 2022-09-28 18:30:40 +01:00
minio [chore]: Bump github.com/minio/minio-go/v7 from 7.0.47 to 7.0.48 (#1486) 2023-02-13 07:46:15 +00:00
mitchellh/mapstructure [chore] update dependencies, bump to Go 1.19.1 (#826) 2022-09-28 18:30:40 +01:00
modern-go Update dependencies (#333) 2021-11-27 15:26:58 +01:00
oklog/ulid Grand test fixup (#138) 2021-08-12 21:03:24 +02:00
opencontainers/runtime-spec [feature] Inherit resource limits from cgroups (#1336) 2023-01-17 20:59:04 +00:00
pelletier/go-toml/v2 [chore]: Bump github.com/spf13/viper from 1.14.0 to 1.15.0 (#1375) 2023-01-23 10:24:00 +01:00
pkg/errors [feature] add rate limit middleware (#741) 2022-08-31 12:06:14 +02:00
pmezard/go-difflib Grand test fixup (#138) 2021-08-12 21:03:24 +02:00
quasoft/memstore Grand test fixup (#138) 2021-08-12 21:03:24 +02:00
remyoudompheng/bigfft migrate go version to 1.17 (#203) 2021-09-10 14:42:14 +02:00
rs/xid [chore] update dependencies, bump to Go 1.19.1 (#826) 2022-09-28 18:30:40 +01:00
sirupsen/logrus [chore] update dependencies, bump to Go 1.19.1 (#826) 2022-09-28 18:30:40 +01:00
spf13 [chore]: Bump github.com/spf13/viper from 1.14.0 to 1.15.0 (#1375) 2023-01-23 10:24:00 +01:00
stretchr/testify [chore] Test fixes (#788) 2022-08-31 17:31:21 +02:00
subosito/gotenv [chore]: Bump github.com/spf13/viper from 1.14.0 to 1.15.0 (#1375) 2023-01-23 10:24:00 +01:00
superseriousbusiness [feature] media: add webp support (#1155) 2022-12-06 14:15:25 +01:00
tdewolff [chore] Bump github.com/tdewolff/minify/v2 from 2.12.1 to 2.12.4 (#985) 2022-11-07 11:24:09 +01:00
tmthrgd/go-hex Grand test fixup (#138) 2021-08-12 21:03:24 +02:00
ugorji/go/codec [chore] Update all but bun libraries (#526) 2022-05-02 15:05:18 +02:00
ulule/limiter/v3 [chore]: Bump github.com/ulule/limiter/v3 from 3.10.0 to 3.11.0 (#1429) 2023-02-06 09:06:04 +01:00
uptrace/bun [chore] bump db dependencies (#1366) 2023-01-22 12:26:47 +01:00
vmihailenco Update dependencies (#333) 2021-11-27 15:26:58 +01:00
wagslane/go-password-validator migrate go version to 1.17 (#203) 2021-09-10 14:42:14 +02:00
yuin/goldmark [chore]: Bump github.com/yuin/goldmark from 1.5.3 to 1.5.4 (#1427) 2023-02-06 09:06:57 +01:00