3d3e99ae52
[performance] update storage backend and make use of seek syscall when available ( #2924 )
...
* update to use go-storage/ instead of go-store/v2/storage/
* pull in latest version from codeberg
* remove test output 😇
* add code comments
* set the exclusive bit when creating new files in disk config
* bump to actual release version
* bump to v0.1.1 (tis a simple no-logic change)
* update readme
* only use a temporary read seeker when decoding video if required (should only be S3 now)
* use fastcopy library to use memory pooled buffers when calling TempFileSeeker()
* update to use seek call in serveFileRange()
2024-05-22 11:46:24 +02:00
06b1e0173b
--- ( #2923 )
...
updated-dependencies:
- dependency-name: github.com/tdewolff/minify/v2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-21 14:37:47 +01:00
6c0d93c6cb
[chore] dependabot updates ( #2922 )
...
* [chore]: Bump github.com/prometheus/client_golang from 1.18.0 to 1.19.1
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang ) from 1.18.0 to 1.19.1.
- [Release notes](https://github.com/prometheus/client_golang/releases )
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md )
- [Commits](https://github.com/prometheus/client_golang/compare/v1.18.0...v1.19.1 )
---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [chore]: Bump github.com/KimMachineGun/automemlimit from 0.6.0 to 0.6.1
Bumps [github.com/KimMachineGun/automemlimit](https://github.com/KimMachineGun/automemlimit ) from 0.6.0 to 0.6.1.
- [Release notes](https://github.com/KimMachineGun/automemlimit/releases )
- [Commits](https://github.com/KimMachineGun/automemlimit/compare/v0.6.0...v0.6.1 )
---
updated-dependencies:
- dependency-name: github.com/KimMachineGun/automemlimit
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [chore]: Bump github.com/tdewolff/minify/v2 from 2.20.20 to 2.20.24
Bumps [github.com/tdewolff/minify/v2](https://github.com/tdewolff/minify ) from 2.20.20 to 2.20.24.
- [Release notes](https://github.com/tdewolff/minify/releases )
- [Commits](https://github.com/tdewolff/minify/compare/v2.20.20...v2.20.24 )
---
updated-dependencies:
- dependency-name: github.com/tdewolff/minify/v2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [chore]: Bump github.com/go-swagger/go-swagger
Bumps [github.com/go-swagger/go-swagger](https://github.com/go-swagger/go-swagger ) from 0.30.6-0.20240418033037-c46c303aaa02 to 0.31.0.
- [Release notes](https://github.com/go-swagger/go-swagger/releases )
- [Changelog](https://github.com/go-swagger/go-swagger/blob/master/.goreleaser.yml )
- [Commits](https://github.com/go-swagger/go-swagger/commits/v0.31.0 )
---
updated-dependencies:
- dependency-name: github.com/go-swagger/go-swagger
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [chore]: Bump github.com/gin-gonic/gin from 1.9.1 to 1.10.0
Bumps [github.com/gin-gonic/gin](https://github.com/gin-gonic/gin ) from 1.9.1 to 1.10.0.
- [Release notes](https://github.com/gin-gonic/gin/releases )
- [Changelog](https://github.com/gin-gonic/gin/blob/master/CHANGELOG.md )
- [Commits](https://github.com/gin-gonic/gin/compare/v1.9.1...v1.10.0 )
---
updated-dependencies:
- dependency-name: github.com/gin-gonic/gin
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-21 14:17:22 +01:00
16c1832793
[chore]: Bump github.com/gin-contrib/cors from 1.7.1 to 1.7.2 ( #2912 )
...
Bumps [github.com/gin-contrib/cors](https://github.com/gin-contrib/cors ) from 1.7.1 to 1.7.2.
- [Release notes](https://github.com/gin-contrib/cors/releases )
- [Changelog](https://github.com/gin-contrib/cors/blob/master/.goreleaser.yaml )
- [Commits](https://github.com/gin-contrib/cors/compare/v1.7.1...v1.7.2 )
---
updated-dependencies:
- dependency-name: github.com/gin-contrib/cors
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kim <89579420+NyaaaWhatsUpDoc@users.noreply.github.com>
2024-05-13 08:29:54 +00:00
f817f96596
[chore]: Bump github.com/gin-contrib/sessions from 1.0.0 to 1.0.1 ( #2916 )
...
Bumps [github.com/gin-contrib/sessions](https://github.com/gin-contrib/sessions ) from 1.0.0 to 1.0.1.
- [Release notes](https://github.com/gin-contrib/sessions/releases )
- [Changelog](https://github.com/gin-contrib/sessions/blob/master/.goreleaser.yaml )
- [Commits](https://github.com/gin-contrib/sessions/compare/v1.0.0...v1.0.1 )
---
updated-dependencies:
- dependency-name: github.com/gin-contrib/sessions
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-13 08:07:17 +00:00
96eea416f3
[chore]: Bump golang.org/x/net from 0.24.0 to 0.25.0 ( #2914 )
...
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.24.0 to 0.25.0.
- [Commits](https://github.com/golang/net/compare/v0.24.0...v0.25.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-13 08:06:30 +00:00
c06e6fb656
[performance] update go-structr and go-mutexes with memory usage improvements ( #2909 )
...
* update go-structr and go-mutexes with memory usage improvements
* bump to go-structr v0.8.4
2024-05-13 08:05:46 +00:00
f24ce34c3a
bump modernc.org/sqlite v1.29.8 -> v1.29.9 (concurrency workaround) ( #2906 )
2024-05-07 14:52:37 +01:00
3554991444
update go-structr -> v0.8.2 which includes some minor memory usage improvements ( #2904 )
2024-05-06 19:44:22 +00:00
a0d066844f
[chore]: Bump golang.org/x/oauth2 from 0.19.0 to 0.20.0 ( #2900 )
2024-05-06 11:14:04 +00:00
8237e8d09e
[chore]: Bump codeberg.org/gruf/go-structr from 0.7.0 to 0.8.0 ( #2902 )
...
Bumps codeberg.org/gruf/go-structr from 0.7.0 to 0.8.0.
---
updated-dependencies:
- dependency-name: codeberg.org/gruf/go-structr
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 08:51:06 +00:00
a5f28fe0c9
[chore]: Bump github.com/gin-contrib/gzip from 1.0.0 to 1.0.1 ( #2899 )
...
Bumps [github.com/gin-contrib/gzip](https://github.com/gin-contrib/gzip ) from 1.0.0 to 1.0.1.
- [Release notes](https://github.com/gin-contrib/gzip/releases )
- [Changelog](https://github.com/gin-contrib/gzip/blob/master/.goreleaser.yaml )
- [Commits](https://github.com/gin-contrib/gzip/compare/v1.0.0...v1.0.1 )
---
updated-dependencies:
- dependency-name: github.com/gin-contrib/gzip
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 08:50:47 +00:00
c98ec6f89d
[chore]: Bump golang.org/x/image from 0.15.0 to 0.16.0 ( #2898 )
...
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.15.0 to 0.16.0.
- [Commits](https://github.com/golang/image/compare/v0.15.0...v0.16.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 08:50:03 +00:00
bfc21e4850
[chore]: Bump github.com/tdewolff/minify/v2 from 2.20.19 to 2.20.20 ( #2875 )
2024-04-29 10:45:17 +00:00
d3bac8bbec
[chore]: Bump github.com/minio/minio-go/v7 from 7.0.69 to 7.0.70 ( #2877 )
2024-04-29 10:44:11 +00:00
1375a86919
[chore]: Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc ( #2878 )
2024-04-29 09:18:16 +00:00
b2eecd9dc7
[chore]: Bump go.opentelemetry.io/otel/sdk from 1.25.0 to 1.26.0 ( #2879 )
2024-04-29 09:02:12 +00:00
c9c0773f2c
[performance] update remaining worker pools to use queues ( #2865 )
...
* start replacing client + federator + media workers with new worker + queue types
* refactor federatingDB.Delete(), drop queued messages when deleting account / status
* move all queue purging to the processor workers
* undo toolchain updates
* code comments, ensure dereferencer worker pool gets started
* update gruf libraries in readme
* start the job scheduler separately to the worker pools
* reshuffle ordering or server.go + remove duplicate worker start / stop
* update go-list version
* fix vendoring
* move queue invalidation to before wipeing / deletion, to ensure queued work not dropped
* add logging to worker processing functions in testrig, don't start workers in unexpected places
* update go-structr to add (+then rely on) QueueCtx{} type
* ensure more worker pools get started properly in tests
* fix remaining broken tests relying on worker queue logic
* fix account test suite queue popping logic, ensure noop workers do not pull from queue
* move back accidentally shuffled account deletion order
* ensure error (non nil!!) gets passed in refactored federatingDB{}.Delete()
* silently drop deletes from accounts not permitted to
* don't warn log on forwarded deletes
* make if else clauses easier to parse
* use getFederatorMsg()
* improved code comment
* improved code comment re: requesting account delete checks
* remove boolean result from worker start / stop since false = already running or already stopped
* remove optional passed-in http.client
* remove worker starting from the admin CLI commands (we don't need to handle side-effects)
* update prune cli to start scheduler but not all of the workers
* fix rebase issues
* remove redundant return statements
* i'm sorry sir linter
2024-04-26 13:50:46 +01:00
fd8a724e77
[chore] Bump go swagger ( #2871 )
...
* bump go swagger version
* bump swagger version
2024-04-26 11:31:10 +02:00
3a369d834a
[chore] Upgrade our Go version to 1.22 ( #2862 )
...
* [chore] Upgrade our Go version to 1.22
With Go 1.22 having been released at the start of February, it's now
been a few months. No major issues have shown up, and the two point
release since then have primarily been security fixes plus some general
bug fixing.
This sets the required Go version to 1.22, as there's nothing in 1.22.1
or 1.22.2 that we would explicitly require. It sets the toolchain to the
latest point release, to ensure we pick up any fixes from there when
building releases etc.
* [chore] Update CI to Go 1.22
* [chore] Update golangci-lint to 1.25.7
Newer version should know about Go 1.22 and run fine.
* [chore] Update Docker container to Go 1.22
* [chore] Update Dockerfile to newer Alpine version
* sign drone.yml
* add missing license header
---------
Co-authored-by: tobi <tobi.smethurst@protonmail.com>
2024-04-26 10:40:29 +02:00
62788aa116
[chore]: Bump codeberg.org/gruf/go-mutexes from 1.4.0 to 1.4.1 ( #2860 )
...
Bumps codeberg.org/gruf/go-mutexes from 1.4.0 to 1.4.1.
---
updated-dependencies:
- dependency-name: codeberg.org/gruf/go-mutexes
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-22 13:43:45 +01:00
a57dd15a8e
[chore]: Bump github.com/miekg/dns from 1.1.58 to 1.1.59 ( #2861 )
2024-04-22 09:11:53 +00:00
12a7eba01f
[chore] bump modernc.org/sqlite to v1.29.8 (with our concurrency workaround) ( #2855 )
2024-04-22 11:02:11 +02:00
0db9e34b69
[chore]: Bump github.com/KimMachineGun/automemlimit from 0.5.0 to 0.6.0 ( #2859 )
2024-04-22 08:59:30 +00:00
b3f2d44143
bump to modernc.org/sqlite v1.29.7 ( #2850 )
2024-04-17 17:10:51 +01:00
1018cde107
[chore] bump bun library versions ( #2837 )
2024-04-15 12:01:20 +02:00
6bb43f3f9b
[chore]: Bump golang.org/x/net from 0.23.0 to 0.24.0 ( #2834 )
2024-04-15 08:44:29 +00:00
66e4510bf1
[chore]: Bump golang.org/x/crypto from 0.21.0 to 0.22.0 ( #2835 )
2024-04-15 08:34:49 +00:00
c097745c38
[chore]: Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc ( #2818 )
...
Bumps [go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc](https://github.com/open-telemetry/opentelemetry-go ) from 1.24.0 to 1.25.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases )
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md )
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.24.0...v1.25.0 )
---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-11 11:46:18 +02:00
db2dcc3455
[chore] update go-structr => v0.6.2 (fixes nested field ptr following) ( #2822 )
...
* update go-structr => v0.6.1 (fixes nested field ptr following)
* bump to v0.6.2
2024-04-11 11:46:08 +02:00
a483bd9e38
[performance] massively improved ActivityPub delivery worker efficiency ( #2812 )
...
* add delivery worker type that pulls from queue to httpclient package
* finish up some code commenting, bodge a vendored activity library change, integrate the deliverypool changes into transportcontroller
* hook up queue deletion logic
* support deleting queued http requests by target ID
* don't index APRequest by hostname in the queue
* use gorun
* use the original context's values when wrapping msg type as delivery{}
* actually log in the AP delivery worker ...
* add uncommitted changes
* use errors.AsV2()
* use errorsv2.AsV2()
* finish adding some code comments, add bad host handling to delivery workers
* slightly tweak deliveryworkerpool API, use advanced sender multiplier
* remove PopCtx() method, let others instead rely on Wait()
* shuffle things around to move delivery stuff into transport/ subpkg
* remove dead code
* formatting
* validate request before queueing for delivery
* finish adding code comments, fix up backoff code
* finish adding more code comments
* clamp minimum no. senders to 1
* add start/stop logging to delivery worker, some slight changes
* remove double logging
* use worker ptrs
* expose the embedded log fields in httpclient.Request{}
* ensure request context values are preserved when updating ctx
* add delivery worker tests
* fix linter issues
* ensure delivery worker gets inited in testrig
* fix tests to delivering messages to check worker delivery queue
* update error type to use ptr instead of value receiver
* fix test calling Workers{}.Start() instead of testrig.StartWorkers()
* update docs for advanced-sender-multiplier
* update to the latest activity library version
* add comment about not using httptest.Server{}
2024-04-11 11:45:35 +02:00
15733cddb2
[chore]: Bump github.com/yuin/goldmark from 1.7.0 to 1.7.1 ( #2819 )
...
Bumps [github.com/yuin/goldmark](https://github.com/yuin/goldmark ) from 1.7.0 to 1.7.1.
- [Release notes](https://github.com/yuin/goldmark/releases )
- [Commits](https://github.com/yuin/goldmark/compare/v1.7.0...v1.7.1 )
---
updated-dependencies:
- dependency-name: github.com/yuin/goldmark
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-10 12:04:27 +01:00
4d16c3adaf
[chore]: Bump golang.org/x/oauth2 from 0.18.0 to 0.19.0 ( #2816 )
...
Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2 ) from 0.18.0 to 0.19.0.
- [Commits](https://github.com/golang/oauth2/compare/v0.18.0...v0.19.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/oauth2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-10 12:04:11 +01:00
85bc140b58
[bugfix] temporarily replace `modernc.org/sqlite-v1.29.5` with `gitlab.com/NyaaaWhatsUpDoc/sqlite-v1.29.5-concurrency-workaround` ( #2811 )
2024-04-05 11:58:28 +02:00
adf345f1ec
[chore] bump go structr cache version -> v0.6.0 ( #2773 )
...
* update go-structr library -> v0.6.0, add necessary wrapping types + code changes to support these changes
* update readme with go-structr package changes
* improved wrapping of the SliceCache type
* add code comments for the cache wrapper types
* remove test.out 😇
---------
Co-authored-by: tobi <31960611+tsmethurst@users.noreply.github.com>
2024-04-02 12:03:40 +02:00
29031d1e27
[chore]: Bump github.com/gin-contrib/sessions from 0.0.5 to 1.0.0 ( #2782 )
2024-03-25 11:00:36 +00:00
a24936040c
[chore]: Bump github.com/coreos/go-oidc/v3 from 3.9.0 to 3.10.0 ( #2779 )
2024-03-25 10:58:34 +00:00
5f43419a87
[chore]: Bump github.com/gin-contrib/cors from 1.7.0 to 1.7.1 ( #2778 )
2024-03-25 10:43:08 +00:00
40ee470536
[chore]: Bump github.com/gin-contrib/gzip from 0.0.6 to 1.0.0 ( #2781 )
2024-03-25 10:31:19 +00:00
967558947a
[chore]: Bump modernc.org/sqlite from 1.29.4 to 1.29.5 ( #2768 )
...
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite ) from 1.29.4 to 1.29.5.
- [Commits](https://gitlab.com/cznic/sqlite/commits/v1.29.5 )
---
updated-dependencies:
- dependency-name: modernc.org/sqlite
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-21 11:14:24 +00:00
51e8879779
[chore]: Bump github.com/tdewolff/minify/v2 from 2.20.18 to 2.20.19 ( #2767 )
2024-03-18 10:05:26 +00:00
8570793dfb
[chore]: Bump golang.org/x/oauth2 from 0.17.0 to 0.18.0 ( #2766 )
2024-03-18 09:56:42 +00:00
fae7627a1b
[chore]: Bump github.com/technologize/otel-go-contrib ( #2765 )
2024-03-18 09:54:32 +00:00
c27049ad15
[chore] bump modernc.org/sqlite v1.28.0 -> v1.29.4 ( #2749 )
2024-03-12 18:21:59 +01:00
5e871e81a8
[chore] Update usage of OTEL libraries ( #2725 )
...
* otel to 1.24
* prometheus exporter to 0.46
* bunotel to 1.1.17
Also:
* Use schemaless URL for metrics
* Add software version to tracing schema
2024-03-11 15:34:34 +01:00
8e88ee8d9c
[chore]: Bump github.com/minio/minio-go/v7 from 7.0.67 to 7.0.69 ( #2748 )
2024-03-11 10:51:13 +00:00
5a56f4f8fb
[chore]: Bump github.com/go-jose/go-jose/v3 from 3.0.1 to 3.0.3 ( #2733 )
2024-03-11 10:36:13 +00:00
d115f9ebc4
[chore]: Bump github.com/jackc/pgx/v5 from 5.5.3 to 5.5.5 ( #2747 )
2024-03-11 10:13:33 +00:00
e24efcac8b
[chore]: Bump github.com/gin-contrib/cors from 1.5.0 to 1.7.0 ( #2745 )
2024-03-11 10:12:06 +00:00
ebdee5aed8
[chore] Downgrade sqlite v1.29.2 -> v1.28.0 ( #2736 )
...
* [chore] Downgrade sqlite v1.29.2 -> v1.29.0
* go down to v1.28.0
2024-03-08 11:45:15 +01:00
kim