9143ac6fb4
updates go-mutexes to no longer rely on unsafe linkname ( #3027 )
2024-06-21 17:35:32 +01:00
b93087ceb4
[chore] update go-structr and go-mangler to no longer rely on modern-go/reflect2 ( #3026 )
...
* updates go-structr and go-mangler to no longer rely on modern-go/reflect2 (*phew* now we're go1.23 safe)
* update go-structr version
* bump go-structr to improve memory usage (v. slightly) in certain conditions
2024-06-21 16:43:17 +01:00
7b1ccbd65a
[feature] add worker task serialization logic ( #2989 )
...
* improved server shutdown with more precise shutdown of modules + deferring of ALL of it
* move delivery and workers into separate files
* add worker task model and Serialize() / Deserialize() methods for message types
* start adding message serialize / deserialize tests
* start adding test cases
* update body rewinding to rely on standard library mechanism of r.GetBody()
* remove request rewinding (http.Client{} should already handle this)
* standard library already handles rewinding
* improved code comment
* move the newPOST() function contents to prepare(), fits better with current API
* add Serialize() / Deserialize() implementations for Delivery{} type
* finish writing FromClientAPI sserialize / deserialize tests
* start adding FromFediAPI{} serialize / deserialize test cases
* fix FromFediAPI{} tests
* add tests for delivery message type
* fix repeat code
* missing license header
* use testrig status and accounts for marshal / unmarshaling tests
* add a specific test for checking account RSA keys are preserved
2024-06-20 17:06:20 +00:00
7ab404d643
[chore]: Bump github.com/spf13/cobra from 1.8.0 to 1.8.1 ( #3016 )
2024-06-17 08:13:40 +00:00
cc64de4dcc
[chore]: Bump golang.org/x/oauth2 from 0.20.0 to 0.21.0 ( #3015 )
2024-06-17 08:13:14 +00:00
3a01377bcc
[chore]: Bump github.com/miekg/dns from 1.1.59 to 1.1.61 ( #3014 )
2024-06-17 08:12:25 +00:00
b7dede2a47
[chore]: Bump github.com/tdewolff/minify/v2 from 2.20.33 to 2.20.34 ( #3017 )
2024-06-17 08:11:08 +00:00
76d695d847
[chore]: Bump github.com/yuin/goldmark from 1.7.1 to 1.7.2 ( #3018 )
2024-06-17 08:10:11 +00:00
978b4176f1
[chore] Upgrade wasm-sqlite to v0.16.2 ( #2997 )
2024-06-12 13:21:34 +01:00
69aba377bc
[chore]: Bump golang.org/x/image from 0.16.0 to 0.17.0 ( #2985 )
...
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.16.0 to 0.17.0.
- [Commits](https://github.com/golang/image/compare/v0.16.0...v0.17.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-10 08:10:25 +00:00
a687f0634c
[chore]: Bump github.com/gorilla/websocket from 1.5.1 to 1.5.2 ( #2987 )
...
Bumps [github.com/gorilla/websocket](https://github.com/gorilla/websocket ) from 1.5.1 to 1.5.2.
- [Release notes](https://github.com/gorilla/websocket/releases )
- [Commits](https://github.com/gorilla/websocket/compare/v1.5.1...v1.5.2 )
---
updated-dependencies:
- dependency-name: github.com/gorilla/websocket
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-10 07:43:38 +00:00
12c406d968
[chore]: Bump github.com/tdewolff/minify/v2 from 2.20.32 to 2.20.33 ( #2984 )
...
Bumps [github.com/tdewolff/minify/v2](https://github.com/tdewolff/minify ) from 2.20.32 to 2.20.33.
- [Release notes](https://github.com/tdewolff/minify/releases )
- [Commits](https://github.com/tdewolff/minify/compare/v2.20.32...v2.20.33 )
---
updated-dependencies:
- dependency-name: github.com/tdewolff/minify/v2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-10 07:41:15 +00:00
3babb6c0d2
[chore]: Bump golang.org/x/net from 0.25.0 to 0.26.0 ( #2986 )
...
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.25.0 to 0.26.0.
- [Commits](https://github.com/golang/net/compare/v0.25.0...v0.26.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-10 07:40:53 +00:00
83ee766e34
[chore]: Bump github.com/minio/minio-go/v7 from 7.0.70 to 7.0.71 ( #2988 )
...
Bumps [github.com/minio/minio-go/v7](https://github.com/minio/minio-go ) from 7.0.70 to 7.0.71.
- [Release notes](https://github.com/minio/minio-go/releases )
- [Commits](https://github.com/minio/minio-go/compare/v7.0.70...v7.0.71 )
---
updated-dependencies:
- dependency-name: github.com/minio/minio-go/v7
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-10 07:40:16 +00:00
cc4f773b0e
[chore] Update WASM go-sqlite3 to v0.16.1 ( #2976 )
...
This includes support for journal mode set to WAL on the BSDs.
Relates to: #1753 , #2962
2024-06-07 15:06:43 +02:00
6ed6824d5d
bump go-structr to v0.8.5 to improve memory usage ( #2955 )
2024-06-03 12:03:35 +01:00
addaba05c0
[chore]: Bump github.com/spf13/viper from 1.18.2 to 1.19.0 ( #2954 )
...
Bumps [github.com/spf13/viper](https://github.com/spf13/viper ) from 1.18.2 to 1.19.0.
- [Release notes](https://github.com/spf13/viper/releases )
- [Commits](https://github.com/spf13/viper/compare/v1.18.2...v1.19.0 )
---
updated-dependencies:
- dependency-name: github.com/spf13/viper
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-03 10:52:54 +01:00
1e7b32490d
[experiment] add alternative wasm sqlite3 implementation available via build-tag ( #2863 )
...
This allows for building GoToSocial with [SQLite transpiled to WASM](https://github.com/ncruces/go-sqlite3 ) and accessed through [Wazero](https://wazero.io/ ).
2024-05-27 17:46:15 +02:00
d96cca60a1
[chore]: Bump github.com/tdewolff/minify/v2 from 2.20.25 to 2.20.32 ( #2927 )
2024-05-27 09:36:09 +00:00
0a18c0d802
[chore]: Bump github.com/jackc/pgx/v5 from 5.5.5 to 5.6.0 ( #2929 )
2024-05-27 09:35:41 +00:00
3d3e99ae52
[performance] update storage backend and make use of seek syscall when available ( #2924 )
...
* update to use go-storage/ instead of go-store/v2/storage/
* pull in latest version from codeberg
* remove test output 😇
* add code comments
* set the exclusive bit when creating new files in disk config
* bump to actual release version
* bump to v0.1.1 (tis a simple no-logic change)
* update readme
* only use a temporary read seeker when decoding video if required (should only be S3 now)
* use fastcopy library to use memory pooled buffers when calling TempFileSeeker()
* update to use seek call in serveFileRange()
2024-05-22 11:46:24 +02:00
06b1e0173b
--- ( #2923 )
...
updated-dependencies:
- dependency-name: github.com/tdewolff/minify/v2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-21 14:37:47 +01:00
6c0d93c6cb
[chore] dependabot updates ( #2922 )
...
* [chore]: Bump github.com/prometheus/client_golang from 1.18.0 to 1.19.1
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang ) from 1.18.0 to 1.19.1.
- [Release notes](https://github.com/prometheus/client_golang/releases )
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md )
- [Commits](https://github.com/prometheus/client_golang/compare/v1.18.0...v1.19.1 )
---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [chore]: Bump github.com/KimMachineGun/automemlimit from 0.6.0 to 0.6.1
Bumps [github.com/KimMachineGun/automemlimit](https://github.com/KimMachineGun/automemlimit ) from 0.6.0 to 0.6.1.
- [Release notes](https://github.com/KimMachineGun/automemlimit/releases )
- [Commits](https://github.com/KimMachineGun/automemlimit/compare/v0.6.0...v0.6.1 )
---
updated-dependencies:
- dependency-name: github.com/KimMachineGun/automemlimit
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [chore]: Bump github.com/tdewolff/minify/v2 from 2.20.20 to 2.20.24
Bumps [github.com/tdewolff/minify/v2](https://github.com/tdewolff/minify ) from 2.20.20 to 2.20.24.
- [Release notes](https://github.com/tdewolff/minify/releases )
- [Commits](https://github.com/tdewolff/minify/compare/v2.20.20...v2.20.24 )
---
updated-dependencies:
- dependency-name: github.com/tdewolff/minify/v2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [chore]: Bump github.com/go-swagger/go-swagger
Bumps [github.com/go-swagger/go-swagger](https://github.com/go-swagger/go-swagger ) from 0.30.6-0.20240418033037-c46c303aaa02 to 0.31.0.
- [Release notes](https://github.com/go-swagger/go-swagger/releases )
- [Changelog](https://github.com/go-swagger/go-swagger/blob/master/.goreleaser.yml )
- [Commits](https://github.com/go-swagger/go-swagger/commits/v0.31.0 )
---
updated-dependencies:
- dependency-name: github.com/go-swagger/go-swagger
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [chore]: Bump github.com/gin-gonic/gin from 1.9.1 to 1.10.0
Bumps [github.com/gin-gonic/gin](https://github.com/gin-gonic/gin ) from 1.9.1 to 1.10.0.
- [Release notes](https://github.com/gin-gonic/gin/releases )
- [Changelog](https://github.com/gin-gonic/gin/blob/master/CHANGELOG.md )
- [Commits](https://github.com/gin-gonic/gin/compare/v1.9.1...v1.10.0 )
---
updated-dependencies:
- dependency-name: github.com/gin-gonic/gin
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-21 14:17:22 +01:00
16c1832793
[chore]: Bump github.com/gin-contrib/cors from 1.7.1 to 1.7.2 ( #2912 )
...
Bumps [github.com/gin-contrib/cors](https://github.com/gin-contrib/cors ) from 1.7.1 to 1.7.2.
- [Release notes](https://github.com/gin-contrib/cors/releases )
- [Changelog](https://github.com/gin-contrib/cors/blob/master/.goreleaser.yaml )
- [Commits](https://github.com/gin-contrib/cors/compare/v1.7.1...v1.7.2 )
---
updated-dependencies:
- dependency-name: github.com/gin-contrib/cors
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kim <89579420+NyaaaWhatsUpDoc@users.noreply.github.com>
2024-05-13 08:29:54 +00:00
f817f96596
[chore]: Bump github.com/gin-contrib/sessions from 1.0.0 to 1.0.1 ( #2916 )
...
Bumps [github.com/gin-contrib/sessions](https://github.com/gin-contrib/sessions ) from 1.0.0 to 1.0.1.
- [Release notes](https://github.com/gin-contrib/sessions/releases )
- [Changelog](https://github.com/gin-contrib/sessions/blob/master/.goreleaser.yaml )
- [Commits](https://github.com/gin-contrib/sessions/compare/v1.0.0...v1.0.1 )
---
updated-dependencies:
- dependency-name: github.com/gin-contrib/sessions
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-13 08:07:17 +00:00
96eea416f3
[chore]: Bump golang.org/x/net from 0.24.0 to 0.25.0 ( #2914 )
...
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.24.0 to 0.25.0.
- [Commits](https://github.com/golang/net/compare/v0.24.0...v0.25.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-13 08:06:30 +00:00
c06e6fb656
[performance] update go-structr and go-mutexes with memory usage improvements ( #2909 )
...
* update go-structr and go-mutexes with memory usage improvements
* bump to go-structr v0.8.4
2024-05-13 08:05:46 +00:00
f24ce34c3a
bump modernc.org/sqlite v1.29.8 -> v1.29.9 (concurrency workaround) ( #2906 )
2024-05-07 14:52:37 +01:00
3554991444
update go-structr -> v0.8.2 which includes some minor memory usage improvements ( #2904 )
2024-05-06 19:44:22 +00:00
a0d066844f
[chore]: Bump golang.org/x/oauth2 from 0.19.0 to 0.20.0 ( #2900 )
2024-05-06 11:14:04 +00:00
8237e8d09e
[chore]: Bump codeberg.org/gruf/go-structr from 0.7.0 to 0.8.0 ( #2902 )
...
Bumps codeberg.org/gruf/go-structr from 0.7.0 to 0.8.0.
---
updated-dependencies:
- dependency-name: codeberg.org/gruf/go-structr
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 08:51:06 +00:00
a5f28fe0c9
[chore]: Bump github.com/gin-contrib/gzip from 1.0.0 to 1.0.1 ( #2899 )
...
Bumps [github.com/gin-contrib/gzip](https://github.com/gin-contrib/gzip ) from 1.0.0 to 1.0.1.
- [Release notes](https://github.com/gin-contrib/gzip/releases )
- [Changelog](https://github.com/gin-contrib/gzip/blob/master/.goreleaser.yaml )
- [Commits](https://github.com/gin-contrib/gzip/compare/v1.0.0...v1.0.1 )
---
updated-dependencies:
- dependency-name: github.com/gin-contrib/gzip
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 08:50:47 +00:00
c98ec6f89d
[chore]: Bump golang.org/x/image from 0.15.0 to 0.16.0 ( #2898 )
...
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.15.0 to 0.16.0.
- [Commits](https://github.com/golang/image/compare/v0.15.0...v0.16.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 08:50:03 +00:00
bfc21e4850
[chore]: Bump github.com/tdewolff/minify/v2 from 2.20.19 to 2.20.20 ( #2875 )
2024-04-29 10:45:17 +00:00
d3bac8bbec
[chore]: Bump github.com/minio/minio-go/v7 from 7.0.69 to 7.0.70 ( #2877 )
2024-04-29 10:44:11 +00:00
1375a86919
[chore]: Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc ( #2878 )
2024-04-29 09:18:16 +00:00
b2eecd9dc7
[chore]: Bump go.opentelemetry.io/otel/sdk from 1.25.0 to 1.26.0 ( #2879 )
2024-04-29 09:02:12 +00:00
c9c0773f2c
[performance] update remaining worker pools to use queues ( #2865 )
...
* start replacing client + federator + media workers with new worker + queue types
* refactor federatingDB.Delete(), drop queued messages when deleting account / status
* move all queue purging to the processor workers
* undo toolchain updates
* code comments, ensure dereferencer worker pool gets started
* update gruf libraries in readme
* start the job scheduler separately to the worker pools
* reshuffle ordering or server.go + remove duplicate worker start / stop
* update go-list version
* fix vendoring
* move queue invalidation to before wipeing / deletion, to ensure queued work not dropped
* add logging to worker processing functions in testrig, don't start workers in unexpected places
* update go-structr to add (+then rely on) QueueCtx{} type
* ensure more worker pools get started properly in tests
* fix remaining broken tests relying on worker queue logic
* fix account test suite queue popping logic, ensure noop workers do not pull from queue
* move back accidentally shuffled account deletion order
* ensure error (non nil!!) gets passed in refactored federatingDB{}.Delete()
* silently drop deletes from accounts not permitted to
* don't warn log on forwarded deletes
* make if else clauses easier to parse
* use getFederatorMsg()
* improved code comment
* improved code comment re: requesting account delete checks
* remove boolean result from worker start / stop since false = already running or already stopped
* remove optional passed-in http.client
* remove worker starting from the admin CLI commands (we don't need to handle side-effects)
* update prune cli to start scheduler but not all of the workers
* fix rebase issues
* remove redundant return statements
* i'm sorry sir linter
2024-04-26 13:50:46 +01:00
fd8a724e77
[chore] Bump go swagger ( #2871 )
...
* bump go swagger version
* bump swagger version
2024-04-26 11:31:10 +02:00
62788aa116
[chore]: Bump codeberg.org/gruf/go-mutexes from 1.4.0 to 1.4.1 ( #2860 )
...
Bumps codeberg.org/gruf/go-mutexes from 1.4.0 to 1.4.1.
---
updated-dependencies:
- dependency-name: codeberg.org/gruf/go-mutexes
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-22 13:43:45 +01:00
a57dd15a8e
[chore]: Bump github.com/miekg/dns from 1.1.58 to 1.1.59 ( #2861 )
2024-04-22 09:11:53 +00:00
12a7eba01f
[chore] bump modernc.org/sqlite to v1.29.8 (with our concurrency workaround) ( #2855 )
2024-04-22 11:02:11 +02:00
0db9e34b69
[chore]: Bump github.com/KimMachineGun/automemlimit from 0.5.0 to 0.6.0 ( #2859 )
2024-04-22 08:59:30 +00:00
b3f2d44143
bump to modernc.org/sqlite v1.29.7 ( #2850 )
2024-04-17 17:10:51 +01:00
1018cde107
[chore] bump bun library versions ( #2837 )
2024-04-15 12:01:20 +02:00
6bb43f3f9b
[chore]: Bump golang.org/x/net from 0.23.0 to 0.24.0 ( #2834 )
2024-04-15 08:44:29 +00:00
66e4510bf1
[chore]: Bump golang.org/x/crypto from 0.21.0 to 0.22.0 ( #2835 )
2024-04-15 08:34:49 +00:00
c097745c38
[chore]: Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc ( #2818 )
...
Bumps [go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc](https://github.com/open-telemetry/opentelemetry-go ) from 1.24.0 to 1.25.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases )
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md )
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.24.0...v1.25.0 )
---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-11 11:46:18 +02:00
db2dcc3455
[chore] update go-structr => v0.6.2 (fixes nested field ptr following) ( #2822 )
...
* update go-structr => v0.6.1 (fixes nested field ptr following)
* bump to v0.6.2
2024-04-11 11:46:08 +02:00
a483bd9e38
[performance] massively improved ActivityPub delivery worker efficiency ( #2812 )
...
* add delivery worker type that pulls from queue to httpclient package
* finish up some code commenting, bodge a vendored activity library change, integrate the deliverypool changes into transportcontroller
* hook up queue deletion logic
* support deleting queued http requests by target ID
* don't index APRequest by hostname in the queue
* use gorun
* use the original context's values when wrapping msg type as delivery{}
* actually log in the AP delivery worker ...
* add uncommitted changes
* use errors.AsV2()
* use errorsv2.AsV2()
* finish adding some code comments, add bad host handling to delivery workers
* slightly tweak deliveryworkerpool API, use advanced sender multiplier
* remove PopCtx() method, let others instead rely on Wait()
* shuffle things around to move delivery stuff into transport/ subpkg
* remove dead code
* formatting
* validate request before queueing for delivery
* finish adding code comments, fix up backoff code
* finish adding more code comments
* clamp minimum no. senders to 1
* add start/stop logging to delivery worker, some slight changes
* remove double logging
* use worker ptrs
* expose the embedded log fields in httpclient.Request{}
* ensure request context values are preserved when updating ctx
* add delivery worker tests
* fix linter issues
* ensure delivery worker gets inited in testrig
* fix tests to delivering messages to check worker delivery queue
* update error type to use ptr instead of value receiver
* fix test calling Workers{}.Start() instead of testrig.StartWorkers()
* update docs for advanced-sender-multiplier
* update to the latest activity library version
* add comment about not using httptest.Server{}
2024-04-11 11:45:35 +02:00
kim