mirror of
1
Fork 0
gotosocial/internal
kim 5318054808
[performance] media processing improvements (#1288)
* media processor consolidation and reformatting, reduce amount of required syscalls

Signed-off-by: kim <grufwub@gmail.com>

* update go-store library, stream jpeg/png encoding + use buffer pools, improved media processing AlreadyExists error handling

Signed-off-by: kim <grufwub@gmail.com>

* fix duration not being set, fix mp4 test expecting error

Signed-off-by: kim <grufwub@gmail.com>

* fix test expecting media files with different extension

Signed-off-by: kim <grufwub@gmail.com>

* remove unused code

Signed-off-by: kim <grufwub@gmail.com>

* fix expected storage paths in tests, update expected test thumbnails

Signed-off-by: kim <grufwub@gmail.com>

* remove dead code

Signed-off-by: kim <grufwub@gmail.com>

* fix cached presigned s3 url fetching

Signed-off-by: kim <grufwub@gmail.com>

* fix tests

Signed-off-by: kim <grufwub@gmail.com>

* fix test models

Signed-off-by: kim <grufwub@gmail.com>

* update media processing to use sync.Once{} for concurrency protection

Signed-off-by: kim <grufwub@gmail.com>

* shutup linter

Signed-off-by: kim <grufwub@gmail.com>

* fix passing in KVStore GetStream() as stream to PutStream()

Signed-off-by: kim <grufwub@gmail.com>

* fix unlocks of storage keys

Signed-off-by: kim <grufwub@gmail.com>

* whoops, return the error...

Signed-off-by: kim <grufwub@gmail.com>

* pour one out for tobi's code <3

Signed-off-by: kim <grufwub@gmail.com>

* add back the byte slurping code

Signed-off-by: kim <grufwub@gmail.com>

* check for both ErrUnexpectedEOF and EOF

Signed-off-by: kim <grufwub@gmail.com>

* add back links to file format header information

Signed-off-by: kim <grufwub@gmail.com>

Signed-off-by: kim <grufwub@gmail.com>
2023-01-11 12:13:13 +01:00
..
ap [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
api [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
cache [feature] Implement Report database model and utility functions (#1310) 2023-01-10 14:19:05 +00:00
concurrency [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
config [feature] Implement Report database model and utility functions (#1310) 2023-01-10 14:19:05 +00:00
db [feature] Implement Report database model and utility functions (#1310) 2023-01-10 14:19:05 +00:00
email [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
federation [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
gotosocial [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
gtserror [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
gtsmodel [feature] Implement Report database model and utility functions (#1310) 2023-01-10 14:19:05 +00:00
httpclient [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
id [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
iotools [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
log [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
media [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
messages [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
middleware [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
netutil [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
oauth [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
oidc [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
processing [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
regexes [feature] Implement Report database model and utility functions (#1310) 2023-01-10 14:19:05 +00:00
router [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
state [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
storage [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
stream [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
text [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
timeline [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
trans [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
transport [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
typeutils [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
uris [feature] Implement Report database model and utility functions (#1310) 2023-01-10 14:19:05 +00:00
util [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
validate [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
visibility [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
web [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00