Commit Graph

541 Commits

Author SHA1 Message Date
jj
c392864c82
api/env: unquote variables if needed
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-05-25 12:44:40 +00:00
jj
ba2d266de7
api: dynamic env reloading from path/url 2025-05-24 15:52:27 +00:00
jj
e76ccd1941
api: move env loading into separate file 2025-05-24 14:47:01 +00:00
jj
06ee65b55d
api/api-keys: watch for file changes instead of polling 2025-05-24 14:32:50 +00:00
jj
2eadc3fbd8
api/create-filename: relax sanitizeString and use fullwidth replacements 2025-05-23 07:44:05 +00:00
wukko
f36c749692
api/twitter: add support for saving media from ad cards
Some checks are pending
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / api sanity check (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
2025-05-23 13:06:51 +06:00
wukko
0ae0bbfa1f
api/core: use new tunnel rate limit env 2025-05-14 19:07:11 +06:00
wukko
a66e789317
api/config: add tunnel rate limit env 2025-05-14 19:06:59 +06:00
wukko
06b865e965
api/config: limit acceptable FORCE_LOCAL_PROCESSING values
and throw an error if the value is wrong
2025-05-06 17:33:06 +06:00
wukko
4d582798bf
api/match: force local processing when configured to do so in env 2025-05-06 16:16:52 +06:00
wukko
c5acb45557
api/core: mark request as session when bearer token is used
and pass it to match() for future consumption
2025-05-06 16:16:29 +06:00
wukko
d0539118ce
api/config: add FORCE_LOCAL_PROCESSING 2025-05-06 16:12:51 +06:00
wukko
a95f87ebfb
api & web: make "basic" the default filename style 2025-04-30 21:33:36 +06:00
wukko
9a3d35185b
merge: soundcloud fix from main 2025-04-30 13:11:02 +06:00
wukko
4b9644ebdf
api/package: bump version to 10.9.4
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-04-29 23:10:18 +06:00
wukko
00b217796f
api/soundcloud: fix short link url & refactor 2025-04-29 22:55:52 +06:00
wukko
4202c954d1
merge: api 10.9.3 from main 2025-04-24 16:27:17 +06:00
wukko
de6b611c41
api/package: bump version to 10.9.3
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-04-24 16:15:09 +06:00
wukko
d0deec546b
api/service-config: add new snapchat link pattern 2025-04-24 15:44:52 +06:00
wukko
7ff6d0036b
api/snapchat: prevent errors if params are undefined 2025-04-24 15:44:34 +06:00
wukko
1335313e39
api/service-patterns: increase xiaohongshu shareId max length 2025-04-24 15:30:52 +06:00
wukko
c1b592430a
merge: api updates from main 2025-04-23 21:10:52 +06:00
jj
6f6f885723
api/youtube: update Session arguments to match new constructor 2025-04-23 14:02:27 +00:00
wukko
678f3a6c57
package: update youtubei.js to 13.4.0 2025-04-23 18:58:00 +06:00
wukko
335cd51eb5
api: add an option to allow better audio from youtube
& an env variable to disable it if needed
2025-04-20 20:45:07 +06:00
wukko
06bc51db54
merge: 10.9 from main
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-04-02 21:48:58 +06:00
wukko
fc050d78e2
api/package: bump version to 10.9.1
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-04-02 21:41:43 +06:00
jj
07f81c5d1d
api/reddit: clean up duplicated headers 2025-04-02 12:35:45 +00:00
jj
f5df78ffec
api/utils: retry getting redirecting url with fetch() if request() fails 2025-04-02 12:29:18 +00:00
Felix Vuong 🍂
a6240d0192
api/url: replace user-agent argument with headers in redirect helpers 2025-04-02 11:44:13 +00:00
Felix Vuong 🍂
b1bde25dee
api/reddit: add support for short links 2025-04-02 11:42:59 +00:00
wukko
1477dcd4e7
api/tests/instagram: allow the private post test to fail
sometimes the visibility status isn't returned
2025-04-02 17:35:01 +06:00
wukko
d352eed85f
api/package: bump version to 10.9 2025-04-01 15:35:25 +06:00
wukko
f70f88bc4c
api/core: customizable session rate limit params
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-03-31 22:32:21 +06:00
jj
1f768df4ec
api: bind session tokens to ip hash 2025-03-30 17:08:34 +00:00
wukko
bf5937e336
api/package: bump version to 10.8.4
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-03-29 19:48:11 +06:00
jj
39274d88f6
api/youtube-session: bypass proxy for requests
usually the session server is hosted locally, which
means the proxy tries to access the wrong url
2025-03-29 10:28:11 +00:00
wukko
0b29121c53
merge: changes from main 2025-03-27 20:02:46 +06:00
wukko
2d38d63003
api/package: update youtubei.js to 13.3.0
Some checks failed
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-03-25 19:11:19 +06:00
wukko
5036c492b8
api/service-config/tiktok: remove trailing forward slash from a pattern 2025-03-25 18:32:05 +06:00
wukko
ab13f78326
api/tiktok: normalize short link URL & catch empty patternMatch 2025-03-25 18:31:12 +06:00
Felix Vuong 🍂
2f38260e23 api/service-config: add tiktok lite url pattern 2025-03-25 18:11:49 +07:00
lostdusty
0a7cf7580c
api/core: remove non-printable unicode character in boot message (#1182)
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-03-21 22:43:53 +06:00
wukko
36516598f9
api/package: bump version to 10.8.2 2025-03-21 22:34:03 +06:00
wukko
1be9a86745
api/tests/xiaohongshu: update the video link & allow to fail
all links expire apparently
2025-03-21 22:16:49 +06:00
wukko
c7c20c2157
api/tests/xiaohongshu: update the live photo picker link 2025-03-21 21:52:21 +06:00
wukko
b93099620f
api/match/youtube: use 1080 dummy quality for audio-only downloads 2025-03-21 21:30:47 +06:00
wukko
cf17f53405
api/youtube: use the iOS client for <=1080p vp9 videos 2025-03-21 21:29:25 +06:00
wukko
ee94513580
api/package: bump version to 10.8.1
Some checks failed
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-03-20 18:11:04 +06:00
wukko
24ce19d09f
api/youtube: use both ios & web_embedded client depending on request
this ensures better reliability & reduces rate limiting of either clients
2025-03-20 17:57:02 +06:00
wukko
e779506d9e
api/package: update youtube.js
it contains a fix that's necessary for youtube to work rn
2025-03-20 17:49:08 +06:00
wukko
f8ee005b06
api/package: bump version to 10.8
Some checks are pending
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-03-20 00:18:31 +06:00
wukko
073b169a93
api: remove code & docs related to youtube oauth
it hasn't been functional for a while, unfortunately
2025-03-19 20:43:31 +06:00
wukko
d1b5983e49
api/youtube: disable HLS if a session server is used 2025-03-19 20:34:56 +06:00
wukko
4e6d1c4051
api/tests/youtube: allow HLS tests to fail 2025-03-19 20:32:44 +06:00
wukko
b6cd0ad727
api: automatically pull youtube session tokens from a session server
if provided, cobalt will pull poToken & visitor_data from an instance of invidious' youtube-trusted-session-generator or its counterpart
2025-03-19 19:54:20 +06:00
wukko
6a13ca347d
api/request/local-processing: don't return an empty audio object
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
& also throw errors whenever a response is invalid
2025-03-19 13:38:55 +06:00
wukko
e497ea51f1
api/request: reformat the local processing response, add output mimetype 2025-03-19 12:24:26 +06:00
wukko
97fee5e6d4
merge: updates from main 2025-03-15 21:25:23 +06:00
wukko
a940eb13fd
api/package: bump version to 10.7.10
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
it's kind of ridiculous at this point
2025-03-14 09:17:01 +06:00
wukko
d2d098dbfb
api/youtube: use custom innertube client env & decipher for more clients 2025-03-14 08:54:42 +06:00
wukko
e10fad3d4e
api/config: add CUSTOM_INNERTUBE_CLIENT env 2025-03-14 08:53:26 +06:00
wukko
2197d9411e
merge: updates from main 2025-03-13 14:56:49 +06:00
wukko
aba23f8655
api/package: bump version to 10.7.9
Some checks failed
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
2025-03-13 14:56:31 +06:00
wukko
2ebe2899be
api/youtube: return an appropriate error if a video is locked behind DRM 2025-03-13 13:23:03 +06:00
hyperdefined
d00d94f3dc
api/pinterest: fix video parsing (#1153)
Some checks are pending
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
fixes #1148
2025-03-12 12:35:27 +01:00
wukko
440d039e2c
api/package: bump version to 10.7.8
Some checks are pending
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run service tests / test service functionality (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-03-11 14:10:01 +06:00
wukko
39b6bb2593
api/twitter: change const to let for media 2025-03-11 14:01:34 +06:00
wukko
9579c3dd08
api/twitter: fix return in extractGraphqlMedia 2025-03-11 13:59:59 +06:00
wukko
69421a11ad
api/twitter: refactor, move graphql media extraction to a function 2025-03-11 13:58:24 +06:00
wukko
30460586c4
api/tests/twitter: add a gif test 2025-03-11 12:34:07 +06:00
wukko
75b498ed77
api/twitter: add fallback to syndication api
it's back yet again, now for good, i suppose
2025-03-11 12:34:04 +06:00
wukko
69dd37c5c3
api/twitter: handle 403 with no cookie in requestTweet() 2025-03-11 10:25:49 +06:00
wukko
9639c599f0
api/twitter: handle empty body properly 2025-03-11 10:00:24 +06:00
wukko
187bf9d745
merge: api 10.7.7 from main
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-03-07 00:07:52 +06:00
wukko
c346d2b027
api/package: bump version to 10.7.7
Some checks failed
Run service tests / test service functionality (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-03-06 23:43:13 +06:00
jj
97f71df962
api/tests: replace broken facebook video link 2025-03-06 17:23:36 +00:00
jj
068ae2f2e7
api/internal: also transplant youtube HEAD requests 2025-03-06 17:16:46 +00:00
wukko
540aee6194
merge: updates from main 2025-02-24 15:11:30 +06:00
wukko
187b1f8f05
api/package: update youtube.js to 13.1.0
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-23 13:39:07 +06:00
wukko
82f3062759
api & web: bump package version to 10.7.5 2025-02-18 18:30:15 +06:00
jj
dba405a6b4
api/facebook: add dispatcher support (#1115) 2025-02-18 17:44:25 +06:00
jj
a52aee2bb3
ci: use TEST_IGNORE_SERVICES variable for ignoring services 2025-02-18 09:12:55 +00:00
wukko
dcc99f0e62
merge: 10.7.4 from main branch
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-13 17:20:11 +06:00
wukko
b540e48ffb
api/package: bump version to 10.7.4
Some checks failed
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-13 17:19:32 +06:00
wukko
b5ba86dd75
api/youtube: return a proper error if the video is "inappropriate" 2025-02-13 17:09:03 +06:00
wukko
c31c484894
merge: 10.7.3 from main
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-11 16:18:30 +06:00
wukko
80f9769d88
api/package: bump version to 10.7.3 2025-02-11 16:15:30 +06:00
wukko
4dc7d28696
api/instagram: fall back to photo in extractOldPost if video has no url
Some checks are pending
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-11 15:42:16 +06:00
lostdusty
fa267ae54b
api/core: return 429 http status for rate-limit (#1066)
Some checks are pending
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Co-authored-by: jj <log@riseup.net>
2025-02-11 14:42:31 +06:00
jj
d8eda230e8
api/test: fix more twitter tests 2025-02-10 22:10:35 +00:00
jj
92061f2e82
api/run-test: print error code for unexpected errors 2025-02-10 22:06:30 +00:00
jj
fcb5023c23
api/test: always randomize ciphers and override envs 2025-02-10 22:04:57 +00:00
jj
d79950b15f
api/test: clear a bunch of canFails 2025-02-10 22:03:10 +00:00
jj
0426621cf5
api/test: fix twitter bookmarked photo link 2025-02-10 21:59:11 +00:00
jj
a06bad161a
api/test: add env for configuring ignored tests 2025-02-10 21:55:11 +00:00
jj
8f57881a68
api/test: use proxy from external proxy env if available 2025-02-10 21:48:30 +00:00
Satya Ananda
d6b0fbc8ec
api/url: extract loom video id from longer links (#832)
Co-authored-by: jj <log@riseup.net>
2025-02-11 14:52:20 +06:00
zjy4fun
ca0bc9f395
api/ok: fix author not being handled properly (#1009) 2025-02-11 14:42:07 +06:00
wukko
ad23b70e9d
merge: api 10.7.2 from main branch
Some checks are pending
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-10 15:27:53 +06:00