wukko
b6cd0ad727
api: automatically pull youtube session tokens from a session server
...
if provided, cobalt will pull poToken & visitor_data from an instance of invidious' youtube-trusted-session-generator or its counterpart
2025-03-19 19:54:20 +06:00
wukko
6a13ca347d
api/request/local-processing: don't return an empty audio object
...
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
& also throw errors whenever a response is invalid
2025-03-19 13:38:55 +06:00
wukko
e497ea51f1
api/request: reformat the local processing response, add output mimetype
2025-03-19 12:24:26 +06:00
wukko
97fee5e6d4
merge: updates from main
2025-03-15 21:25:23 +06:00
wukko
a940eb13fd
api/package: bump version to 10.7.10
...
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
it's kind of ridiculous at this point
2025-03-14 09:17:01 +06:00
wukko
d2d098dbfb
api/youtube: use custom innertube client env & decipher for more clients
2025-03-14 08:54:42 +06:00
wukko
e10fad3d4e
api/config: add CUSTOM_INNERTUBE_CLIENT env
2025-03-14 08:53:26 +06:00
wukko
2197d9411e
merge: updates from main
2025-03-13 14:56:49 +06:00
wukko
aba23f8655
api/package: bump version to 10.7.9
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
2025-03-13 14:56:31 +06:00
wukko
2ebe2899be
api/youtube: return an appropriate error if a video is locked behind DRM
2025-03-13 13:23:03 +06:00
hyperdefined
d00d94f3dc
api/pinterest: fix video parsing ( #1153 )
...
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
fixes #1148
2025-03-12 12:35:27 +01:00
wukko
440d039e2c
api/package: bump version to 10.7.8
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run service tests / test service functionality (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-03-11 14:10:01 +06:00
wukko
39b6bb2593
api/twitter: change const to let for media
2025-03-11 14:01:34 +06:00
wukko
9579c3dd08
api/twitter: fix return in extractGraphqlMedia
2025-03-11 13:59:59 +06:00
wukko
69421a11ad
api/twitter: refactor, move graphql media extraction to a function
2025-03-11 13:58:24 +06:00
wukko
30460586c4
api/tests/twitter: add a gif test
2025-03-11 12:34:07 +06:00
wukko
75b498ed77
api/twitter: add fallback to syndication api
...
it's back yet again, now for good, i suppose
2025-03-11 12:34:04 +06:00
wukko
69dd37c5c3
api/twitter: handle 403 with no cookie in requestTweet()
2025-03-11 10:25:49 +06:00
wukko
9639c599f0
api/twitter: handle empty body properly
2025-03-11 10:00:24 +06:00
wukko
187bf9d745
merge: api 10.7.7 from main
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-03-07 00:07:52 +06:00
wukko
c346d2b027
api/package: bump version to 10.7.7
Run service tests / test service functionality (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-03-06 23:43:13 +06:00
jj
97f71df962
api/tests: replace broken facebook video link
2025-03-06 17:23:36 +00:00
jj
068ae2f2e7
api/internal: also transplant youtube HEAD requests
2025-03-06 17:16:46 +00:00
wukko
540aee6194
merge: updates from main
2025-02-24 15:11:30 +06:00
wukko
187b1f8f05
api/package: update youtube.js to 13.1.0
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-23 13:39:07 +06:00
wukko
82f3062759
api & web: bump package version to 10.7.5
2025-02-18 18:30:15 +06:00
jj
dba405a6b4
api/facebook: add dispatcher support ( #1115 )
2025-02-18 17:44:25 +06:00
jj
a52aee2bb3
ci: use TEST_IGNORE_SERVICES variable for ignoring services
2025-02-18 09:12:55 +00:00
wukko
dcc99f0e62
merge: 10.7.4 from main branch
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-13 17:20:11 +06:00
wukko
b540e48ffb
api/package: bump version to 10.7.4
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-13 17:19:32 +06:00
wukko
b5ba86dd75
api/youtube: return a proper error if the video is "inappropriate"
2025-02-13 17:09:03 +06:00
wukko
c31c484894
merge: 10.7.3 from main
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-11 16:18:30 +06:00
wukko
80f9769d88
api/package: bump version to 10.7.3
2025-02-11 16:15:30 +06:00
wukko
4dc7d28696
api/instagram: fall back to photo in extractOldPost if video has no url
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-11 15:42:16 +06:00
lostdusty
fa267ae54b
api/core: return 429 http status for rate-limit ( #1066 )
...
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Co-authored-by: jj <log@riseup.net>
2025-02-11 14:42:31 +06:00
jj
d8eda230e8
api/test: fix more twitter tests
2025-02-10 22:10:35 +00:00
jj
92061f2e82
api/run-test: print error code for unexpected errors
2025-02-10 22:06:30 +00:00
jj
fcb5023c23
api/test: always randomize ciphers and override envs
2025-02-10 22:04:57 +00:00
jj
d79950b15f
api/test: clear a bunch of canFails
2025-02-10 22:03:10 +00:00
jj
0426621cf5
api/test: fix twitter bookmarked photo link
2025-02-10 21:59:11 +00:00
jj
a06bad161a
api/test: add env for configuring ignored tests
2025-02-10 21:55:11 +00:00
jj
8f57881a68
api/test: use proxy from external proxy env if available
2025-02-10 21:48:30 +00:00
Satya Ananda
d6b0fbc8ec
api/url: extract loom video id from longer links ( #832 )
...
Co-authored-by: jj <log@riseup.net>
2025-02-11 14:52:20 +06:00
zjy4fun
ca0bc9f395
api/ok: fix author not being handled properly ( #1009 )
2025-02-11 14:42:07 +06:00
wukko
ad23b70e9d
merge: api 10.7.2 from main branch
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-10 15:27:53 +06:00
wukko
07947882c4
api/package: bump version to 10.7.2
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-10 11:53:49 +06:00
wukko
de69989bbe
api/service-config/instagram: add support for more share links
2025-02-10 11:53:37 +06:00
wukko
8ab5e32390
api/package: bump version to 10.7.1
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-10 00:57:19 +06:00
wukko
09706160a9
api/snapchat: allow profile params to be missing
...
fixes broken story extraction
2025-02-10 00:33:23 +06:00
wukko
a0f227d68b
api/reddit: add support for mobile links & bunch of other links ( #1098 )
...
* api/reddit: extract params from a mobile share link
* api/reddit: add support for a bunch of links & update the api endpoint
also fixed "undefined" in a filename when downloading a user post
* api/service-patterns: fix reddit id pattern
2025-02-10 00:17:48 +06:00
wukko
fb739f5315
merge: 10.7 api from main branch
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-09 18:34:30 +06:00
wukko
5306760890
api/package: bump version to 10.7
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-09 18:31:55 +06:00
wukko
6e653f468b
api/instagram: add a filename to all single images
2025-02-09 18:23:28 +06:00
jj
55f591b37d
api/instagram: add explanation for resolveRedirectingURL user-agent
2025-02-09 11:59:10 +00:00
jj
59cb6b05be
api/test: add test for private instagram posts
2025-02-09 11:50:26 +00:00
wukko
20525d6c7c
api/processing/url: sort imports by line length
2025-02-09 17:49:19 +06:00
wukko
5b63e2e6f2
api/instagram: sort imports by line length
2025-02-09 17:48:49 +06:00
wukko
b3b893b8f3
api/misc/utils: add one (1) line break
2025-02-09 17:48:37 +06:00
wukko
9d2f77949a
api/tests/snapchat: revert story link change
2025-02-09 17:48:00 +06:00
wukko
98dbba5672
api/test: add reddit to finicky list cuz reddit blocked github ips
2025-02-09 17:42:10 +06:00
jj
3f6dd4fced
api/youtube: expect errorInfo to not be json
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-08 20:59:53 +00:00
jj
a918b12387
api/tests: fix broken tests
2025-02-08 20:59:27 +00:00
jj
a8cc5bc8bc
api/instagram: update tests
2025-02-08 20:05:49 +00:00
jj
cca61275f1
api/instagram: add support for share urls
...
closes #998
2025-02-08 17:24:02 +00:00
jj
1be13a30bf
api/instagram: age-restricted and private account-specific errors
...
fixes #222
2025-02-08 16:45:31 +00:00
jj
6d18dff5cc
api/bilibili: use shortlink resolver
2025-02-08 16:27:33 +00:00
jj
bbcb2bee7c
api/pinterest: use shortlink resolver
2025-02-08 16:09:49 +00:00
jj
5db5437b62
api/pinterest: fix undefined in name when downloading shortlink
2025-02-08 16:08:34 +00:00
jj
a758b1dbc6
api/snapchat: use shortlink resolver
2025-02-08 16:06:36 +00:00
jj
9e6582b76c
api/xiaohongshu: use shortlink resolver
2025-02-08 16:05:51 +00:00
jj
6e8b4f30c1
api/url: add function for resolving shortlinks
...
motivation: we frequently need to resolve shortlinks to full URLs
let's have a common standard function for doing this safely
instead of reinventing the wheel in every single service module
2025-02-08 13:53:29 +00:00
jj
77dca70792
api/instagram: yet another attempt at resurrection
2025-02-07 22:47:36 +00:00
wukko
0ce777cbfc
api/internal-hls: transform segment uri when probing the HLS tunnel
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-06 14:29:42 +06:00
wukko
fd1a7530ed
merge: api updates from main
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-30 16:47:21 +06:00
jj
c48c64240b
api/internal: allow redirects when reading chunks
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-29 21:51:35 +00:00
wukko
affe49474d
api/readme: fix a typo in acknowledgments
...
an ability -> the ability
2025-01-29 16:43:12 +06:00
wukko
1c34d2daff
merge: docs & test updates from main
2025-01-29 15:43:51 +06:00
wukko
e7d4b72c8c
api/schema: tiktokH265 -> allowH265, twitterGif -> convertGif
...
h265 param is already used for more than tiktok, and gif param will be used for bluesky gifs in the future
2025-01-29 15:37:58 +06:00
wukko
c7c9cf2f0f
api: add local processing response type & param
...
`local-processing` type returns needed info for on-device processing and creates basic proxy tunnels
2025-01-29 15:00:50 +06:00
wukko
906d929333
api/tests/pinterest: update the gif link
...
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
because the id changed???
2025-01-23 22:00:02 +06:00
wukko
7b31817fdb
api/tests/xiaohongshu: update photo test link
2025-01-23 21:58:41 +06:00
wukko
31f6ff9b87
api/tests/loom: update test links
...
the old video is unavailable for an unknown reason. it's unplayable in a regular browser and also loom's own landing page.
2025-01-23 21:51:06 +06:00
wukko
99265d594b
api/readme: update list of supported services & list of dependencies
2025-01-22 14:41:44 +06:00
jj
c4c47bdc27
merge: 10.6 updates
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-21 13:36:37 +00:00
wukko
cecb8a4c53
api/package: bump version to 10.6
2025-01-21 17:25:45 +06:00
wukko
36d4608ee5
api/bluesky: add support for tenor gifs
2025-01-21 17:18:49 +06:00
jj
ee3ef60a20
api/youtube: expect one of itags to be empty
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-20 20:12:21 +00:00
wukko
0ab3fe4d2a
api: itunnel transplants ( #1065 )
2025-01-21 00:10:49 +06:00
jj
600c769141
api/stream: implement itunnel transplants
2025-01-20 15:55:26 +00:00
jj
c07940bfa4
api/itunnel: pass itunnel object by reference
2025-01-20 15:46:03 +00:00
jj
19ade7c905
api/youtube: return internal metadata for replaying request
2025-01-20 14:47:09 +00:00
jj
7767a5f5bb
api/youtube: add support for pinning client/itag
2025-01-20 14:46:55 +00:00
jj
035825bc05
api: cache original request parameters in stream
2025-01-20 14:38:55 +00:00
wukko
7488c74faf
api/xiaohongshu: clean up the h265-h264 if statement
...
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:46:12 +06:00
wukko
e39b0ae7b3
api/xiaohongshu: deduplicate h264 stream extraction
...
reduce() isn't called on 1 item arrays, so this is just fine
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:41:02 +06:00
wukko
4963c9f128
api/xiaohongshu: remove duplicated extraction error
...
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:37:23 +06:00
wukko
3cbed87c3e
api/xiaohongshu: update initial state extraction regex
...
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:35:53 +06:00
wukko
de5eca19a5
api/utils: replace redirectStatuses array with a set
...
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:30:11 +06:00
wukko
cd0a2a47c9
api/tests/pinterest: update expected photo status
2025-01-20 19:28:35 +06:00
wukko
cd466a418a
api/tests/bsky: fix expected photo test status
2025-01-20 19:24:12 +06:00
