Commit Graph

434 Commits

Author SHA1 Message Date
wukko
6e653f468b
api/instagram: add a filename to all single images 2025-02-09 18:23:28 +06:00
jj
55f591b37d
api/instagram: add explanation for resolveRedirectingURL user-agent 2025-02-09 11:59:10 +00:00
jj
59cb6b05be
api/test: add test for private instagram posts 2025-02-09 11:50:26 +00:00
wukko
20525d6c7c
api/processing/url: sort imports by line length 2025-02-09 17:49:19 +06:00
wukko
5b63e2e6f2
api/instagram: sort imports by line length 2025-02-09 17:48:49 +06:00
wukko
b3b893b8f3
api/misc/utils: add one (1) line break 2025-02-09 17:48:37 +06:00
wukko
9d2f77949a
api/tests/snapchat: revert story link change 2025-02-09 17:48:00 +06:00
wukko
98dbba5672
api/test: add reddit to finicky list cuz reddit blocked github ips 2025-02-09 17:42:10 +06:00
jj
3f6dd4fced
api/youtube: expect errorInfo to not be json
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-08 20:59:53 +00:00
jj
a918b12387
api/tests: fix broken tests 2025-02-08 20:59:27 +00:00
jj
a8cc5bc8bc
api/instagram: update tests 2025-02-08 20:05:49 +00:00
jj
cca61275f1
api/instagram: add support for share urls
closes #998
2025-02-08 17:24:02 +00:00
jj
1be13a30bf
api/instagram: age-restricted and private account-specific errors
fixes #222
2025-02-08 16:45:31 +00:00
jj
6d18dff5cc
api/bilibili: use shortlink resolver 2025-02-08 16:27:33 +00:00
jj
bbcb2bee7c
api/pinterest: use shortlink resolver 2025-02-08 16:09:49 +00:00
jj
5db5437b62
api/pinterest: fix undefined in name when downloading shortlink 2025-02-08 16:08:34 +00:00
jj
a758b1dbc6
api/snapchat: use shortlink resolver 2025-02-08 16:06:36 +00:00
jj
9e6582b76c
api/xiaohongshu: use shortlink resolver 2025-02-08 16:05:51 +00:00
jj
6e8b4f30c1
api/url: add function for resolving shortlinks
motivation: we frequently need to resolve shortlinks to full URLs
let's have a common standard function for doing this safely
instead of reinventing the wheel in every single service module
2025-02-08 13:53:29 +00:00
jj
77dca70792
api/instagram: yet another attempt at resurrection 2025-02-07 22:47:36 +00:00
wukko
0ce777cbfc
api/internal-hls: transform segment uri when probing the HLS tunnel
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-06 14:29:42 +06:00
wukko
fd1a7530ed
merge: api updates from main
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-30 16:47:21 +06:00
jj
c48c64240b
api/internal: allow redirects when reading chunks
Some checks failed
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-29 21:51:35 +00:00
wukko
affe49474d
api/readme: fix a typo in acknowledgments
an ability -> the ability
2025-01-29 16:43:12 +06:00
wukko
1c34d2daff
merge: docs & test updates from main 2025-01-29 15:43:51 +06:00
wukko
e7d4b72c8c
api/schema: tiktokH265 -> allowH265, twitterGif -> convertGif
h265 param is already used for more than tiktok, and gif param will be used for bluesky gifs in the future
2025-01-29 15:37:58 +06:00
wukko
c7c9cf2f0f
api: add local processing response type & param
`local-processing` type returns needed info for on-device processing and creates basic proxy tunnels
2025-01-29 15:00:50 +06:00
wukko
906d929333
api/tests/pinterest: update the gif link
Some checks failed
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
because the id changed???
2025-01-23 22:00:02 +06:00
wukko
7b31817fdb
api/tests/xiaohongshu: update photo test link 2025-01-23 21:58:41 +06:00
wukko
31f6ff9b87
api/tests/loom: update test links
the old video is unavailable for an unknown reason. it's unplayable in a regular browser and also loom's own landing page.
2025-01-23 21:51:06 +06:00
wukko
99265d594b
api/readme: update list of supported services & list of dependencies 2025-01-22 14:41:44 +06:00
jj
c4c47bdc27
merge: 10.6 updates
Some checks failed
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-21 13:36:37 +00:00
wukko
cecb8a4c53
api/package: bump version to 10.6 2025-01-21 17:25:45 +06:00
wukko
36d4608ee5
api/bluesky: add support for tenor gifs 2025-01-21 17:18:49 +06:00
jj
ee3ef60a20
api/youtube: expect one of itags to be empty
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-20 20:12:21 +00:00
wukko
0ab3fe4d2a
api: itunnel transplants (#1065) 2025-01-21 00:10:49 +06:00
jj
600c769141
api/stream: implement itunnel transplants 2025-01-20 15:55:26 +00:00
jj
c07940bfa4
api/itunnel: pass itunnel object by reference 2025-01-20 15:46:03 +00:00
jj
19ade7c905
api/youtube: return internal metadata for replaying request 2025-01-20 14:47:09 +00:00
jj
7767a5f5bb
api/youtube: add support for pinning client/itag 2025-01-20 14:46:55 +00:00
jj
035825bc05
api: cache original request parameters in stream 2025-01-20 14:38:55 +00:00
wukko
7488c74faf
api/xiaohongshu: clean up the h265-h264 if statement
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:46:12 +06:00
wukko
e39b0ae7b3
api/xiaohongshu: deduplicate h264 stream extraction
reduce() isn't called on 1 item arrays, so this is just fine

Co-authored-by: jj <log@riseup.net>
2025-01-20 19:41:02 +06:00
wukko
4963c9f128
api/xiaohongshu: remove duplicated extraction error
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:37:23 +06:00
wukko
3cbed87c3e
api/xiaohongshu: update initial state extraction regex
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:35:53 +06:00
wukko
de5eca19a5
api/utils: replace redirectStatuses array with a set
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:30:11 +06:00
wukko
cd0a2a47c9
api/tests/pinterest: update expected photo status 2025-01-20 19:28:35 +06:00
wukko
cd466a418a
api/tests/bsky: fix expected photo test status 2025-01-20 19:24:12 +06:00
wukko
ad6f29a3c8
api/tests: add xiaohongshu tests 2025-01-20 19:21:44 +06:00
wukko
ed8f4353ea
api/processing: add support for xiaohongshu 2025-01-20 19:10:02 +06:00
wukko
63b2681017
api/match-action: always proxy photos 2025-01-20 19:04:31 +06:00
wukko
9bdcb9d821
api/utils: update getRedirectingURL to accept more statuses & dispatcher 2025-01-20 18:51:37 +06:00
jj
ec0d773792
api/youtube: use Math.min instead of ternary operator 2025-01-20 12:38:12 +00:00
jj
0378a1ae15
api/youtube: fix error when downloading stuff from WEB 2025-01-20 12:37:36 +00:00
wukko
ef687750b4
api/tiktok: update domain because dns records for main one are gone
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
closes #1057
2025-01-18 17:02:24 +06:00
jj
2b95af1b51
merge: fix for tiktok audio download from picker 2025-01-12 17:14:12 +00:00
jj
ce7d553beb
api/match-action: pass audio bitrate when creating tiktok stream
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
fixes #996
2025-01-12 16:43:55 +00:00
wukko
a6069f406f
api & web: merge base queue ui & api updates 2025-01-08 17:20:00 +06:00
wukko
50db4d342a
api & web: roll back the default hls change due to doubled CPU usage
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-08 11:22:05 +06:00
wukko
7db31851d0
api/package: bump version to 10.5.3 2025-01-08 10:58:49 +06:00
wukko
ec019a1b50
api/schema: enable youtubeHLS by default 2025-01-08 10:54:07 +06:00
jj
0f65165671
api/package: bump version to 10.5.2
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-27 17:17:08 +00:00
jj
a14e51d8bd
api: uninstall esbuild
also not used for a while anymore
2024-12-27 15:18:57 +00:00
jj
ac3716ae4a
api: uninstall node-cache package
not used for a while anymore
2024-12-27 15:16:49 +00:00
jj
45e7b69937
api/tunnel: add Content-Disposition to exposed headers
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-25 20:05:18 +00:00
wukko
1dc3532c5d
api/package: bump version to 10.5.1 2024-12-23 23:34:14 +06:00
wukko
4d634603e2
api/youtube: fix variable shadowing
oops
2024-12-23 23:34:05 +06:00
wukko
7f7281d794
api/package: bump version to 10.5 2024-12-23 23:21:44 +06:00
wukko
c6d0e0bdd5
api/youtube: use poToken, visitorData, and web client with cookies
and also decipher media whenever needed, but only if cookies are used
2024-12-23 22:58:16 +06:00
jj
9da3ba60a9
api/youtube: add support for cookies
Some checks are pending
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
2024-12-23 11:11:48 +00:00
jj
537d1e8b61
api: bump version to 10.4.7 2024-12-22 14:10:31 +00:00
jj
1ed7e74773
api/match-action: pass isHLS when muting audio
fixes a bug where HLS status would be ignored if a muted video
was downloaded with HLS enabled
2024-12-22 14:09:16 +00:00
jj
52b7f9523f
api/stream: remove content-length estimation from proxy()
Some checks failed
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-20 16:35:40 +00:00
jj
78d0670f50
api/stream: stfu deepsource 2024-12-17 12:20:17 +00:00
jj
06c348126e
api/stream: remove random undici import
wtf
2024-12-17 12:16:04 +00:00
jj
fec07d0e10
api: add cors headers for tunnels 2024-12-16 17:45:02 +00:00
jj
f5b47a2b7e
api/tunnel: adjust estimate multiplier to 1.1 2024-12-16 17:42:39 +00:00
jj
6e6a792984
api/bilibili: mark tunnel as isHLS where appropriate 2024-12-16 17:41:38 +00:00
jj
05e0f031ed
api/stream: add Estimated-Content-Length header to tunnels
present where Content-Length cannot be accurately calculated,
pure proxy streams do not have this header and instead have
the accurate Content-Length one.
2024-12-16 17:07:30 +00:00
jj
11388cb418
api/stream: await all call types 2024-12-16 16:21:38 +00:00
jj
bf4675a5e3
api/stream: move bsky override into isHlsResponse 2024-12-16 11:29:13 +00:00
jj
bc597c817f
api: move itunnel handlers to separate file 2024-12-16 10:38:31 +00:00
jj
f06aa65801
api: always create separate server for itunnels 2024-12-16 10:19:15 +00:00
jj
e7c2872e40
api/stream: rename getInternalStream to getInternalTunnel 2024-12-16 10:16:48 +00:00
wukko
2e4b76de6e
api/package: bump version to 10.4.6 2024-12-16 00:04:58 +06:00
jj
459b2c8283
api/internal-hls: don't remake chunk istreams if already wrapped 2024-12-15 17:59:47 +00:00
wukko
86a67dee83
api/package: bump version to 10.4.5
Some checks failed
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-13 16:03:32 +06:00
wukko
3dafdd825a
api/types/proxy: use default dispatcher instead of a global one
this function never gets anything but internal streams, so global proxy (`API_EXTERNAL_PROXY`) is only causing issues here. this commit fixes an issue of cobalt attempting to proxy internal streams, and failing spectacularly.
2024-12-13 16:01:16 +06:00
wukko
5973d70053
api/package: bump version to 10.4.4 & update youtube.js
Some checks failed
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
2024-12-12 23:03:00 +06:00
wukko
112866096c
api/url: return a diff error when youtube is disabled on main instance 2024-12-12 23:00:49 +06:00
wukko
e041e376c7
api & web: bump dependencies
Some checks failed
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-10 19:55:43 +06:00
wukko
4b8b0a0e9e
api/youtube: don't retrieve the player as cobalt doesn't use it
we don't decipher anything lol
2024-12-10 17:30:32 +06:00
wukko
e1b84e7472
api/package: bump version to 10.4.3
Some checks failed
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-05 00:27:53 +06:00
jj
6f0a8196ff
api/istream: remove icy-metadata header if sent by client 2024-12-04 18:25:25 +00:00
jj
6c39edbc10
api/stream: use dispatcher if passed to istream 2024-12-04 18:17:13 +00:00
wukko
6ca377ded6
api/tiktok: catch unavailable post error
Some checks are pending
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run service tests / test service functionality (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2024-12-04 12:28:05 +06:00
wukko
0e5914f66c
api/package: bump version 10.4.2
Some checks failed
Run service tests / test service functionality (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-11-28 17:53:35 +06:00
wukko
15a0ba30c7
api/tests/vk: add new domain test 2024-11-28 17:32:41 +06:00
wukko
4700682ccb
api/vk: refactor quality picking 2024-11-28 17:32:10 +06:00
wukko
f696335278
api/vk: use proper api, add support for more links, refactor
also added support for video access keys
2024-11-28 16:01:26 +06:00